Jun 08 23:59:09.915014 ip-10-0-128-73 systemd[1]: Starting Kubernetes Kubelet... Jun 08 23:59:10.363003 ip-10-0-128-73 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 23:59:10.363003 ip-10-0-128-73 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 23:59:10.363003 ip-10-0-128-73 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 23:59:10.363003 ip-10-0-128-73 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 23:59:10.363003 ip-10-0-128-73 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 23:59:10.364157 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.364066 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 23:59:10.368350 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368330 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:10.368350 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368348 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:10.368350 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368353 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:10.368350 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368357 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368361 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368365 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368371 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368375 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368379 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368383 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368387 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368395 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368400 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368404 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368409 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368414 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368419 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368424 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368428 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368432 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368437 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368443 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:10.368592 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368448 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368453 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368457 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368462 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368465 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368469 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368475 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368479 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368483 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368487 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368492 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368496 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368500 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368504 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368508 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368514 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368518 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368523 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368527 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368532 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:10.369419 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368536 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368542 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368546 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368550 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368554 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368558 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368562 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368567 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368571 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368575 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368579 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368583 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368587 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368590 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368594 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368598 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368602 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368606 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368610 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368614 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:10.370300 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368618 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368624 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368628 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368632 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368636 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368641 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368645 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368649 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368654 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368658 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368662 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368666 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368670 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368675 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368679 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368684 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368688 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368692 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368696 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368700 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:10.371178 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368704 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368708 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368712 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368716 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368720 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368724 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368728 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368732 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368756 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368761 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368767 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368772 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368777 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368781 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368785 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368789 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.368793 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.369977 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.369988 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.369994 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:10.372063 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.369998 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370003 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370007 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370011 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370015 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370019 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370024 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370029 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370033 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370037 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370042 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370046 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370050 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370054 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370058 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370062 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370066 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370070 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370074 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:10.372926 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370081 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370087 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370092 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370096 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370102 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370106 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370110 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370115 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370119 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370123 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370127 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370132 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370137 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370142 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370146 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370150 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370154 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370158 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370163 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:10.373529 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370167 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370171 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370176 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370180 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370184 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370188 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370192 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370197 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370201 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370206 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370210 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370214 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370218 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370222 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370226 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370230 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370235 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370241 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370246 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370251 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:10.374102 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370256 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370260 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370265 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370269 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370273 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370282 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370287 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370291 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370295 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370299 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370303 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370306 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370310 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370314 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370318 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370323 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370327 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370331 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370335 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:10.374611 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370340 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370345 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370350 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370354 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370359 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370363 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370367 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370371 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370376 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370381 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370386 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370390 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370394 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370398 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370402 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370406 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370410 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370414 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.370420 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:10.375250 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371073 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371084 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371089 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371094 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371099 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371103 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371107 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371112 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371116 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371121 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371126 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371130 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371134 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371138 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371142 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371146 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371151 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371156 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371160 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371164 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:10.375800 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371169 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371173 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371177 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371181 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371185 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371188 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371192 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371196 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371200 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371204 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371208 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371214 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371221 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371227 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371232 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371236 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371240 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371244 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371248 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371252 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:10.376292 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371256 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371261 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371269 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371275 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371280 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371284 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371289 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371293 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371296 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371301 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371306 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371310 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371314 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371319 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371323 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371327 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371331 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371338 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:10.376867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371343 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371348 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371353 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371357 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371361 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371366 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371370 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371374 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371379 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371399 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371404 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371408 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371414 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371420 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371424 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371429 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371433 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371439 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371443 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371447 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:10.377324 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371451 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371455 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371459 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371463 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371467 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371471 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371475 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371479 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371483 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371487 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371491 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371495 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371499 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371503 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371507 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371511 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371516 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371521 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371525 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371530 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.371534 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:10.377867 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371621 2573 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371632 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371641 2573 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371648 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371656 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371661 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371667 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371674 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371679 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371684 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371690 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371695 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371700 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371705 2573 flags.go:64] FLAG: --cgroup-root="" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371710 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371716 2573 flags.go:64] FLAG: --client-ca-file="" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371720 2573 flags.go:64] FLAG: --cloud-provider="external" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371725 2573 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371731 2573 flags.go:64] FLAG: --cluster-domain="" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371753 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371759 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371764 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371769 2573 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371775 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 23:59:10.378372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371780 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371785 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371790 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371795 2573 flags.go:64] FLAG: --contention-profiling="false" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371802 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371806 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371811 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371816 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371823 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371829 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371833 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371838 2573 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371844 2573 flags.go:64] FLAG: --enable-server="true" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371849 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371856 2573 flags.go:64] FLAG: --event-burst="100" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371861 2573 flags.go:64] FLAG: --event-qps="50" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371866 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371871 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371876 2573 flags.go:64] FLAG: --eviction-hard="" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371883 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371887 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371892 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371897 2573 flags.go:64] FLAG: --eviction-soft="" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371901 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371906 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 23:59:10.378977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371911 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371916 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371921 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371925 2573 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371930 2573 flags.go:64] FLAG: --feature-gates="" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371936 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371941 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371946 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371951 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371956 2573 flags.go:64] FLAG: --healthz-port="10248" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371961 2573 flags.go:64] FLAG: --help="false" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371967 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371972 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371977 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371982 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371987 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371993 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.371998 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372002 2573 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372008 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372013 2573 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372018 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372022 2573 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372027 2573 flags.go:64] FLAG: --kube-reserved="" Jun 08 23:59:10.379663 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372032 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372037 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372043 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372047 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372052 2573 flags.go:64] FLAG: --lock-file="" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372056 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372061 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372066 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372074 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372079 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372083 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372087 2573 flags.go:64] FLAG: --logging-format="text" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372092 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372098 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372103 2573 flags.go:64] FLAG: --manifest-url="" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372108 2573 flags.go:64] FLAG: --manifest-url-header="" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372114 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372119 2573 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372125 2573 flags.go:64] FLAG: --max-pods="110" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372130 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372135 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372139 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372144 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372149 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372154 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 23:59:10.380340 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372159 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372168 2573 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372175 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372180 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372185 2573 flags.go:64] FLAG: --pod-cidr="" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372189 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372202 2573 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372206 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372211 2573 flags.go:64] FLAG: --pods-per-core="0" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372215 2573 flags.go:64] FLAG: --port="10250" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372221 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372226 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0faf434649754d9c1" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372231 2573 flags.go:64] FLAG: --qos-reserved="" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372236 2573 flags.go:64] FLAG: --read-only-port="10255" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372241 2573 flags.go:64] FLAG: --register-node="true" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372245 2573 flags.go:64] FLAG: --register-with-taints="" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372251 2573 flags.go:64] FLAG: --registry-burst="10" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372255 2573 flags.go:64] FLAG: --registry-qps="5" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372260 2573 flags.go:64] FLAG: --reserved-cpus="" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372264 2573 flags.go:64] FLAG: --reserved-memory="" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372270 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372275 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372280 2573 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372284 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372289 2573 flags.go:64] FLAG: --runonce="false" Jun 08 23:59:10.380985 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372293 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372298 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372304 2573 flags.go:64] FLAG: --seccomp-default="false" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372309 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372314 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372319 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372324 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372329 2573 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372333 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372339 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372344 2573 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372349 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372354 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372359 2573 flags.go:64] FLAG: --system-cgroups="" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372364 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372372 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372376 2573 flags.go:64] FLAG: --tls-cert-file="" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372381 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372388 2573 flags.go:64] FLAG: --tls-min-version="" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372393 2573 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372398 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372403 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372407 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372412 2573 flags.go:64] FLAG: --v="2" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372418 2573 flags.go:64] FLAG: --version="false" Jun 08 23:59:10.381943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372428 2573 flags.go:64] FLAG: --vmodule="" Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372434 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.372440 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372640 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372647 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372652 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372657 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372662 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372667 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372671 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372676 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372681 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372685 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372689 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372693 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372698 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372707 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372712 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372716 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372720 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:10.382958 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372724 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372728 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372732 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372754 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372759 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372763 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372768 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372772 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372776 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372780 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372785 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372789 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372793 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372798 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372802 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372806 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372810 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372814 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372818 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372822 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:10.383664 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372826 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372831 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372835 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372839 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372843 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372847 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372851 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372855 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372861 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372866 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372871 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372877 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372883 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372890 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372895 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372900 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372904 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372909 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372913 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:10.384187 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372918 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372922 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372926 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372930 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372934 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372938 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372942 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372946 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372950 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372954 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372966 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372970 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372975 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372979 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372986 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372990 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372994 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.372999 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373003 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373007 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:10.384851 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373011 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373016 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373021 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373025 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373029 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373034 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373038 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373042 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373046 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373049 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373054 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373058 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373062 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373067 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373073 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373078 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373083 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373087 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373093 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373097 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:10.385733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373102 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373106 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.373110 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.373944 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.383307 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.383458 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.384405 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.384420 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384507 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384515 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384520 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384524 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384529 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384533 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384538 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:10.386299 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384542 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384546 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384550 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384554 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384558 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384562 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384566 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384570 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384574 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384578 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384582 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384586 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384590 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384594 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384598 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384607 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384612 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384616 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384620 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:10.386791 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384624 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384628 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384632 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384638 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384643 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384647 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384651 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384655 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384659 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384664 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384668 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384672 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384676 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384680 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384686 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384691 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384696 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384700 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384705 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:10.387376 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384710 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384715 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384720 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384724 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384728 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384733 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384756 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384761 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384764 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384769 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384773 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384777 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384781 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384786 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384790 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384794 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384798 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384803 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384807 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384811 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:10.387925 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384815 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384819 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384823 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384828 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384832 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384836 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384842 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384847 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384851 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384856 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384860 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384864 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384868 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384872 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384877 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384881 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384885 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384890 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384894 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384898 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:10.388567 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384902 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384906 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384910 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384914 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384918 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384922 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384926 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384930 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384934 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384938 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384943 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384947 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384951 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.384955 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.384974 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 23:59:10.389372 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385145 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385153 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385158 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385162 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385167 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385171 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385175 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385178 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385182 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385187 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385191 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385195 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385200 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385204 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385208 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385212 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385216 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385220 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385224 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385228 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:10.389733 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385232 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385237 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385241 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385245 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385249 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385253 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385257 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385261 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385265 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385269 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385273 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385277 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385281 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385286 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385290 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385294 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385298 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385302 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385307 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385311 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:10.390342 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385315 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385318 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385322 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385326 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385330 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385335 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385340 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385343 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385348 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385352 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385356 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385360 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385366 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385371 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385375 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385379 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385383 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385387 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385391 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:10.390877 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385395 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385401 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385405 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385409 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385414 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385418 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385422 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385426 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385430 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385435 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385439 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385443 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385447 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385453 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385459 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385464 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385469 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385473 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385478 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:10.391326 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385484 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385488 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385492 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385497 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385501 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385505 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385510 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385513 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385518 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385522 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385526 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385530 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385534 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385538 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385545 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385549 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385553 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385557 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385561 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:10.391938 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385565 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:10.392388 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:10.385572 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:10.392388 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.385580 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 23:59:10.392388 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.385714 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 23:59:10.392388 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.389947 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 23:59:10.392388 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.391635 2573 server.go:1019] "Starting client certificate rotation" Jun 08 23:59:10.392388 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.391755 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 23:59:10.392388 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.391796 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 23:59:10.394579 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.394561 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 23:59:10.395819 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.395799 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 23:59:10.403559 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.403545 2573 log.go:25] "Validated CRI v1 runtime API" Jun 08 23:59:10.406533 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.406520 2573 log.go:25] "Validated CRI v1 image API" Jun 08 23:59:10.407295 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.407282 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 23:59:10.410260 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.410243 2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c869937d-2c8a-42af-b4af-66acdf799429:/dev/nvme0n1p3 fc891423-5437-4755-a453-d20b64a915a3:/dev/nvme0n1p4] Jun 08 23:59:10.410311 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.410260 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 23:59:10.416909 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.416784 2573 manager.go:216] Machine: {Timestamp:2026-06-08 23:59:10.415461955 +0000 UTC m=+0.373729550 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3118855 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2025ac6ca127e9d36bb10cc3bb4df4 SystemUUID:ec2025ac-6ca1-27e9-d36b-b10cc3bb4df4 BootID:b5c5d666-c4b8-4b2e-9903-a6186c58761e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e5:79:4f:0e:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e5:79:4f:0e:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:7b:d5:b5:77:34 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 23:59:10.416909 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.416903 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 23:59:10.417028 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.417012 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 23:59:10.420664 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.420644 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 23:59:10.420838 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.420674 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-73.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 23:59:10.421582 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.421572 2573 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 23:59:10.421616 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.421585 2573 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 23:59:10.421616 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.421592 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 23:59:10.422424 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.422412 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 23:59:10.423816 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.423804 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 23:59:10.427038 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.427021 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 23:59:10.429041 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.429021 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 08 23:59:10.429164 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.429154 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 23:59:10.429209 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.429186 2573 kubelet.go:486] "Attempting to sync node with API server" Jun 08 23:59:10.429209 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.429196 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 23:59:10.429209 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.429210 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 23:59:10.429286 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.429219 2573 kubelet.go:398] "Adding apiserver pod source" Jun 08 23:59:10.429286 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.429227 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 23:59:10.429686 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.429668 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 23:59:10.429718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.429694 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 23:59:10.431999 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.431984 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 23:59:10.434112 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.434096 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 23:59:10.434164 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.434142 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 23:59:10.435025 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.435012 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 23:59:10.435078 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.435035 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 23:59:10.435078 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.435045 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 23:59:10.435078 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.435055 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 23:59:10.435078 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.435067 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 23:59:10.435078 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.435076 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 23:59:10.435203 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.435089 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 23:59:10.435203 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.435097 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 23:59:10.435203 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.435106 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 23:59:10.435203 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.435115 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 23:59:10.435203 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.435128 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 23:59:10.435203 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.435136 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 23:59:10.436161 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.436148 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 23:59:10.436196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.436165 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 23:59:10.439191 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.439180 2573 server.go:1268] "Started kubelet" Jun 08 23:59:10.439383 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.439363 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 23:59:10.439658 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.439631 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 23:59:10.439769 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.439672 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 23:59:10.439895 ip-10-0-128-73 systemd[1]: Started Kubernetes Kubelet. Jun 08 23:59:10.441889 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.441869 2573 server.go:310] "Adding debug handlers to kubelet server" Jun 08 23:59:10.441976 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.441927 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 23:59:10.448135 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.448115 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 23:59:10.449648 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.449628 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 23:59:10.449780 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.449694 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 23:59:10.450050 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.450025 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found" Jun 08 23:59:10.450496 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.450471 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 23:59:10.450660 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.450472 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 23:59:10.450818 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.450799 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 23:59:10.450949 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.450602 2573 factory.go:55] Registering systemd factory Jun 08 23:59:10.451003 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.450957 2573 factory.go:223] Registration of the systemd container factory successfully Jun 08 23:59:10.451169 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.451153 2573 reconstruct.go:97] "Volume reconstruction finished" Jun 08 23:59:10.451244 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.451171 2573 reconciler.go:29] "Reconciler: start to sync state" Jun 08 23:59:10.451244 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.451242 2573 factory.go:153] Registering CRI-O factory Jun 08 23:59:10.451347 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.451257 2573 factory.go:223] Registration of the crio container factory successfully Jun 08 23:59:10.451347 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.451305 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 23:59:10.451347 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.451328 2573 factory.go:103] Registering Raw factory Jun 08 23:59:10.451347 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.451330 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-73.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 23:59:10.451347 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.451345 2573 manager.go:1196] Started watching for new ooms in manager Jun 08 23:59:10.451821 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.451805 2573 manager.go:349] Starting recovery of all containers Jun 08 23:59:10.452131 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.452091 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 23:59:10.452131 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.452089 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 23:59:10.452544 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.451369 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-73.ec2.internal.18b7408ca3fc8616 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-73.ec2.internal,UID:ip-10-0-128-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-73.ec2.internal,},FirstTimestamp:2026-06-08 23:59:10.439155222 +0000 UTC m=+0.397422816,LastTimestamp:2026-06-08 23:59:10.439155222 +0000 UTC m=+0.397422816,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-73.ec2.internal,}" Jun 08 23:59:10.453478 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.453450 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 23:59:10.453597 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.453577 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 23:59:10.460385 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.460339 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 23:59:10.465241 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.465219 2573 manager.go:354] Recovery completed Jun 08 23:59:10.466573 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.466548 2573 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 08 23:59:10.469384 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.469373 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:10.471068 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.471053 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:10.471128 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.471079 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:10.471128 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.471097 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:10.471560 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.471544 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 23:59:10.471560 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.471557 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 23:59:10.471660 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.471573 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 08 23:59:10.471660 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.471548 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:10.472326 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.472312 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:10.472375 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.472334 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:10.472375 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.472345 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:10.473167 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.473108 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-73.ec2.internal.18b7408ca5e378ed default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-73.ec2.internal,UID:ip-10-0-128-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-73.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-73.ec2.internal,},FirstTimestamp:2026-06-08 23:59:10.471067885 +0000 UTC m=+0.429335482,LastTimestamp:2026-06-08 23:59:10.471067885 +0000 UTC m=+0.429335482,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-73.ec2.internal,}" Jun 08 23:59:10.473860 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.473848 2573 policy_none.go:49] "None policy: Start" Jun 08 23:59:10.473904 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.473864 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 23:59:10.473904 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.473873 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 23:59:10.475362 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.475352 2573 policy_none.go:47] "Start" Jun 08 23:59:10.482095 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.482078 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fg6h5" Jun 08 23:59:10.483466 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.483412 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-73.ec2.internal.18b7408ca5e3b7ac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-73.ec2.internal,UID:ip-10-0-128-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-73.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-73.ec2.internal,},FirstTimestamp:2026-06-08 23:59:10.471083948 +0000 UTC m=+0.429351542,LastTimestamp:2026-06-08 23:59:10.471083948 +0000 UTC m=+0.429351542,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-73.ec2.internal,}" Jun 08 23:59:10.487024 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.487008 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fg6h5" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.509977 2573 manager.go:337] "Starting Device Plugin manager" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.510013 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.510023 2573 server.go:87] "Starting device plugin registration server" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.510224 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.510237 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.510302 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.510401 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.510410 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.511184 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.511235 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-73.ec2.internal\" not found" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.525328 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.525360 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.525378 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.525426 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 23:59:10.535971 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.527271 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:10.610485 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.610455 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:10.612090 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.612077 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:10.612157 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.612104 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:10.612157 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.612114 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:10.612157 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.612135 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.620484 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.620444 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.620484 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.620468 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-73.ec2.internal\": node \"ip-10-0-128-73.ec2.internal\" not found" Jun 08 23:59:10.626391 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.626371 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"] Jun 08 23:59:10.626455 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.626426 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:10.627200 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.627170 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:10.627200 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.627190 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:10.627200 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.627199 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:10.629728 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.629716 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:10.629832 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.629820 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.629866 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.629853 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:10.632080 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.632064 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:10.632166 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.632093 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:10.632166 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.632104 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:10.632818 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.632795 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:10.632818 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.632819 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:10.632915 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.632832 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:10.635305 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.635289 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.635383 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.635313 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:10.635990 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.635976 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:10.636065 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.636005 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:10.636065 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.636019 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:10.643378 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.643362 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found" Jun 08 23:59:10.658261 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.658238 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-73.ec2.internal\" not found" node="ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.662425 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.662409 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-73.ec2.internal\" not found" node="ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.743783 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.743755 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found" Jun 08 23:59:10.751713 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.751692 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58267d6e6471fb16c1b68a4f6cfaa490-config\") pod \"kube-apiserver-proxy-ip-10-0-128-73.ec2.internal\" (UID: \"58267d6e6471fb16c1b68a4f6cfaa490\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.751792 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.751722 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.751792 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.751757 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.844393 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.844350 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found" Jun 08 23:59:10.852696 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.852677 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58267d6e6471fb16c1b68a4f6cfaa490-config\") pod \"kube-apiserver-proxy-ip-10-0-128-73.ec2.internal\" (UID: \"58267d6e6471fb16c1b68a4f6cfaa490\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.852761 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.852700 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.852761 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.852721 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.852833 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.852777 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.852833 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.852797 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.852833 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.852797 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58267d6e6471fb16c1b68a4f6cfaa490-config\") pod \"kube-apiserver-proxy-ip-10-0-128-73.ec2.internal\" (UID: \"58267d6e6471fb16c1b68a4f6cfaa490\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.945125 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:10.945079 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found" Jun 08 23:59:10.966574 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.966556 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" Jun 08 23:59:10.969435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:10.969412 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" Jun 08 23:59:11.045234 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:11.045209 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found" Jun 08 23:59:11.145727 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:11.145700 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found" Jun 08 23:59:11.246208 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:11.246184 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found" Jun 08 23:59:11.346955 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:11.346927 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found" Jun 08 23:59:11.363053 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.363030 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:11.391011 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.390989 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 23:59:11.391133 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.391112 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 23:59:11.391174 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.391126 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 23:59:11.447519 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:11.447498 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found" Jun 08 23:59:11.490476 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.490419 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 23:54:10 +0000 UTC" deadline="2028-01-18 19:52:18.085030039 +0000 UTC" Jun 08 23:59:11.490476 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.490464 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14131h53m6.594569377s" Jun 08 23:59:11.539073 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.539006 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:11.539923 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.539903 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:11.539988 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.539944 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:11.539988 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.539960 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:11.548198 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:11.548179 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found" Jun 08 23:59:11.592539 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:11.592387 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58267d6e6471fb16c1b68a4f6cfaa490.slice/crio-12fefe9d613f2260768b1bf10fc8e3e98fcc4fc2c2d267cc6192b702e1f5c14a WatchSource:0}: Error finding container 12fefe9d613f2260768b1bf10fc8e3e98fcc4fc2c2d267cc6192b702e1f5c14a: Status 404 returned error can't find the container with id 12fefe9d613f2260768b1bf10fc8e3e98fcc4fc2c2d267cc6192b702e1f5c14a Jun 08 23:59:11.593407 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:11.593388 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa226fc2d2c5f842f452b30ccab5b919.slice/crio-ced52bfdb96ea73dac10731ed2bd44cf90e70bed69e048011e8c65c0897eb284 WatchSource:0}: Error finding container ced52bfdb96ea73dac10731ed2bd44cf90e70bed69e048011e8c65c0897eb284: Status 404 returned error can't find the container with id ced52bfdb96ea73dac10731ed2bd44cf90e70bed69e048011e8c65c0897eb284 Jun 08 23:59:11.599578 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.599562 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 23:59:11.627887 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.627862 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:11.650504 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.650487 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" Jun 08 23:59:11.659467 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.659454 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 23:59:11.660677 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.660666 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" Jun 08 23:59:11.672075 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:11.672057 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 23:59:12.005876 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.005845 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:12.431134 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.431069 2573 apiserver.go:52] "Watching apiserver" Jun 08 23:59:12.440944 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.440914 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 23:59:12.442343 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.442314 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-d2xbc","kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4","openshift-dns/node-resolver-r4ksj","openshift-image-registry/node-ca-6cn9v","openshift-multus/multus-9sncw","openshift-multus/network-metrics-daemon-tcxq6","openshift-cluster-node-tuning-operator/tuned-m8jj9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal","openshift-multus/multus-additional-cni-plugins-8l77g","openshift-network-diagnostics/network-check-target-zz4hd","openshift-network-operator/iptables-alerter-vgt8w","openshift-ovn-kubernetes/ovnkube-node-twgfd","kube-system/global-pull-secret-syncer-nr9c8"] Jun 08 23:59:12.445088 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.445063 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:12.445198 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:12.445142 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:12.447804 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.447163 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.449776 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.449233 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.449965 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.449946 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tpt9z\"" Jun 08 23:59:12.450688 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.450670 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 23:59:12.450797 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.450784 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 23:59:12.451787 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.451088 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 23:59:12.451787 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.451261 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 23:59:12.451787 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.451284 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 23:59:12.451787 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.451474 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 23:59:12.451787 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.451595 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 23:59:12.451787 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.451647 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 23:59:12.451787 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.451661 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 23:59:12.452191 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.451806 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 23:59:12.452191 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.451926 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r4ksj" Jun 08 23:59:12.452441 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.452420 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p8xps\"" Jun 08 23:59:12.453289 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.453259 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6cn9v" Jun 08 23:59:12.454768 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.454731 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 23:59:12.454865 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.454772 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2rwlp\"" Jun 08 23:59:12.454923 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.454913 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 23:59:12.455280 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.455263 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 23:59:12.455506 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.455489 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cjhmx\"" Jun 08 23:59:12.455577 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.455493 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 23:59:12.455577 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.455532 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.455856 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.455838 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 23:59:12.457672 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.457655 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:12.457772 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:12.457716 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:12.458783 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.458764 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nlct9\"" Jun 08 23:59:12.458899 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.458825 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 23:59:12.458899 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.458865 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 23:59:12.459055 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.458906 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 23:59:12.459113 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.458684 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 23:59:12.460347 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.460324 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d2xbc" Jun 08 23:59:12.461241 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461221 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-slash\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.461351 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461255 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-run-ovn\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.461351 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461280 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-log-socket\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.461351 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461303 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e-tmp-dir\") pod \"node-resolver-r4ksj\" (UID: \"3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e\") " pod="openshift-dns/node-resolver-r4ksj" Jun 08 23:59:12.461351 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461325 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-cni-netd\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.461547 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-registration-dir\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.461547 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461379 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-sys-fs\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.461547 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461462 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrd6z\" (UniqueName: \"kubernetes.io/projected/314dabf5-096d-442a-9db1-83512bf87f66-kube-api-access-lrd6z\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:12.461547 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461515 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-kubelet\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.461756 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461542 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-run-systemd\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.461756 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461592 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-run-ovn-kubernetes\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.461756 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461617 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e-hosts-file\") pod \"node-resolver-r4ksj\" (UID: \"3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e\") " pod="openshift-dns/node-resolver-r4ksj" Jun 08 23:59:12.461756 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461593 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 23:59:12.461756 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461633 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6q67\" (UniqueName: \"kubernetes.io/projected/3de9a184-ebf5-487a-b4c9-0f657559543b-kube-api-access-z6q67\") pod \"node-ca-6cn9v\" (UID: \"3de9a184-ebf5-487a-b4c9-0f657559543b\") " pod="openshift-image-registry/node-ca-6cn9v" Jun 08 23:59:12.461756 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461674 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-node-log\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.461756 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461694 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/219c3767-e998-4f79-a227-45681847cac2-ovnkube-config\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.461756 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461717 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/219c3767-e998-4f79-a227-45681847cac2-ovnkube-script-lib\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.462182 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461766 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.462182 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461790 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4m9t\" (UniqueName: \"kubernetes.io/projected/3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e-kube-api-access-w4m9t\") pod \"node-resolver-r4ksj\" (UID: \"3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e\") " pod="openshift-dns/node-resolver-r4ksj" Jun 08 23:59:12.462182 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461824 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-var-lib-openvswitch\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.462182 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461915 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-run-netns\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.462182 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461949 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-etc-openvswitch\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.462182 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461964 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-socket-dir\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.462182 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.461980 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-run-openvswitch\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.462182 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-cni-bin\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.462182 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462040 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.462182 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462061 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/219c3767-e998-4f79-a227-45681847cac2-env-overrides\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.462182 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/219c3767-e998-4f79-a227-45681847cac2-ovn-node-metrics-cert\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.462683 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462199 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.462683 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462227 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-device-dir\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.462683 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462265 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhhtw\" (UniqueName: \"kubernetes.io/projected/9d54514a-72c8-46e9-8bc4-bdd3426ae010-kube-api-access-qhhtw\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.462683 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462304 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3de9a184-ebf5-487a-b4c9-0f657559543b-host\") pod \"node-ca-6cn9v\" (UID: \"3de9a184-ebf5-487a-b4c9-0f657559543b\") " pod="openshift-image-registry/node-ca-6cn9v" Jun 08 23:59:12.462683 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462353 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3de9a184-ebf5-487a-b4c9-0f657559543b-serviceca\") pod \"node-ca-6cn9v\" (UID: \"3de9a184-ebf5-487a-b4c9-0f657559543b\") " pod="openshift-image-registry/node-ca-6cn9v" Jun 08 23:59:12.462683 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462381 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54v5q\" (UniqueName: \"kubernetes.io/projected/219c3767-e998-4f79-a227-45681847cac2-kube-api-access-54v5q\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.462683 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:12.462683 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462423 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-systemd-units\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.462683 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462452 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 23:59:12.462683 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462467 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r8pfz\"" Jun 08 23:59:12.462683 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.462468 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 23:59:12.463543 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.463438 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.467876 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.466201 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 23:59:12.467876 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.466905 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 23:59:12.467876 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.467540 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qgpkg\"" Jun 08 23:59:12.469755 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.469721 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.471699 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.471678 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:12.471816 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:12.471766 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:12.471882 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.471856 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 23:59:12.472250 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.472062 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p98ng\"" Jun 08 23:59:12.472250 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.472085 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 23:59:12.474803 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.473972 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vgt8w" Jun 08 23:59:12.476456 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.476190 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 23:59:12.477054 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.477024 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 23:59:12.477142 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.477075 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 23:59:12.477460 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.477442 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fskzn\"" Jun 08 23:59:12.493382 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.493362 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5hwvp" Jun 08 23:59:12.499467 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.499449 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5hwvp" Jun 08 23:59:12.530505 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.530461 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" event={"ID":"fa226fc2d2c5f842f452b30ccab5b919","Type":"ContainerStarted","Data":"ced52bfdb96ea73dac10731ed2bd44cf90e70bed69e048011e8c65c0897eb284"} Jun 08 23:59:12.531707 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.531684 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" event={"ID":"58267d6e6471fb16c1b68a4f6cfaa490","Type":"ContainerStarted","Data":"12fefe9d613f2260768b1bf10fc8e3e98fcc4fc2c2d267cc6192b702e1f5c14a"} Jun 08 23:59:12.552624 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.552604 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 23:59:12.562609 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562582 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26cea4d5-7028-4cf2-99b2-b8241284895e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.562703 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562616 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-os-release\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.562703 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562653 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-var-lib-kubelet\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.562842 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562725 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.562842 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562774 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-kubernetes\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.562842 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562800 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-var-lib-kubelet\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.562842 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562817 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-multus-socket-dir-parent\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.562842 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562819 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.562842 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-run-netns\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.563119 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562877 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11c3f5bf-538b-4ca6-8d53-e3562fa2e54e-konnectivity-ca\") pod \"konnectivity-agent-d2xbc\" (UID: \"11c3f5bf-538b-4ca6-8d53-e3562fa2e54e\") " pod="kube-system/konnectivity-agent-d2xbc" Jun 08 23:59:12.563119 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562884 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-run-netns\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.563119 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562916 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59a522e7-fc0f-4076-affc-9d1591204d64-tmp\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.563119 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562939 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26cea4d5-7028-4cf2-99b2-b8241284895e-os-release\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.563119 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562963 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzbpp\" (UniqueName: \"kubernetes.io/projected/675ca9df-c1ee-4798-9dbd-7bfe881cf901-kube-api-access-wzbpp\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.563119 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562981 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:12.563119 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.562996 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-cni-bin\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.563119 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563013 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/219c3767-e998-4f79-a227-45681847cac2-env-overrides\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.563119 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563034 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/219c3767-e998-4f79-a227-45681847cac2-ovn-node-metrics-cert\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.563119 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563055 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-systemd\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.563119 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26cea4d5-7028-4cf2-99b2-b8241284895e-system-cni-dir\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.563119 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563076 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-cni-bin\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.563119 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563086 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26cea4d5-7028-4cf2-99b2-b8241284895e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563141 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dae8492-c623-4219-9ac7-c33927a73c65-host-slash\") pod \"iptables-alerter-vgt8w\" (UID: \"5dae8492-c623-4219-9ac7-c33927a73c65\") " pod="openshift-network-operator/iptables-alerter-vgt8w" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563203 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-run-k8s-cni-cncf-io\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563231 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563255 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3de9a184-ebf5-487a-b4c9-0f657559543b-serviceca\") pod \"node-ca-6cn9v\" (UID: \"3de9a184-ebf5-487a-b4c9-0f657559543b\") " pod="openshift-image-registry/node-ca-6cn9v" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563276 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4phc\" (UniqueName: \"kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc\") pod \"network-check-target-zz4hd\" (UID: \"36e2bd15-8d51-4018-a5cb-daba9c9cd0f5\") " pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563301 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563363 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-systemd-units\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563389 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-slash\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:12.563402 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563412 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-run-ovn\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563436 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-log-socket\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563441 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-systemd-units\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563447 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:12.563477 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs podName:314dabf5-096d-442a-9db1-83512bf87f66 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:13.063440981 +0000 UTC m=+3.021708583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs") pod "network-metrics-daemon-tcxq6" (UID: "314dabf5-096d-442a-9db1-83512bf87f66") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563474 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-log-socket\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.563720 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/219c3767-e998-4f79-a227-45681847cac2-env-overrides\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563551 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-slash\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563495 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-run-ovn\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563602 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11c3f5bf-538b-4ca6-8d53-e3562fa2e54e-agent-certs\") pod \"konnectivity-agent-d2xbc\" (UID: \"11c3f5bf-538b-4ca6-8d53-e3562fa2e54e\") " pod="kube-system/konnectivity-agent-d2xbc" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563627 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/675ca9df-c1ee-4798-9dbd-7bfe881cf901-multus-daemon-config\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563651 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36d64b55-58c7-4005-859a-0a895a3a1971-kubelet-config\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563699 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e-tmp-dir\") pod \"node-resolver-r4ksj\" (UID: \"3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e\") " pod="openshift-dns/node-resolver-r4ksj" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563725 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-sysctl-d\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563764 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-run\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563848 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-host\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrd6z\" (UniqueName: \"kubernetes.io/projected/314dabf5-096d-442a-9db1-83512bf87f66-kube-api-access-lrd6z\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563928 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3de9a184-ebf5-487a-b4c9-0f657559543b-serviceca\") pod \"node-ca-6cn9v\" (UID: \"3de9a184-ebf5-487a-b4c9-0f657559543b\") " pod="openshift-image-registry/node-ca-6cn9v" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.563995 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dae8492-c623-4219-9ac7-c33927a73c65-iptables-alerter-script\") pod \"iptables-alerter-vgt8w\" (UID: \"5dae8492-c623-4219-9ac7-c33927a73c65\") " pod="openshift-network-operator/iptables-alerter-vgt8w" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564022 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-multus-cni-dir\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564040 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e-tmp-dir\") pod \"node-resolver-r4ksj\" (UID: \"3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e\") " pod="openshift-dns/node-resolver-r4ksj" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564045 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-run-netns\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564124 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-var-lib-cni-multus\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.564515 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564152 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6q67\" (UniqueName: \"kubernetes.io/projected/3de9a184-ebf5-487a-b4c9-0f657559543b-kube-api-access-z6q67\") pod \"node-ca-6cn9v\" (UID: \"3de9a184-ebf5-487a-b4c9-0f657559543b\") " pod="openshift-image-registry/node-ca-6cn9v" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564176 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/219c3767-e998-4f79-a227-45681847cac2-ovnkube-script-lib\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564201 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-run-multus-certs\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564226 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4m9t\" (UniqueName: \"kubernetes.io/projected/3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e-kube-api-access-w4m9t\") pod \"node-resolver-r4ksj\" (UID: \"3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e\") " pod="openshift-dns/node-resolver-r4ksj" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564275 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-var-lib-openvswitch\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564323 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-var-lib-openvswitch\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564416 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-sys\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564446 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26cea4d5-7028-4cf2-99b2-b8241284895e-cni-binary-copy\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564472 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2crw\" (UniqueName: \"kubernetes.io/projected/26cea4d5-7028-4cf2-99b2-b8241284895e-kube-api-access-v2crw\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564498 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnr27\" (UniqueName: \"kubernetes.io/projected/5dae8492-c623-4219-9ac7-c33927a73c65-kube-api-access-lnr27\") pod \"iptables-alerter-vgt8w\" (UID: \"5dae8492-c623-4219-9ac7-c33927a73c65\") " pod="openshift-network-operator/iptables-alerter-vgt8w" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564520 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-cnibin\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564539 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/675ca9df-c1ee-4798-9dbd-7bfe881cf901-cni-binary-copy\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564555 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-etc-openvswitch\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564572 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-var-lib-cni-bin\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564595 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-socket-dir\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564619 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-run-openvswitch\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564623 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-etc-openvswitch\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.565196 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564644 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564666 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z6rb\" (UniqueName: \"kubernetes.io/projected/59a522e7-fc0f-4076-affc-9d1591204d64-kube-api-access-4z6rb\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564686 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36d64b55-58c7-4005-859a-0a895a3a1971-dbus\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564712 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-device-dir\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564732 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-socket-dir\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564756 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhhtw\" (UniqueName: \"kubernetes.io/projected/9d54514a-72c8-46e9-8bc4-bdd3426ae010-kube-api-access-qhhtw\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564784 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3de9a184-ebf5-487a-b4c9-0f657559543b-host\") pod \"node-ca-6cn9v\" (UID: \"3de9a184-ebf5-487a-b4c9-0f657559543b\") " pod="openshift-image-registry/node-ca-6cn9v" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564829 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3de9a184-ebf5-487a-b4c9-0f657559543b-host\") pod \"node-ca-6cn9v\" (UID: \"3de9a184-ebf5-487a-b4c9-0f657559543b\") " pod="openshift-image-registry/node-ca-6cn9v" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564845 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-device-dir\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54v5q\" (UniqueName: \"kubernetes.io/projected/219c3767-e998-4f79-a227-45681847cac2-kube-api-access-54v5q\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-run-openvswitch\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564887 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-modprobe-d\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564912 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564953 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-sysconfig\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564977 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26cea4d5-7028-4cf2-99b2-b8241284895e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.564997 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-system-cni-dir\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565018 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-multus-conf-dir\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.565998 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565229 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/219c3767-e998-4f79-a227-45681847cac2-ovnkube-script-lib\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565419 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-etc-kubernetes\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565455 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-cni-netd\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565476 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-sysctl-conf\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565492 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-hostroot\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-registration-dir\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565543 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-sys-fs\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565567 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-kubelet\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565583 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-run-systemd\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565592 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-cni-netd\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565604 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-run-ovn-kubernetes\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565619 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-registration-dir\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565627 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59a522e7-fc0f-4076-affc-9d1591204d64-etc-tuned\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565633 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-kubelet\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e-hosts-file\") pod \"node-resolver-r4ksj\" (UID: \"3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e\") " pod="openshift-dns/node-resolver-r4ksj" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565666 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-node-log\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565681 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d54514a-72c8-46e9-8bc4-bdd3426ae010-sys-fs\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.566718 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565693 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/219c3767-e998-4f79-a227-45681847cac2-ovnkube-config\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.567413 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565704 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e-hosts-file\") pod \"node-resolver-r4ksj\" (UID: \"3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e\") " pod="openshift-dns/node-resolver-r4ksj" Jun 08 23:59:12.567413 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565706 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-lib-modules\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.567413 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565666 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-run-systemd\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.567413 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565725 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-host-run-ovn-kubernetes\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.567413 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565755 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/219c3767-e998-4f79-a227-45681847cac2-node-log\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.567413 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.565782 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26cea4d5-7028-4cf2-99b2-b8241284895e-cnibin\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.567413 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.566188 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/219c3767-e998-4f79-a227-45681847cac2-ovnkube-config\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.568908 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.568887 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/219c3767-e998-4f79-a227-45681847cac2-ovn-node-metrics-cert\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.573037 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.573012 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhhtw\" (UniqueName: \"kubernetes.io/projected/9d54514a-72c8-46e9-8bc4-bdd3426ae010-kube-api-access-qhhtw\") pod \"aws-ebs-csi-driver-node-qwqs4\" (UID: \"9d54514a-72c8-46e9-8bc4-bdd3426ae010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.576342 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.575323 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4m9t\" (UniqueName: \"kubernetes.io/projected/3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e-kube-api-access-w4m9t\") pod \"node-resolver-r4ksj\" (UID: \"3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e\") " pod="openshift-dns/node-resolver-r4ksj" Jun 08 23:59:12.576342 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.575574 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54v5q\" (UniqueName: \"kubernetes.io/projected/219c3767-e998-4f79-a227-45681847cac2-kube-api-access-54v5q\") pod \"ovnkube-node-twgfd\" (UID: \"219c3767-e998-4f79-a227-45681847cac2\") " pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.576342 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.575950 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6q67\" (UniqueName: \"kubernetes.io/projected/3de9a184-ebf5-487a-b4c9-0f657559543b-kube-api-access-z6q67\") pod \"node-ca-6cn9v\" (UID: \"3de9a184-ebf5-487a-b4c9-0f657559543b\") " pod="openshift-image-registry/node-ca-6cn9v" Jun 08 23:59:12.577302 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.577278 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrd6z\" (UniqueName: \"kubernetes.io/projected/314dabf5-096d-442a-9db1-83512bf87f66-kube-api-access-lrd6z\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:12.666371 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666345 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-systemd\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.666526 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666380 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26cea4d5-7028-4cf2-99b2-b8241284895e-system-cni-dir\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.666526 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666406 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26cea4d5-7028-4cf2-99b2-b8241284895e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.666526 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666480 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-systemd\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.666526 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666490 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26cea4d5-7028-4cf2-99b2-b8241284895e-system-cni-dir\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.666710 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666609 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dae8492-c623-4219-9ac7-c33927a73c65-host-slash\") pod \"iptables-alerter-vgt8w\" (UID: \"5dae8492-c623-4219-9ac7-c33927a73c65\") " pod="openshift-network-operator/iptables-alerter-vgt8w" Jun 08 23:59:12.666710 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666643 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-run-k8s-cni-cncf-io\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.666710 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666668 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4phc\" (UniqueName: \"kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc\") pod \"network-check-target-zz4hd\" (UID: \"36e2bd15-8d51-4018-a5cb-daba9c9cd0f5\") " pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:12.666710 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666695 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11c3f5bf-538b-4ca6-8d53-e3562fa2e54e-agent-certs\") pod \"konnectivity-agent-d2xbc\" (UID: \"11c3f5bf-538b-4ca6-8d53-e3562fa2e54e\") " pod="kube-system/konnectivity-agent-d2xbc" Jun 08 23:59:12.666710 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666699 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dae8492-c623-4219-9ac7-c33927a73c65-host-slash\") pod \"iptables-alerter-vgt8w\" (UID: \"5dae8492-c623-4219-9ac7-c33927a73c65\") " pod="openshift-network-operator/iptables-alerter-vgt8w" Jun 08 23:59:12.666710 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666709 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/675ca9df-c1ee-4798-9dbd-7bfe881cf901-multus-daemon-config\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.667019 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666720 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-run-k8s-cni-cncf-io\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.667019 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666763 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36d64b55-58c7-4005-859a-0a895a3a1971-kubelet-config\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:12.667019 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666791 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-sysctl-d\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.667019 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666815 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-run\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.667019 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666837 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-host\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.667019 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dae8492-c623-4219-9ac7-c33927a73c65-iptables-alerter-script\") pod \"iptables-alerter-vgt8w\" (UID: \"5dae8492-c623-4219-9ac7-c33927a73c65\") " pod="openshift-network-operator/iptables-alerter-vgt8w" Jun 08 23:59:12.667019 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666885 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-multus-cni-dir\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.667019 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-run-netns\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.667019 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666965 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-var-lib-cni-multus\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.667019 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.666993 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-run-multus-certs\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.667019 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667018 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-sys\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667019 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-host\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667042 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26cea4d5-7028-4cf2-99b2-b8241284895e-cni-binary-copy\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36d64b55-58c7-4005-859a-0a895a3a1971-kubelet-config\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667048 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26cea4d5-7028-4cf2-99b2-b8241284895e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667130 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-run\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667135 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-var-lib-cni-multus\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667177 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-run-multus-certs\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667183 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-multus-cni-dir\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667195 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-sysctl-d\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667211 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-run-netns\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667228 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-sys\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667243 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2crw\" (UniqueName: \"kubernetes.io/projected/26cea4d5-7028-4cf2-99b2-b8241284895e-kube-api-access-v2crw\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667253 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/675ca9df-c1ee-4798-9dbd-7bfe881cf901-multus-daemon-config\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667274 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnr27\" (UniqueName: \"kubernetes.io/projected/5dae8492-c623-4219-9ac7-c33927a73c65-kube-api-access-lnr27\") pod \"iptables-alerter-vgt8w\" (UID: \"5dae8492-c623-4219-9ac7-c33927a73c65\") " pod="openshift-network-operator/iptables-alerter-vgt8w" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667301 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-cnibin\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667325 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/675ca9df-c1ee-4798-9dbd-7bfe881cf901-cni-binary-copy\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-cnibin\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.667519 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667392 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-var-lib-cni-bin\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667543 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z6rb\" (UniqueName: \"kubernetes.io/projected/59a522e7-fc0f-4076-affc-9d1591204d64-kube-api-access-4z6rb\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667561 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-var-lib-cni-bin\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667573 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36d64b55-58c7-4005-859a-0a895a3a1971-dbus\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667578 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dae8492-c623-4219-9ac7-c33927a73c65-iptables-alerter-script\") pod \"iptables-alerter-vgt8w\" (UID: \"5dae8492-c623-4219-9ac7-c33927a73c65\") " pod="openshift-network-operator/iptables-alerter-vgt8w" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667602 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-modprobe-d\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667626 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-sysconfig\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26cea4d5-7028-4cf2-99b2-b8241284895e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667659 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36d64b55-58c7-4005-859a-0a895a3a1971-dbus\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667666 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26cea4d5-7028-4cf2-99b2-b8241284895e-cni-binary-copy\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667673 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-system-cni-dir\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667715 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-sysconfig\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667716 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-multus-conf-dir\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-etc-kubernetes\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667802 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-sysctl-conf\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667820 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-modprobe-d\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667858 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-etc-kubernetes\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667861 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/675ca9df-c1ee-4798-9dbd-7bfe881cf901-cni-binary-copy\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.668435 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667776 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-multus-conf-dir\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667826 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-hostroot\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667887 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26cea4d5-7028-4cf2-99b2-b8241284895e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667867 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-hostroot\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667823 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-system-cni-dir\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667912 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59a522e7-fc0f-4076-affc-9d1591204d64-etc-tuned\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667931 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-lib-modules\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667941 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-sysctl-conf\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667957 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26cea4d5-7028-4cf2-99b2-b8241284895e-cnibin\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667979 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26cea4d5-7028-4cf2-99b2-b8241284895e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.667994 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-os-release\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668009 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-var-lib-kubelet\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668028 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-lib-modules\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668034 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-kubernetes\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668058 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-var-lib-kubelet\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668072 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-os-release\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668079 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-host-var-lib-kubelet\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668082 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-multus-socket-dir-parent\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.669225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668111 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11c3f5bf-538b-4ca6-8d53-e3562fa2e54e-konnectivity-ca\") pod \"konnectivity-agent-d2xbc\" (UID: \"11c3f5bf-538b-4ca6-8d53-e3562fa2e54e\") " pod="kube-system/konnectivity-agent-d2xbc" Jun 08 23:59:12.669966 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668126 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-var-lib-kubelet\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.669966 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668133 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59a522e7-fc0f-4076-affc-9d1591204d64-tmp\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.669966 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668138 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/675ca9df-c1ee-4798-9dbd-7bfe881cf901-multus-socket-dir-parent\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.669966 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668156 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26cea4d5-7028-4cf2-99b2-b8241284895e-os-release\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.669966 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668172 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26cea4d5-7028-4cf2-99b2-b8241284895e-cnibin\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.669966 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668180 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzbpp\" (UniqueName: \"kubernetes.io/projected/675ca9df-c1ee-4798-9dbd-7bfe881cf901-kube-api-access-wzbpp\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.669966 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668147 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59a522e7-fc0f-4076-affc-9d1591204d64-etc-kubernetes\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.669966 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668225 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26cea4d5-7028-4cf2-99b2-b8241284895e-os-release\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.669966 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668251 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:12.669966 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:12.668334 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:12.669966 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:12.668404 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret podName:36d64b55-58c7-4005-859a-0a895a3a1971 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:13.168387399 +0000 UTC m=+3.126654995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret") pod "global-pull-secret-syncer-nr9c8" (UID: "36d64b55-58c7-4005-859a-0a895a3a1971") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:12.669966 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668640 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26cea4d5-7028-4cf2-99b2-b8241284895e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.669966 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.668671 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11c3f5bf-538b-4ca6-8d53-e3562fa2e54e-konnectivity-ca\") pod \"konnectivity-agent-d2xbc\" (UID: \"11c3f5bf-538b-4ca6-8d53-e3562fa2e54e\") " pod="kube-system/konnectivity-agent-d2xbc" Jun 08 23:59:12.670503 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.670277 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59a522e7-fc0f-4076-affc-9d1591204d64-etc-tuned\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.670556 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.670497 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59a522e7-fc0f-4076-affc-9d1591204d64-tmp\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.672797 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.672778 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11c3f5bf-538b-4ca6-8d53-e3562fa2e54e-agent-certs\") pod \"konnectivity-agent-d2xbc\" (UID: \"11c3f5bf-538b-4ca6-8d53-e3562fa2e54e\") " pod="kube-system/konnectivity-agent-d2xbc" Jun 08 23:59:12.673824 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:12.673522 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:12.673824 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:12.673546 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:12.673824 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:12.673561 2573 projected.go:196] Error preparing data for projected volume kube-api-access-v4phc for pod openshift-network-diagnostics/network-check-target-zz4hd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:12.673824 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:12.673643 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc podName:36e2bd15-8d51-4018-a5cb-daba9c9cd0f5 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:13.173624811 +0000 UTC m=+3.131892411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v4phc" (UniqueName: "kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc") pod "network-check-target-zz4hd" (UID: "36e2bd15-8d51-4018-a5cb-daba9c9cd0f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:12.675193 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.675163 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z6rb\" (UniqueName: \"kubernetes.io/projected/59a522e7-fc0f-4076-affc-9d1591204d64-kube-api-access-4z6rb\") pod \"tuned-m8jj9\" (UID: \"59a522e7-fc0f-4076-affc-9d1591204d64\") " pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.676089 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.676070 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnr27\" (UniqueName: \"kubernetes.io/projected/5dae8492-c623-4219-9ac7-c33927a73c65-kube-api-access-lnr27\") pod \"iptables-alerter-vgt8w\" (UID: \"5dae8492-c623-4219-9ac7-c33927a73c65\") " pod="openshift-network-operator/iptables-alerter-vgt8w" Jun 08 23:59:12.676228 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.676209 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2crw\" (UniqueName: \"kubernetes.io/projected/26cea4d5-7028-4cf2-99b2-b8241284895e-kube-api-access-v2crw\") pod \"multus-additional-cni-plugins-8l77g\" (UID: \"26cea4d5-7028-4cf2-99b2-b8241284895e\") " pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.676494 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.676464 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzbpp\" (UniqueName: \"kubernetes.io/projected/675ca9df-c1ee-4798-9dbd-7bfe881cf901-kube-api-access-wzbpp\") pod \"multus-9sncw\" (UID: \"675ca9df-c1ee-4798-9dbd-7bfe881cf901\") " pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.761854 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.761825 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:12.771038 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.771000 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" Jun 08 23:59:12.781716 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.781698 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r4ksj" Jun 08 23:59:12.785809 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.785795 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6cn9v" Jun 08 23:59:12.795381 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.795365 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9sncw" Jun 08 23:59:12.802194 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.802177 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d2xbc" Jun 08 23:59:12.808849 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.808832 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" Jun 08 23:59:12.816371 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.816354 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8l77g" Jun 08 23:59:12.822025 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.822011 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:12.823040 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:12.823022 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vgt8w" Jun 08 23:59:13.070561 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.070485 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:13.070706 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:13.070585 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:13.070706 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:13.070637 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs podName:314dabf5-096d-442a-9db1-83512bf87f66 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:14.070621234 +0000 UTC m=+4.028888836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs") pod "network-metrics-daemon-tcxq6" (UID: "314dabf5-096d-442a-9db1-83512bf87f66") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:13.170847 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.170817 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:13.171019 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:13.170973 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:13.171067 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:13.171042 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret podName:36d64b55-58c7-4005-859a-0a895a3a1971 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:14.171023905 +0000 UTC m=+4.129291493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret") pod "global-pull-secret-syncer-nr9c8" (UID: "36d64b55-58c7-4005-859a-0a895a3a1971") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:13.271672 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.271639 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4phc\" (UniqueName: \"kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc\") pod \"network-check-target-zz4hd\" (UID: \"36e2bd15-8d51-4018-a5cb-daba9c9cd0f5\") " pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:13.271869 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:13.271797 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:13.271869 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:13.271822 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:13.271869 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:13.271835 2573 projected.go:196] Error preparing data for projected volume kube-api-access-v4phc for pod openshift-network-diagnostics/network-check-target-zz4hd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:13.272014 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:13.271897 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc podName:36e2bd15-8d51-4018-a5cb-daba9c9cd0f5 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:14.271878239 +0000 UTC m=+4.230145840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4phc" (UniqueName: "kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc") pod "network-check-target-zz4hd" (UID: "36e2bd15-8d51-4018-a5cb-daba9c9cd0f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:13.459647 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:13.459605 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de9a184_ebf5_487a_b4c9_0f657559543b.slice/crio-ef7b7e6eaedb9a2e6ec249ba5d086af8fcfeb082182ecef3cdf5f363246c1c12 WatchSource:0}: Error finding container ef7b7e6eaedb9a2e6ec249ba5d086af8fcfeb082182ecef3cdf5f363246c1c12: Status 404 returned error can't find the container with id ef7b7e6eaedb9a2e6ec249ba5d086af8fcfeb082182ecef3cdf5f363246c1c12 Jun 08 23:59:13.460989 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:13.460851 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a35b02f_c44e_4acc_b9d1_233b8d5b9d4e.slice/crio-560caf68df781fbdb66a717e678124b5f7be5073e77398083f4dd67d5e1f4892 WatchSource:0}: Error finding container 560caf68df781fbdb66a717e678124b5f7be5073e77398083f4dd67d5e1f4892: Status 404 returned error can't find the container with id 560caf68df781fbdb66a717e678124b5f7be5073e77398083f4dd67d5e1f4892 Jun 08 23:59:13.485066 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:13.485038 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c3f5bf_538b_4ca6_8d53_e3562fa2e54e.slice/crio-d95344aaf1dbb8b28131d6de09cdb95c803f8c2c2870d3e4c3af2228c05826ae WatchSource:0}: Error finding container d95344aaf1dbb8b28131d6de09cdb95c803f8c2c2870d3e4c3af2228c05826ae: Status 404 returned error can't find the container with id d95344aaf1dbb8b28131d6de09cdb95c803f8c2c2870d3e4c3af2228c05826ae Jun 08 23:59:13.486461 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:13.486441 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dae8492_c623_4219_9ac7_c33927a73c65.slice/crio-0ccdbde21dcc0773c34ff2e49802851b3ebf0474519646650940b00fcf986ab1 WatchSource:0}: Error finding container 0ccdbde21dcc0773c34ff2e49802851b3ebf0474519646650940b00fcf986ab1: Status 404 returned error can't find the container with id 0ccdbde21dcc0773c34ff2e49802851b3ebf0474519646650940b00fcf986ab1 Jun 08 23:59:13.487325 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:13.487307 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26cea4d5_7028_4cf2_99b2_b8241284895e.slice/crio-4c31f57882ed53ee22eb5263a249191d6746dded1ab6d57ba3e3c5f3b4ef6990 WatchSource:0}: Error finding container 4c31f57882ed53ee22eb5263a249191d6746dded1ab6d57ba3e3c5f3b4ef6990: Status 404 returned error can't find the container with id 4c31f57882ed53ee22eb5263a249191d6746dded1ab6d57ba3e3c5f3b4ef6990 Jun 08 23:59:13.489469 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:13.489436 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d54514a_72c8_46e9_8bc4_bdd3426ae010.slice/crio-c97b87d8c64343f08cad1a701b305f580e6d5ddf592226df6b81309fecdae14a WatchSource:0}: Error finding container c97b87d8c64343f08cad1a701b305f580e6d5ddf592226df6b81309fecdae14a: Status 404 returned error can't find the container with id c97b87d8c64343f08cad1a701b305f580e6d5ddf592226df6b81309fecdae14a Jun 08 23:59:13.490213 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:13.490192 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219c3767_e998_4f79_a227_45681847cac2.slice/crio-80ec3982351bdc54739d9782c55a5500a00f9b4468ad6e31027c1c5344730647 WatchSource:0}: Error finding container 80ec3982351bdc54739d9782c55a5500a00f9b4468ad6e31027c1c5344730647: Status 404 returned error can't find the container with id 80ec3982351bdc54739d9782c55a5500a00f9b4468ad6e31027c1c5344730647 Jun 08 23:59:13.491961 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:13.491935 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a522e7_fc0f_4076_affc_9d1591204d64.slice/crio-3df596246efca4899b9a645ad94c5f1d8f27da708412a1b81538e221089cea11 WatchSource:0}: Error finding container 3df596246efca4899b9a645ad94c5f1d8f27da708412a1b81538e221089cea11: Status 404 returned error can't find the container with id 3df596246efca4899b9a645ad94c5f1d8f27da708412a1b81538e221089cea11 Jun 08 23:59:13.492979 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:13.492853 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675ca9df_c1ee_4798_9dbd_7bfe881cf901.slice/crio-f8df8b33677d0f022539d94552fdc29f3c65d2e5b8483046c72e29ff3a570164 WatchSource:0}: Error finding container f8df8b33677d0f022539d94552fdc29f3c65d2e5b8483046c72e29ff3a570164: Status 404 returned error can't find the container with id f8df8b33677d0f022539d94552fdc29f3c65d2e5b8483046c72e29ff3a570164 Jun 08 23:59:13.504482 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.504459 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 23:54:12 +0000 UTC" deadline="2027-12-29 01:20:56.027237526 +0000 UTC" Jun 08 23:59:13.504541 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.504484 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13633h21m42.522758768s" Jun 08 23:59:13.526542 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.526523 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:13.526661 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:13.526633 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:13.536055 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.535907 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" event={"ID":"59a522e7-fc0f-4076-affc-9d1591204d64","Type":"ContainerStarted","Data":"3df596246efca4899b9a645ad94c5f1d8f27da708412a1b81538e221089cea11"} Jun 08 23:59:13.538650 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.538620 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" event={"ID":"219c3767-e998-4f79-a227-45681847cac2","Type":"ContainerStarted","Data":"80ec3982351bdc54739d9782c55a5500a00f9b4468ad6e31027c1c5344730647"} Jun 08 23:59:13.541580 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.541548 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l77g" event={"ID":"26cea4d5-7028-4cf2-99b2-b8241284895e","Type":"ContainerStarted","Data":"4c31f57882ed53ee22eb5263a249191d6746dded1ab6d57ba3e3c5f3b4ef6990"} Jun 08 23:59:13.542516 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.542493 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vgt8w" event={"ID":"5dae8492-c623-4219-9ac7-c33927a73c65","Type":"ContainerStarted","Data":"0ccdbde21dcc0773c34ff2e49802851b3ebf0474519646650940b00fcf986ab1"} Jun 08 23:59:13.543418 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.543392 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r4ksj" event={"ID":"3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e","Type":"ContainerStarted","Data":"560caf68df781fbdb66a717e678124b5f7be5073e77398083f4dd67d5e1f4892"} Jun 08 23:59:13.544229 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.544210 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6cn9v" event={"ID":"3de9a184-ebf5-487a-b4c9-0f657559543b","Type":"ContainerStarted","Data":"ef7b7e6eaedb9a2e6ec249ba5d086af8fcfeb082182ecef3cdf5f363246c1c12"} Jun 08 23:59:13.545063 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.545044 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9sncw" event={"ID":"675ca9df-c1ee-4798-9dbd-7bfe881cf901","Type":"ContainerStarted","Data":"f8df8b33677d0f022539d94552fdc29f3c65d2e5b8483046c72e29ff3a570164"} Jun 08 23:59:13.549201 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.549181 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" event={"ID":"9d54514a-72c8-46e9-8bc4-bdd3426ae010","Type":"ContainerStarted","Data":"c97b87d8c64343f08cad1a701b305f580e6d5ddf592226df6b81309fecdae14a"} Jun 08 23:59:13.553328 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:13.553308 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d2xbc" event={"ID":"11c3f5bf-538b-4ca6-8d53-e3562fa2e54e","Type":"ContainerStarted","Data":"d95344aaf1dbb8b28131d6de09cdb95c803f8c2c2870d3e4c3af2228c05826ae"} Jun 08 23:59:14.078440 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:14.077761 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:14.078440 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:14.077960 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:14.078440 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:14.078027 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs podName:314dabf5-096d-442a-9db1-83512bf87f66 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:16.078007808 +0000 UTC m=+6.036275404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs") pod "network-metrics-daemon-tcxq6" (UID: "314dabf5-096d-442a-9db1-83512bf87f66") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:14.149624 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:14.149593 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:14.178953 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:14.178920 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:14.179160 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:14.179095 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:14.179160 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:14.179153 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret podName:36d64b55-58c7-4005-859a-0a895a3a1971 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:16.179136113 +0000 UTC m=+6.137403711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret") pod "global-pull-secret-syncer-nr9c8" (UID: "36d64b55-58c7-4005-859a-0a895a3a1971") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:14.279505 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:14.279468 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4phc\" (UniqueName: \"kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc\") pod \"network-check-target-zz4hd\" (UID: \"36e2bd15-8d51-4018-a5cb-daba9c9cd0f5\") " pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:14.279677 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:14.279663 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:14.279733 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:14.279686 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:14.279733 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:14.279699 2573 projected.go:196] Error preparing data for projected volume kube-api-access-v4phc for pod openshift-network-diagnostics/network-check-target-zz4hd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:14.279870 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:14.279771 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc podName:36e2bd15-8d51-4018-a5cb-daba9c9cd0f5 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:16.279752811 +0000 UTC m=+6.238020407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4phc" (UniqueName: "kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc") pod "network-check-target-zz4hd" (UID: "36e2bd15-8d51-4018-a5cb-daba9c9cd0f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:14.504914 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:14.504854 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 23:54:12 +0000 UTC" deadline="2028-01-09 18:14:10.745997867 +0000 UTC" Jun 08 23:59:14.504914 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:14.504912 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13914h14m56.241089864s" Jun 08 23:59:14.526944 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:14.526870 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:14.527095 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:14.526999 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:14.527393 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:14.527227 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:14.527393 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:14.527339 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:14.566145 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:14.566116 2573 generic.go:356] "Generic (PLEG): container finished" podID="fa226fc2d2c5f842f452b30ccab5b919" containerID="990ef78c212c3988282262a880e235f43cbc7d2253660d1298fa6754cce40398" exitCode=0 Jun 08 23:59:14.566273 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:14.566168 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" event={"ID":"fa226fc2d2c5f842f452b30ccab5b919","Type":"ContainerDied","Data":"990ef78c212c3988282262a880e235f43cbc7d2253660d1298fa6754cce40398"} Jun 08 23:59:14.587700 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:14.587090 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" event={"ID":"58267d6e6471fb16c1b68a4f6cfaa490","Type":"ContainerStarted","Data":"1f38fac319865831c8245d7e80e74196a65f1a5de5802ef5fe2f7ce40f7f3445"} Jun 08 23:59:14.600179 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:14.599099 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" podStartSLOduration=3.599083209 podStartE2EDuration="3.599083209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:14.59897703 +0000 UTC m=+4.557244639" watchObservedRunningTime="2026-06-08 23:59:14.599083209 +0000 UTC m=+4.557350816" Jun 08 23:59:15.526391 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:15.526313 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:15.526921 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:15.526476 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:15.608081 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:15.608011 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" event={"ID":"fa226fc2d2c5f842f452b30ccab5b919","Type":"ContainerStarted","Data":"ea452683f3c5b10677eeda3320a920e1dd6b0a3557deb86eeb7d98fd524609fb"} Jun 08 23:59:16.093900 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:16.093852 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:16.094091 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:16.094010 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:16.094207 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:16.094097 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs podName:314dabf5-096d-442a-9db1-83512bf87f66 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:20.094054893 +0000 UTC m=+10.052322483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs") pod "network-metrics-daemon-tcxq6" (UID: "314dabf5-096d-442a-9db1-83512bf87f66") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:16.195371 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:16.195326 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:16.200056 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:16.200023 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:16.200177 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:16.200118 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret podName:36d64b55-58c7-4005-859a-0a895a3a1971 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:20.20009706 +0000 UTC m=+10.158364654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret") pod "global-pull-secret-syncer-nr9c8" (UID: "36d64b55-58c7-4005-859a-0a895a3a1971") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:16.296366 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:16.296311 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4phc\" (UniqueName: \"kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc\") pod \"network-check-target-zz4hd\" (UID: \"36e2bd15-8d51-4018-a5cb-daba9c9cd0f5\") " pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:16.296588 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:16.296548 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:16.296588 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:16.296570 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:16.296588 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:16.296583 2573 projected.go:196] Error preparing data for projected volume kube-api-access-v4phc for pod openshift-network-diagnostics/network-check-target-zz4hd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:16.296834 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:16.296654 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc podName:36e2bd15-8d51-4018-a5cb-daba9c9cd0f5 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:20.296635548 +0000 UTC m=+10.254903151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4phc" (UniqueName: "kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc") pod "network-check-target-zz4hd" (UID: "36e2bd15-8d51-4018-a5cb-daba9c9cd0f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:16.526919 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:16.526886 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:16.527365 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:16.527019 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:16.527496 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:16.527476 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:16.527621 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:16.527591 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:17.525858 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:17.525821 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:17.526017 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:17.525954 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:18.525958 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:18.525924 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:18.525958 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:18.525959 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:18.526500 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:18.526110 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:18.526500 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:18.526239 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:19.526475 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:19.526445 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:19.526903 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:19.526568 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:20.125290 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:20.125260 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:20.125464 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:20.125373 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:20.125464 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:20.125429 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs podName:314dabf5-096d-442a-9db1-83512bf87f66 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:28.125412543 +0000 UTC m=+18.083680125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs") pod "network-metrics-daemon-tcxq6" (UID: "314dabf5-096d-442a-9db1-83512bf87f66") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:20.226628 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:20.226592 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:20.226782 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:20.226756 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:20.226848 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:20.226829 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret podName:36d64b55-58c7-4005-859a-0a895a3a1971 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:28.226807828 +0000 UTC m=+18.185075411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret") pod "global-pull-secret-syncer-nr9c8" (UID: "36d64b55-58c7-4005-859a-0a895a3a1971") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:20.328790 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:20.328728 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4phc\" (UniqueName: \"kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc\") pod \"network-check-target-zz4hd\" (UID: \"36e2bd15-8d51-4018-a5cb-daba9c9cd0f5\") " pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:20.328970 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:20.328954 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:20.329069 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:20.328978 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:20.329069 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:20.328991 2573 projected.go:196] Error preparing data for projected volume kube-api-access-v4phc for pod openshift-network-diagnostics/network-check-target-zz4hd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:20.329069 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:20.329044 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc podName:36e2bd15-8d51-4018-a5cb-daba9c9cd0f5 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:28.329026969 +0000 UTC m=+18.287294553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4phc" (UniqueName: "kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc") pod "network-check-target-zz4hd" (UID: "36e2bd15-8d51-4018-a5cb-daba9c9cd0f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:20.528130 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:20.528088 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:20.528577 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:20.528165 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:20.528577 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:20.528190 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:20.528577 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:20.528281 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:21.525646 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:21.525607 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:21.525902 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:21.525751 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:22.526769 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:22.526311 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:22.526769 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:22.526459 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:22.526769 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:22.526518 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:22.526769 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:22.526622 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:23.526239 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:23.526208 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:23.526529 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:23.526331 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:24.526321 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:24.526288 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:24.526782 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:24.526419 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:24.526875 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:24.526833 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:24.526958 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:24.526935 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:25.526095 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:25.526062 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:25.526278 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:25.526184 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:26.526477 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:26.526446 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:26.526944 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:26.526449 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:26.526944 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:26.526593 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:26.526944 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:26.526657 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:27.526308 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:27.526273 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:27.526469 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:27.526394 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:28.187152 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:28.187113 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:28.187558 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:28.187250 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:28.187558 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:28.187326 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs podName:314dabf5-096d-442a-9db1-83512bf87f66 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:44.18730897 +0000 UTC m=+34.145576554 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs") pod "network-metrics-daemon-tcxq6" (UID: "314dabf5-096d-442a-9db1-83512bf87f66") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:28.288114 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:28.288085 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:28.288289 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:28.288241 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:28.288349 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:28.288310 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret podName:36d64b55-58c7-4005-859a-0a895a3a1971 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:44.288292168 +0000 UTC m=+34.246559763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret") pod "global-pull-secret-syncer-nr9c8" (UID: "36d64b55-58c7-4005-859a-0a895a3a1971") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:28.388608 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:28.388569 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4phc\" (UniqueName: \"kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc\") pod \"network-check-target-zz4hd\" (UID: \"36e2bd15-8d51-4018-a5cb-daba9c9cd0f5\") " pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:28.388796 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:28.388719 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:28.388796 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:28.388753 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:28.388796 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:28.388766 2573 projected.go:196] Error preparing data for projected volume kube-api-access-v4phc for pod openshift-network-diagnostics/network-check-target-zz4hd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:28.388966 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:28.388818 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc podName:36e2bd15-8d51-4018-a5cb-daba9c9cd0f5 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:44.388805048 +0000 UTC m=+34.347072629 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4phc" (UniqueName: "kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc") pod "network-check-target-zz4hd" (UID: "36e2bd15-8d51-4018-a5cb-daba9c9cd0f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:28.525820 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:28.525790 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:28.525977 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:28.525794 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:28.525977 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:28.525948 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:28.526082 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:28.525984 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:29.526595 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:29.526388 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:29.527031 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:29.526667 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:30.526377 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:30.526349 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:30.526540 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:30.526442 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:30.526540 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:30.526506 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:30.526644 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:30.526600 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:31.526254 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:31.526215 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:31.526470 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:31.526339 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:32.526492 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.526467 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:32.527681 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:32.526605 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:32.527681 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.527009 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:32.527681 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:32.527099 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:32.641760 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.641533 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" event={"ID":"59a522e7-fc0f-4076-affc-9d1591204d64","Type":"ContainerStarted","Data":"e80a913ac56641df38ac6cab16468893676361d2c24326169c339d43c8b0ada0"} Jun 08 23:59:32.643137 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.643118 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" event={"ID":"219c3767-e998-4f79-a227-45681847cac2","Type":"ContainerStarted","Data":"fa0168c31351a47bdeff3baff289096ee6dd300b630581fd7f4129fe91f0d215"} Jun 08 23:59:32.644427 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.644402 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l77g" event={"ID":"26cea4d5-7028-4cf2-99b2-b8241284895e","Type":"ContainerStarted","Data":"2e2b1a51a953be0f1f8c97e58ac34f679f76c4dfd3a5954f95b69c0bd4957cab"} Jun 08 23:59:32.645908 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.645883 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r4ksj" event={"ID":"3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e","Type":"ContainerStarted","Data":"3e1c2cc17d10bb887da78af901a7e25f674b09d393522fdc55c5706ef2eef7b2"} Jun 08 23:59:32.647339 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.647286 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6cn9v" event={"ID":"3de9a184-ebf5-487a-b4c9-0f657559543b","Type":"ContainerStarted","Data":"1cca75fdb669f5a675cfd8ab439e25746214719a7884daf1e5fed43aaed1aa96"} Jun 08 23:59:32.649016 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.648995 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9sncw" event={"ID":"675ca9df-c1ee-4798-9dbd-7bfe881cf901","Type":"ContainerStarted","Data":"5560bd4ba2c76d4ed1b55299fcb85296672257fe48f4b9bf3158630be6e1b4e3"} Jun 08 23:59:32.650546 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.650528 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" event={"ID":"9d54514a-72c8-46e9-8bc4-bdd3426ae010","Type":"ContainerStarted","Data":"28cb85cdaf7e8014718198917aebfeff410d5c85cadec9fa1fa091907cbe9652"} Jun 08 23:59:32.651857 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.651837 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d2xbc" event={"ID":"11c3f5bf-538b-4ca6-8d53-e3562fa2e54e","Type":"ContainerStarted","Data":"94e04bf5679ed0c1f5fe5269060c4cf36af8e49b3d6372c2eb28301c849f2e30"} Jun 08 23:59:32.661095 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.661059 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m8jj9" podStartSLOduration=3.798352099 podStartE2EDuration="22.661047469s" totalImagesPullingTime="18.86269537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:32.660888555 +0000 UTC m=+22.619156159" watchObservedRunningTime="2026-06-08 23:59:32.661047469 +0000 UTC m=+22.619315073" Jun 08 23:59:32.661174 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.661143 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" podStartSLOduration=21.661139565 podStartE2EDuration="21.661139565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:15.625994726 +0000 UTC m=+5.584262331" watchObservedRunningTime="2026-06-08 23:59:32.661139565 +0000 UTC m=+22.619407171" Jun 08 23:59:32.685828 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.685788 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r4ksj" podStartSLOduration=3.812441766 podStartE2EDuration="22.685777273s" totalImagesPullingTime="18.873335507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:32.685400823 +0000 UTC m=+22.643668438" watchObservedRunningTime="2026-06-08 23:59:32.685777273 +0000 UTC m=+22.644044877" Jun 08 23:59:32.705802 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.705758 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9sncw" podStartSLOduration=3.813287634 podStartE2EDuration="22.705722328s" totalImagesPullingTime="18.892434694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:32.705258559 +0000 UTC m=+22.663526165" watchObservedRunningTime="2026-06-08 23:59:32.705722328 +0000 UTC m=+22.663989933" Jun 08 23:59:32.744558 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.744453 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6cn9v" podStartSLOduration=3.870454261 podStartE2EDuration="22.744437706s" totalImagesPullingTime="18.873983445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:32.743941561 +0000 UTC m=+22.702209165" watchObservedRunningTime="2026-06-08 23:59:32.744437706 +0000 UTC m=+22.702705310" Jun 08 23:59:32.757324 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:32.757282 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d2xbc" podStartSLOduration=12.328702102 podStartE2EDuration="22.757265524s" totalImagesPullingTime="10.428563422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:32.7565068 +0000 UTC m=+22.714774404" watchObservedRunningTime="2026-06-08 23:59:32.757265524 +0000 UTC m=+22.715533127" Jun 08 23:59:33.380849 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.380812 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 23:59:33.521903 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.521790 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T23:59:33.380831796Z","UUID":"ad2b4181-66b0-467e-9871-f3d5b1d82080","Handler":null,"Name":"","Endpoint":""} Jun 08 23:59:33.523198 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.523175 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 23:59:33.523295 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.523215 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 23:59:33.526025 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.526004 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:33.526119 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:33.526096 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:33.655191 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.655121 2573 generic.go:356] "Generic (PLEG): container finished" podID="26cea4d5-7028-4cf2-99b2-b8241284895e" containerID="2e2b1a51a953be0f1f8c97e58ac34f679f76c4dfd3a5954f95b69c0bd4957cab" exitCode=0 Jun 08 23:59:33.655546 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.655208 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l77g" event={"ID":"26cea4d5-7028-4cf2-99b2-b8241284895e","Type":"ContainerDied","Data":"2e2b1a51a953be0f1f8c97e58ac34f679f76c4dfd3a5954f95b69c0bd4957cab"} Jun 08 23:59:33.657206 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.657183 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" event={"ID":"9d54514a-72c8-46e9-8bc4-bdd3426ae010","Type":"ContainerStarted","Data":"42aa8378bcaf36428cc238f535da0212be891069515a8a98e71ae3922f3d936b"} Jun 08 23:59:33.660037 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.660022 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-twgfd_219c3767-e998-4f79-a227-45681847cac2/ovn-acl-logging/0.log" Jun 08 23:59:33.660338 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.660318 2573 generic.go:356] "Generic (PLEG): container finished" podID="219c3767-e998-4f79-a227-45681847cac2" containerID="894bd0abcd05059602a69efc40f017da7c9d9e3650f8548f361e164dd25dd233" exitCode=1 Jun 08 23:59:33.660425 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.660402 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" event={"ID":"219c3767-e998-4f79-a227-45681847cac2","Type":"ContainerStarted","Data":"f46648873c51dbf29e640c4df69cb644667297fd72903fedf0ee7026434f0692"} Jun 08 23:59:33.660494 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.660474 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" event={"ID":"219c3767-e998-4f79-a227-45681847cac2","Type":"ContainerStarted","Data":"21716c6871d766f66e7f8eb196620180fce02395fbdf77a296c8ea21a8997c6c"} Jun 08 23:59:33.660546 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.660509 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" event={"ID":"219c3767-e998-4f79-a227-45681847cac2","Type":"ContainerStarted","Data":"6861f8078a1392ae7238c1db9e29ac64d487c236424ca68dcfe154545d5c5f27"} Jun 08 23:59:33.660599 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.660552 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" event={"ID":"219c3767-e998-4f79-a227-45681847cac2","Type":"ContainerStarted","Data":"d6ecaa70550d0e7ba64c8d865c1b69365a7851be57698920f55cf855147a51b5"} Jun 08 23:59:33.660649 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:33.660597 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" event={"ID":"219c3767-e998-4f79-a227-45681847cac2","Type":"ContainerDied","Data":"894bd0abcd05059602a69efc40f017da7c9d9e3650f8548f361e164dd25dd233"} Jun 08 23:59:34.525760 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:34.525715 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:34.525921 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:34.525862 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:34.525921 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:34.525718 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:34.526023 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:34.525971 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:34.666054 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:34.665637 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vgt8w" event={"ID":"5dae8492-c623-4219-9ac7-c33927a73c65","Type":"ContainerStarted","Data":"363f39245bf8c2f9229178714d708a2729dfab60325f39d64970cf03a6de8d08"} Jun 08 23:59:34.667935 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:34.667906 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" event={"ID":"9d54514a-72c8-46e9-8bc4-bdd3426ae010","Type":"ContainerStarted","Data":"c6f2825a4bc2f74337e1c8bd87b2420c697fbae144b07c53acd544bfe1223839"} Jun 08 23:59:34.679283 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:34.679241 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vgt8w" podStartSLOduration=5.81520288 podStartE2EDuration="24.679228232s" totalImagesPullingTime="18.864025352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:34.678845103 +0000 UTC m=+24.637112708" watchObservedRunningTime="2026-06-08 23:59:34.679228232 +0000 UTC m=+24.637495834" Jun 08 23:59:35.526539 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:35.526501 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:35.526721 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:35.526604 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:35.672991 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:35.672964 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-twgfd_219c3767-e998-4f79-a227-45681847cac2/ovn-acl-logging/0.log" Jun 08 23:59:35.673447 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:35.673339 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" event={"ID":"219c3767-e998-4f79-a227-45681847cac2","Type":"ContainerStarted","Data":"fbff8dde9d789378173b55cab0c02c8f0ece5f75b57590054d5a3c3097e8f116"} Jun 08 23:59:35.990968 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:35.990946 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d2xbc" Jun 08 23:59:35.991479 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:35.991462 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d2xbc" Jun 08 23:59:36.005426 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:36.005386 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqs4" podStartSLOduration=5.687575755 podStartE2EDuration="26.005372616s" totalImagesPullingTime="20.317796861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:34.69615722 +0000 UTC m=+24.654424833" watchObservedRunningTime="2026-06-08 23:59:36.005372616 +0000 UTC m=+25.963640220" Jun 08 23:59:36.526559 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:36.526526 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:36.526559 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:36.526567 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:36.526810 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:36.526670 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:36.526876 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:36.526850 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:36.676240 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:36.676208 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d2xbc" Jun 08 23:59:36.676842 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:36.676813 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d2xbc" Jun 08 23:59:37.526413 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:37.526379 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:37.526576 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:37.526488 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:38.526035 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:38.525849 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:38.526590 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:38.525852 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:38.526590 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:38.526113 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:38.526590 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:38.526177 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:38.681598 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:38.681564 2573 generic.go:356] "Generic (PLEG): container finished" podID="26cea4d5-7028-4cf2-99b2-b8241284895e" containerID="6f869c0e1ad8eda5faf240299ff81f9301592960e54da0a313012ef904d50bb8" exitCode=0 Jun 08 23:59:38.681942 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:38.681649 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l77g" event={"ID":"26cea4d5-7028-4cf2-99b2-b8241284895e","Type":"ContainerDied","Data":"6f869c0e1ad8eda5faf240299ff81f9301592960e54da0a313012ef904d50bb8"} Jun 08 23:59:38.685222 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:38.685196 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-twgfd_219c3767-e998-4f79-a227-45681847cac2/ovn-acl-logging/0.log" Jun 08 23:59:38.685548 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:38.685529 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" event={"ID":"219c3767-e998-4f79-a227-45681847cac2","Type":"ContainerStarted","Data":"9c9ad29ed0901261ef111478aa6a4b67d2ff5c21658bc8090f883ea45d0b8819"} Jun 08 23:59:38.685783 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:38.685766 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:38.686026 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:38.686011 2573 scope.go:117] "RemoveContainer" containerID="894bd0abcd05059602a69efc40f017da7c9d9e3650f8548f361e164dd25dd233" Jun 08 23:59:38.702804 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:38.702788 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:39.526493 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:39.526460 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:39.526891 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:39.526561 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:39.693003 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:39.692706 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-twgfd_219c3767-e998-4f79-a227-45681847cac2/ovn-acl-logging/0.log" Jun 08 23:59:39.693411 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:39.693378 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" event={"ID":"219c3767-e998-4f79-a227-45681847cac2","Type":"ContainerStarted","Data":"fc8fd938222c748644a038505f83dca1b6d082aaaf9bb9e8168e37b9a758bd51"} Jun 08 23:59:39.693609 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:39.693585 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:39.693725 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:39.693668 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:39.709508 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:39.709482 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 08 23:59:39.719605 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:39.719371 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" podStartSLOduration=10.787473684 podStartE2EDuration="29.719353263s" totalImagesPullingTime="18.931879579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:39.7175921 +0000 UTC m=+29.675859701" watchObservedRunningTime="2026-06-08 23:59:39.719353263 +0000 UTC m=+29.677620866" Jun 08 23:59:39.911610 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:39.911586 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tcxq6"] Jun 08 23:59:39.911753 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:39.911728 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:39.911852 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:39.911835 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:39.914854 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:39.914829 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nr9c8"] Jun 08 23:59:39.914955 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:39.914940 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:39.915063 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:39.915040 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:39.915596 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:39.915570 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zz4hd"] Jun 08 23:59:39.915682 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:39.915662 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:39.915784 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:39.915761 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:40.697007 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:40.696975 2573 generic.go:356] "Generic (PLEG): container finished" podID="26cea4d5-7028-4cf2-99b2-b8241284895e" containerID="30757cef8be75f48b42a0fc9f26c1e2e18ddfadd4a3e6e6b6990690817b5fa7f" exitCode=0 Jun 08 23:59:40.697604 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:40.697059 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l77g" event={"ID":"26cea4d5-7028-4cf2-99b2-b8241284895e","Type":"ContainerDied","Data":"30757cef8be75f48b42a0fc9f26c1e2e18ddfadd4a3e6e6b6990690817b5fa7f"} Jun 08 23:59:41.526285 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:41.526219 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:41.526434 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:41.526325 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:41.526434 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:41.526327 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:41.526434 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:41.526376 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:41.526595 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:41.526463 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:41.526595 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:41.526549 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:42.704080 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:42.704043 2573 generic.go:356] "Generic (PLEG): container finished" podID="26cea4d5-7028-4cf2-99b2-b8241284895e" containerID="657811c94502c19fc0fd5c02b1ad2906f85a6065090ea651e0dca00d36f5760d" exitCode=0 Jun 08 23:59:42.704080 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:42.704084 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l77g" event={"ID":"26cea4d5-7028-4cf2-99b2-b8241284895e","Type":"ContainerDied","Data":"657811c94502c19fc0fd5c02b1ad2906f85a6065090ea651e0dca00d36f5760d"} Jun 08 23:59:43.526506 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:43.526456 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:43.526687 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:43.526575 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:43.526687 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:43.526585 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zz4hd" podUID="36e2bd15-8d51-4018-a5cb-daba9c9cd0f5" Jun 08 23:59:43.526687 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:43.526610 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:43.526687 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:43.526678 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9c8" podUID="36d64b55-58c7-4005-859a-0a895a3a1971" Jun 08 23:59:43.526900 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:43.526798 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 08 23:59:44.209153 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:44.208913 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:44.209527 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:44.209045 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:44.209527 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:44.209228 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs podName:314dabf5-096d-442a-9db1-83512bf87f66 nodeName:}" failed. No retries permitted until 2026-06-09 00:00:16.209212634 +0000 UTC m=+66.167480215 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs") pod "network-metrics-daemon-tcxq6" (UID: "314dabf5-096d-442a-9db1-83512bf87f66") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:44.310284 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:44.310251 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:44.310466 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:44.310414 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:44.310517 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:44.310479 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret podName:36d64b55-58c7-4005-859a-0a895a3a1971 nodeName:}" failed. No retries permitted until 2026-06-09 00:00:16.310459359 +0000 UTC m=+66.268726962 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret") pod "global-pull-secret-syncer-nr9c8" (UID: "36d64b55-58c7-4005-859a-0a895a3a1971") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:44.411237 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:44.411206 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4phc\" (UniqueName: \"kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc\") pod \"network-check-target-zz4hd\" (UID: \"36e2bd15-8d51-4018-a5cb-daba9c9cd0f5\") " pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:44.411407 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:44.411373 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:44.411407 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:44.411395 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:44.411486 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:44.411411 2573 projected.go:196] Error preparing data for projected volume kube-api-access-v4phc for pod openshift-network-diagnostics/network-check-target-zz4hd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:44.411486 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:44.411473 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc podName:36e2bd15-8d51-4018-a5cb-daba9c9cd0f5 nodeName:}" failed. No retries permitted until 2026-06-09 00:00:16.411455914 +0000 UTC m=+66.369723499 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4phc" (UniqueName: "kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc") pod "network-check-target-zz4hd" (UID: "36e2bd15-8d51-4018-a5cb-daba9c9cd0f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:45.296936 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.296819 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeReady" Jun 08 23:59:45.297393 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.296984 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 23:59:45.328523 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.328491 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59f4f5cff8-kq5cp"] Jun 08 23:59:45.355991 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.355959 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4ch68"] Jun 08 23:59:45.356180 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.356097 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.360095 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.358894 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cn964\"" Jun 08 23:59:45.360095 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.359156 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 23:59:45.360095 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.359384 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 23:59:45.360095 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.359874 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 23:59:45.364488 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.364465 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 23:59:45.382299 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.382272 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f4f5cff8-kq5cp"] Jun 08 23:59:45.382426 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.382309 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qjl4k"] Jun 08 23:59:45.382426 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.382413 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:45.384665 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.384518 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 23:59:45.384665 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.384520 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cw7xv\"" Jun 08 23:59:45.384665 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.384645 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 23:59:45.400010 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.399995 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4ch68"] Jun 08 23:59:45.400182 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.400022 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qjl4k"] Jun 08 23:59:45.400182 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.400108 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qjl4k" Jun 08 23:59:45.402392 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.402363 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 23:59:45.402392 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.402363 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 23:59:45.402553 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.402402 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 23:59:45.402553 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.402364 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x8dqb\"" Jun 08 23:59:45.519674 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.519626 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dba8bef0-1813-4dd2-802b-0db068169b98-ca-trust-extracted\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.519674 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.519669 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2eac10de-440f-4fb9-83f1-b8f24050fd42-cert\") pod \"ingress-canary-qjl4k\" (UID: \"2eac10de-440f-4fb9-83f1-b8f24050fd42\") " pod="openshift-ingress-canary/ingress-canary-qjl4k" Jun 08 23:59:45.519926 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.519768 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.519926 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.519830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dba8bef0-1813-4dd2-802b-0db068169b98-installation-pull-secrets\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.519926 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.519886 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psckc\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-kube-api-access-psckc\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.520060 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.519927 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcpsn\" (UniqueName: \"kubernetes.io/projected/2eac10de-440f-4fb9-83f1-b8f24050fd42-kube-api-access-mcpsn\") pod \"ingress-canary-qjl4k\" (UID: \"2eac10de-440f-4fb9-83f1-b8f24050fd42\") " pod="openshift-ingress-canary/ingress-canary-qjl4k" Jun 08 23:59:45.520060 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.519958 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dba8bef0-1813-4dd2-802b-0db068169b98-trusted-ca\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.520060 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.519999 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:45.520060 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.520031 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nstzz\" (UniqueName: \"kubernetes.io/projected/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-kube-api-access-nstzz\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:45.520224 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.520105 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dba8bef0-1813-4dd2-802b-0db068169b98-image-registry-private-configuration\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.520224 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.520140 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-bound-sa-token\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.520224 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.520171 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dba8bef0-1813-4dd2-802b-0db068169b98-registry-certificates\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.520224 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.520195 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-config-volume\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:45.520385 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.520273 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-tmp-dir\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:45.526362 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.526336 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 08 23:59:45.526482 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.526381 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 08 23:59:45.526482 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.526461 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 08 23:59:45.528806 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.528785 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 23:59:45.528943 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.528923 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 23:59:45.529011 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.528929 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k7v6c\"" Jun 08 23:59:45.529065 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.529035 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hgn2x\"" Jun 08 23:59:45.529128 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.529112 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 23:59:45.529528 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.529503 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 23:59:45.621191 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.621160 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:45.621191 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.621204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nstzz\" (UniqueName: \"kubernetes.io/projected/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-kube-api-access-nstzz\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:45.621437 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.621234 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dba8bef0-1813-4dd2-802b-0db068169b98-image-registry-private-configuration\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.621437 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.621258 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-bound-sa-token\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.621437 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.621288 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dba8bef0-1813-4dd2-802b-0db068169b98-registry-certificates\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.621437 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.621309 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-config-volume\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:45.621437 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:45.621341 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 23:59:45.621437 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:45.621414 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls podName:7ab4dd6e-79b1-4298-b7a8-d77b6f985b82 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:46.121391128 +0000 UTC m=+36.079658728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls") pod "dns-default-4ch68" (UID: "7ab4dd6e-79b1-4298-b7a8-d77b6f985b82") : secret "dns-default-metrics-tls" not found Jun 08 23:59:45.621827 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.621347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-tmp-dir\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:45.621827 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.621533 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dba8bef0-1813-4dd2-802b-0db068169b98-ca-trust-extracted\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.621827 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.621555 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2eac10de-440f-4fb9-83f1-b8f24050fd42-cert\") pod \"ingress-canary-qjl4k\" (UID: \"2eac10de-440f-4fb9-83f1-b8f24050fd42\") " pod="openshift-ingress-canary/ingress-canary-qjl4k" Jun 08 23:59:45.621827 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.621591 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.621827 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.621617 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dba8bef0-1813-4dd2-802b-0db068169b98-installation-pull-secrets\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.621827 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.621678 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-tmp-dir\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:45.621827 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:45.621792 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 23:59:45.621827 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:45.621808 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f4f5cff8-kq5cp: secret "image-registry-tls" not found Jun 08 23:59:45.622395 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:45.621867 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls podName:dba8bef0-1813-4dd2-802b-0db068169b98 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:46.121848206 +0000 UTC m=+36.080115807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls") pod "image-registry-59f4f5cff8-kq5cp" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98") : secret "image-registry-tls" not found Jun 08 23:59:45.622395 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.621934 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-config-volume\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:45.622395 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.621971 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psckc\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-kube-api-access-psckc\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.622395 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.622004 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcpsn\" (UniqueName: \"kubernetes.io/projected/2eac10de-440f-4fb9-83f1-b8f24050fd42-kube-api-access-mcpsn\") pod \"ingress-canary-qjl4k\" (UID: \"2eac10de-440f-4fb9-83f1-b8f24050fd42\") " pod="openshift-ingress-canary/ingress-canary-qjl4k" Jun 08 23:59:45.622395 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.622053 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dba8bef0-1813-4dd2-802b-0db068169b98-trusted-ca\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.623681 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.623650 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dba8bef0-1813-4dd2-802b-0db068169b98-trusted-ca\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.624049 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.624026 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dba8bef0-1813-4dd2-802b-0db068169b98-ca-trust-extracted\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.624423 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.624399 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dba8bef0-1813-4dd2-802b-0db068169b98-registry-certificates\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.626604 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.626579 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dba8bef0-1813-4dd2-802b-0db068169b98-image-registry-private-configuration\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.629225 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.629084 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dba8bef0-1813-4dd2-802b-0db068169b98-installation-pull-secrets\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.629957 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.629920 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-bound-sa-token\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.630064 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.629914 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2eac10de-440f-4fb9-83f1-b8f24050fd42-cert\") pod \"ingress-canary-qjl4k\" (UID: \"2eac10de-440f-4fb9-83f1-b8f24050fd42\") " pod="openshift-ingress-canary/ingress-canary-qjl4k" Jun 08 23:59:45.630461 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.630440 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nstzz\" (UniqueName: \"kubernetes.io/projected/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-kube-api-access-nstzz\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:45.631216 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.631197 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcpsn\" (UniqueName: \"kubernetes.io/projected/2eac10de-440f-4fb9-83f1-b8f24050fd42-kube-api-access-mcpsn\") pod \"ingress-canary-qjl4k\" (UID: \"2eac10de-440f-4fb9-83f1-b8f24050fd42\") " pod="openshift-ingress-canary/ingress-canary-qjl4k" Jun 08 23:59:45.631303 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.631237 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psckc\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-kube-api-access-psckc\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:45.709498 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:45.709448 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qjl4k" Jun 08 23:59:46.126046 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:46.126005 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:46.126249 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:46.126058 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:46.126249 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:46.126183 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 23:59:46.126249 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:46.126190 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 23:59:46.126249 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:46.126209 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f4f5cff8-kq5cp: secret "image-registry-tls" not found Jun 08 23:59:46.126249 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:46.126238 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls podName:7ab4dd6e-79b1-4298-b7a8-d77b6f985b82 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:47.126218618 +0000 UTC m=+37.084486200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls") pod "dns-default-4ch68" (UID: "7ab4dd6e-79b1-4298-b7a8-d77b6f985b82") : secret "dns-default-metrics-tls" not found Jun 08 23:59:46.126516 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:46.126260 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls podName:dba8bef0-1813-4dd2-802b-0db068169b98 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:47.126245719 +0000 UTC m=+37.084513314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls") pod "image-registry-59f4f5cff8-kq5cp" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98") : secret "image-registry-tls" not found Jun 08 23:59:46.915809 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:46.915771 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qjl4k"] Jun 08 23:59:46.919950 ip-10-0-128-73 kubenswrapper[2573]: W0608 23:59:46.919917 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eac10de_440f_4fb9_83f1_b8f24050fd42.slice/crio-8401a252b7826fc0013a190bbae56ac3469ede281bf96efa6b0896e39117722e WatchSource:0}: Error finding container 8401a252b7826fc0013a190bbae56ac3469ede281bf96efa6b0896e39117722e: Status 404 returned error can't find the container with id 8401a252b7826fc0013a190bbae56ac3469ede281bf96efa6b0896e39117722e Jun 08 23:59:47.135551 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:47.135497 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:47.135669 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:47.135557 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:47.135669 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:47.135646 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 23:59:47.135798 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:47.135662 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 23:59:47.135798 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:47.135683 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f4f5cff8-kq5cp: secret "image-registry-tls" not found Jun 08 23:59:47.135798 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:47.135693 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls podName:7ab4dd6e-79b1-4298-b7a8-d77b6f985b82 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:49.135680413 +0000 UTC m=+39.093947995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls") pod "dns-default-4ch68" (UID: "7ab4dd6e-79b1-4298-b7a8-d77b6f985b82") : secret "dns-default-metrics-tls" not found Jun 08 23:59:47.135798 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:47.135758 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls podName:dba8bef0-1813-4dd2-802b-0db068169b98 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:49.135717471 +0000 UTC m=+39.093985068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls") pod "image-registry-59f4f5cff8-kq5cp" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98") : secret "image-registry-tls" not found Jun 08 23:59:47.719333 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:47.719086 2573 generic.go:356] "Generic (PLEG): container finished" podID="26cea4d5-7028-4cf2-99b2-b8241284895e" containerID="205c554c89e35a3101456fa9f5a79d2b10dc0050af3ec498ded566f846a5bdc2" exitCode=0 Jun 08 23:59:47.719528 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:47.719163 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l77g" event={"ID":"26cea4d5-7028-4cf2-99b2-b8241284895e","Type":"ContainerDied","Data":"205c554c89e35a3101456fa9f5a79d2b10dc0050af3ec498ded566f846a5bdc2"} Jun 08 23:59:47.720584 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:47.720553 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qjl4k" event={"ID":"2eac10de-440f-4fb9-83f1-b8f24050fd42","Type":"ContainerStarted","Data":"8401a252b7826fc0013a190bbae56ac3469ede281bf96efa6b0896e39117722e"} Jun 08 23:59:48.726755 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:48.726707 2573 generic.go:356] "Generic (PLEG): container finished" podID="26cea4d5-7028-4cf2-99b2-b8241284895e" containerID="8da9632bf836046286e9714e27ab0c2a6b0cd34d65f1d578849e421442f2f9e7" exitCode=0 Jun 08 23:59:48.727279 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:48.726780 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l77g" event={"ID":"26cea4d5-7028-4cf2-99b2-b8241284895e","Type":"ContainerDied","Data":"8da9632bf836046286e9714e27ab0c2a6b0cd34d65f1d578849e421442f2f9e7"} Jun 08 23:59:49.156481 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:49.156447 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:49.156604 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:49.156486 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:49.156663 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:49.156601 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 23:59:49.156663 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:49.156616 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 23:59:49.156663 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:49.156639 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f4f5cff8-kq5cp: secret "image-registry-tls" not found Jun 08 23:59:49.156663 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:49.156649 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls podName:7ab4dd6e-79b1-4298-b7a8-d77b6f985b82 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:53.156637385 +0000 UTC m=+43.114904966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls") pod "dns-default-4ch68" (UID: "7ab4dd6e-79b1-4298-b7a8-d77b6f985b82") : secret "dns-default-metrics-tls" not found Jun 08 23:59:49.156838 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:49.156689 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls podName:dba8bef0-1813-4dd2-802b-0db068169b98 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:53.156671955 +0000 UTC m=+43.114939539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls") pod "image-registry-59f4f5cff8-kq5cp" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98") : secret "image-registry-tls" not found Jun 08 23:59:49.657259 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:49.657230 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 08 23:59:49.732551 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:49.732516 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l77g" event={"ID":"26cea4d5-7028-4cf2-99b2-b8241284895e","Type":"ContainerStarted","Data":"2f31ced5cfd298ad0b3c6559cd727a6dc6e8eacdf0298b1e813e935b01029f60"} Jun 08 23:59:49.733911 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:49.733886 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qjl4k" event={"ID":"2eac10de-440f-4fb9-83f1-b8f24050fd42","Type":"ContainerStarted","Data":"ecd051b48427f84c9dc3d744c3979b92b1b03548ec4f4c3bed5a98c56dd80cf4"} Jun 08 23:59:49.739815 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:49.739790 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 08 23:59:49.754521 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:49.754431 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8l77g" podStartSLOduration=10.233914771 podStartE2EDuration="39.754416109s" totalImagesPullingTime="29.520501338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:49.752586995 +0000 UTC m=+39.710854597" watchObservedRunningTime="2026-06-08 23:59:49.754416109 +0000 UTC m=+39.712683714" Jun 08 23:59:49.767067 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:49.767031 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qjl4k" podStartSLOduration=2.652529641 podStartE2EDuration="4.76701719s" totalImagesPullingTime="2.114487549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:49.766636899 +0000 UTC m=+39.724904504" watchObservedRunningTime="2026-06-08 23:59:49.76701719 +0000 UTC m=+39.725284794" Jun 08 23:59:49.941865 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:49.941828 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 08 23:59:50.042015 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:50.041933 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 08 23:59:50.094844 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:50.094819 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 08 23:59:50.667244 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:50.667216 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 08 23:59:50.714499 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:50.714470 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 08 23:59:53.184516 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:53.184483 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 08 23:59:53.184516 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:53.184525 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 08 23:59:53.184954 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:53.184628 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 23:59:53.184954 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:53.184654 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 23:59:53.184954 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:53.184675 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f4f5cff8-kq5cp: secret "image-registry-tls" not found Jun 08 23:59:53.184954 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:53.184706 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls podName:7ab4dd6e-79b1-4298-b7a8-d77b6f985b82 nodeName:}" failed. No retries permitted until 2026-06-09 00:00:01.184674621 +0000 UTC m=+51.142942203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls") pod "dns-default-4ch68" (UID: "7ab4dd6e-79b1-4298-b7a8-d77b6f985b82") : secret "dns-default-metrics-tls" not found Jun 08 23:59:53.184954 ip-10-0-128-73 kubenswrapper[2573]: E0608 23:59:53.184728 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls podName:dba8bef0-1813-4dd2-802b-0db068169b98 nodeName:}" failed. No retries permitted until 2026-06-09 00:00:01.18471508 +0000 UTC m=+51.142982661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls") pod "image-registry-59f4f5cff8-kq5cp" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98") : secret "image-registry-tls" not found Jun 08 23:59:57.169669 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:57.169627 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 08 23:59:57.213877 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:57.213843 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 08 23:59:57.919758 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:57.919715 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 08 23:59:57.965337 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:57.965308 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 08 23:59:59.550883 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:59.550847 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 08 23:59:59.600834 ip-10-0-128-73 kubenswrapper[2573]: I0608 23:59:59.600792 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:00:01.242057 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:01.242011 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 09 00:00:01.242498 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:01.242114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 09 00:00:01.242498 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:01.242160 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:00:01.242498 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:01.242192 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:00:01.242498 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:01.242202 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f4f5cff8-kq5cp: secret "image-registry-tls" not found Jun 09 00:00:01.242498 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:01.242220 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls podName:7ab4dd6e-79b1-4298-b7a8-d77b6f985b82 nodeName:}" failed. No retries permitted until 2026-06-09 00:00:17.24220397 +0000 UTC m=+67.200471552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls") pod "dns-default-4ch68" (UID: "7ab4dd6e-79b1-4298-b7a8-d77b6f985b82") : secret "dns-default-metrics-tls" not found Jun 09 00:00:01.242498 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:01.242237 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls podName:dba8bef0-1813-4dd2-802b-0db068169b98 nodeName:}" failed. No retries permitted until 2026-06-09 00:00:17.242226499 +0000 UTC m=+67.200494099 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls") pod "image-registry-59f4f5cff8-kq5cp" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98") : secret "image-registry-tls" not found Jun 09 00:00:11.710118 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:11.710092 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-twgfd" Jun 09 00:00:11.857197 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:11.857165 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:00:11.956957 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:11.956929 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:00:12.058510 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:12.058476 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:00:12.106751 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:12.106713 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:00:16.250275 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.250243 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 09 00:00:16.252955 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.252939 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 00:00:16.261019 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:16.261000 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 00:00:16.261097 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:16.261087 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs podName:314dabf5-096d-442a-9db1-83512bf87f66 nodeName:}" failed. No retries permitted until 2026-06-09 00:01:20.261071519 +0000 UTC m=+130.219339101 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs") pod "network-metrics-daemon-tcxq6" (UID: "314dabf5-096d-442a-9db1-83512bf87f66") : secret "metrics-daemon-secret" not found Jun 09 00:00:16.350840 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.350798 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 09 00:00:16.353087 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.353071 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 00:00:16.365203 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.365179 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d64b55-58c7-4005-859a-0a895a3a1971-original-pull-secret\") pod \"global-pull-secret-syncer-nr9c8\" (UID: \"36d64b55-58c7-4005-859a-0a895a3a1971\") " pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 09 00:00:16.445773 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.445724 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9c8" Jun 09 00:00:16.451784 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.451761 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4phc\" (UniqueName: \"kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc\") pod \"network-check-target-zz4hd\" (UID: \"36e2bd15-8d51-4018-a5cb-daba9c9cd0f5\") " pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 09 00:00:16.454556 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.454535 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 00:00:16.464296 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.464275 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 00:00:16.475858 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.475835 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4phc\" (UniqueName: \"kubernetes.io/projected/36e2bd15-8d51-4018-a5cb-daba9c9cd0f5-kube-api-access-v4phc\") pod \"network-check-target-zz4hd\" (UID: \"36e2bd15-8d51-4018-a5cb-daba9c9cd0f5\") " pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 09 00:00:16.564617 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.564586 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nr9c8"] Jun 09 00:00:16.567886 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:00:16.567862 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d64b55_58c7_4005_859a_0a895a3a1971.slice/crio-8ea0ae7a6088ea1c7bb2db01b02a88d951123dd73f83b0f0ffbc0c48452966f2 WatchSource:0}: Error finding container 8ea0ae7a6088ea1c7bb2db01b02a88d951123dd73f83b0f0ffbc0c48452966f2: Status 404 returned error can't find the container with id 8ea0ae7a6088ea1c7bb2db01b02a88d951123dd73f83b0f0ffbc0c48452966f2 Jun 09 00:00:16.754324 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.754300 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hgn2x\"" Jun 09 00:00:16.762241 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.762220 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 09 00:00:16.796938 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.796866 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nr9c8" event={"ID":"36d64b55-58c7-4005-859a-0a895a3a1971","Type":"ContainerStarted","Data":"8ea0ae7a6088ea1c7bb2db01b02a88d951123dd73f83b0f0ffbc0c48452966f2"} Jun 09 00:00:16.876443 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:16.876416 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zz4hd"] Jun 09 00:00:16.879473 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:00:16.879451 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e2bd15_8d51_4018_a5cb_daba9c9cd0f5.slice/crio-a211f7e5151ce90ccbefa516da2838dcd04f4cf6a39d88f9d5bf9a3630b66c73 WatchSource:0}: Error finding container a211f7e5151ce90ccbefa516da2838dcd04f4cf6a39d88f9d5bf9a3630b66c73: Status 404 returned error can't find the container with id a211f7e5151ce90ccbefa516da2838dcd04f4cf6a39d88f9d5bf9a3630b66c73 Jun 09 00:00:17.258373 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:17.258338 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 09 00:00:17.258865 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:17.258388 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 09 00:00:17.258865 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:17.258507 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:00:17.258865 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:17.258533 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:00:17.258865 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:17.258537 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f4f5cff8-kq5cp: secret "image-registry-tls" not found Jun 09 00:00:17.258865 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:17.258593 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls podName:7ab4dd6e-79b1-4298-b7a8-d77b6f985b82 nodeName:}" failed. No retries permitted until 2026-06-09 00:00:49.258578221 +0000 UTC m=+99.216845807 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls") pod "dns-default-4ch68" (UID: "7ab4dd6e-79b1-4298-b7a8-d77b6f985b82") : secret "dns-default-metrics-tls" not found Jun 09 00:00:17.258865 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:17.258611 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls podName:dba8bef0-1813-4dd2-802b-0db068169b98 nodeName:}" failed. No retries permitted until 2026-06-09 00:00:49.258602092 +0000 UTC m=+99.216869675 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls") pod "image-registry-59f4f5cff8-kq5cp" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98") : secret "image-registry-tls" not found Jun 09 00:00:17.801415 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:17.801374 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zz4hd" event={"ID":"36e2bd15-8d51-4018-a5cb-daba9c9cd0f5","Type":"ContainerStarted","Data":"a211f7e5151ce90ccbefa516da2838dcd04f4cf6a39d88f9d5bf9a3630b66c73"} Jun 09 00:00:21.102304 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:21.102263 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:00:21.159142 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:21.159100 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:00:21.813148 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:21.813058 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nr9c8" event={"ID":"36d64b55-58c7-4005-859a-0a895a3a1971","Type":"ContainerStarted","Data":"0c129f60325c5677ba51d83aaadaecf2dda0f9000b8fffa713bb2a0cd2f721a9"} Jun 09 00:00:21.814467 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:21.814440 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zz4hd" event={"ID":"36e2bd15-8d51-4018-a5cb-daba9c9cd0f5","Type":"ContainerStarted","Data":"902510817aab2e6aac3ea38e885bfb9d5c749581a9eb483e7ade1086fd82aa65"} Jun 09 00:00:21.814574 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:21.814494 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 09 00:00:21.827555 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:21.827517 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nr9c8" podStartSLOduration=67.13682934 podStartE2EDuration="1m11.827505048s" totalImagesPullingTime="4.690675708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:00:21.826490624 +0000 UTC m=+71.784758229" watchObservedRunningTime="2026-06-09 00:00:21.827505048 +0000 UTC m=+71.785772652" Jun 09 00:00:21.839526 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:21.839485 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zz4hd" podStartSLOduration=67.464870196 podStartE2EDuration="1m11.839474525s" totalImagesPullingTime="4.374604329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:00:21.839099989 +0000 UTC m=+71.797367592" watchObservedRunningTime="2026-06-09 00:00:21.839474525 +0000 UTC m=+71.797742146" Jun 09 00:00:25.472371 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:25.472335 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:00:49.274663 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:49.274630 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 09 00:00:49.274663 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:49.274667 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 09 00:00:49.275173 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:49.274790 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:00:49.275173 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:49.274809 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:00:49.275173 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:49.274829 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f4f5cff8-kq5cp: secret "image-registry-tls" not found Jun 09 00:00:49.275173 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:49.274849 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls podName:7ab4dd6e-79b1-4298-b7a8-d77b6f985b82 nodeName:}" failed. No retries permitted until 2026-06-09 00:01:53.274835455 +0000 UTC m=+163.233103037 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls") pod "dns-default-4ch68" (UID: "7ab4dd6e-79b1-4298-b7a8-d77b6f985b82") : secret "dns-default-metrics-tls" not found Jun 09 00:00:49.275173 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:00:49.274881 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls podName:dba8bef0-1813-4dd2-802b-0db068169b98 nodeName:}" failed. No retries permitted until 2026-06-09 00:01:53.274868472 +0000 UTC m=+163.233136053 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls") pod "image-registry-59f4f5cff8-kq5cp" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98") : secret "image-registry-tls" not found Jun 09 00:00:52.818423 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:00:52.818393 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zz4hd" Jun 09 00:01:20.286870 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:01:20.286825 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 09 00:01:20.287333 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:01:20.286951 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 00:01:20.287333 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:01:20.287004 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs podName:314dabf5-096d-442a-9db1-83512bf87f66 nodeName:}" failed. No retries permitted until 2026-06-09 00:03:22.286990606 +0000 UTC m=+252.245258187 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs") pod "network-metrics-daemon-tcxq6" (UID: "314dabf5-096d-442a-9db1-83512bf87f66") : secret "metrics-daemon-secret" not found Jun 09 00:01:48.369242 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:01:48.369186 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" podUID="dba8bef0-1813-4dd2-802b-0db068169b98" Jun 09 00:01:48.393425 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:01:48.393397 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4ch68" podUID="7ab4dd6e-79b1-4298-b7a8-d77b6f985b82" Jun 09 00:01:48.537339 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:01:48.537308 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tcxq6" podUID="314dabf5-096d-442a-9db1-83512bf87f66" Jun 09 00:01:49.017083 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:01:49.017056 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4ch68" Jun 09 00:01:49.017243 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:01:49.017056 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 09 00:01:53.298762 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:01:53.298637 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 09 00:01:53.298762 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:01:53.298696 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 09 00:01:53.299220 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:01:53.298814 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:01:53.299220 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:01:53.298834 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f4f5cff8-kq5cp: secret "image-registry-tls" not found Jun 09 00:01:53.299220 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:01:53.298846 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:01:53.299220 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:01:53.298902 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls podName:dba8bef0-1813-4dd2-802b-0db068169b98 nodeName:}" failed. No retries permitted until 2026-06-09 00:03:55.298886488 +0000 UTC m=+285.257154083 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls") pod "image-registry-59f4f5cff8-kq5cp" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98") : secret "image-registry-tls" not found Jun 09 00:01:53.299220 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:01:53.298916 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls podName:7ab4dd6e-79b1-4298-b7a8-d77b6f985b82 nodeName:}" failed. No retries permitted until 2026-06-09 00:03:55.298909964 +0000 UTC m=+285.257177546 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls") pod "dns-default-4ch68" (UID: "7ab4dd6e-79b1-4298-b7a8-d77b6f985b82") : secret "dns-default-metrics-tls" not found Jun 09 00:02:00.528145 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:00.528111 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 09 00:02:47.872872 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.872838 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-92qnq"] Jun 09 00:02:47.875722 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.875692 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-h26mm"] Jun 09 00:02:47.875985 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.875961 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-92qnq" Jun 09 00:02:47.878363 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.878342 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5698bdd995-q7cpq"] Jun 09 00:02:47.878484 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.878453 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 00:02:47.878484 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.878460 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:47.878593 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.878527 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:02:47.879954 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.879933 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7fvxk\"" Jun 09 00:02:47.880542 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.880525 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 00:02:47.880978 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.880963 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:47.881115 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.881097 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-97k94\"" Jun 09 00:02:47.881465 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.881450 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 00:02:47.881541 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.881471 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 00:02:47.881599 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.881550 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 00:02:47.883283 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.883264 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 09 00:02:47.883410 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.883273 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 00:02:47.884400 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.884381 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 09 00:02:47.884506 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.884440 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 09 00:02:47.884506 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.884456 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zd2q5\"" Jun 09 00:02:47.884506 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.884415 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 09 00:02:47.884688 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.884389 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 00:02:47.886370 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.886352 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-92qnq"] Jun 09 00:02:47.893913 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.893888 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-h26mm"] Jun 09 00:02:47.894383 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.894264 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 00:02:47.896133 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.896113 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5698bdd995-q7cpq"] Jun 09 00:02:47.963030 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.963005 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97475d09-d6f9-4643-888f-2b941dcebba9-trusted-ca-bundle\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:47.963144 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.963045 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:47.963144 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.963070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97475d09-d6f9-4643-888f-2b941dcebba9-serving-cert\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:47.963144 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.963134 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-stats-auth\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:47.963304 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.963158 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dszpx\" (UniqueName: \"kubernetes.io/projected/f7566520-eef1-4e98-8240-1d5561056a0f-kube-api-access-dszpx\") pod \"volume-data-source-validator-78dd696465-92qnq\" (UID: \"f7566520-eef1-4e98-8240-1d5561056a0f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-92qnq" Jun 09 00:02:47.963304 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.963181 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/97475d09-d6f9-4643-888f-2b941dcebba9-snapshots\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:47.963304 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.963208 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97475d09-d6f9-4643-888f-2b941dcebba9-service-ca-bundle\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:47.963304 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.963279 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-default-certificate\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:47.963470 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.963339 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwr8b\" (UniqueName: \"kubernetes.io/projected/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-kube-api-access-xwr8b\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:47.963470 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.963361 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97475d09-d6f9-4643-888f-2b941dcebba9-tmp\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:47.963470 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.963406 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bczqk\" (UniqueName: \"kubernetes.io/projected/97475d09-d6f9-4643-888f-2b941dcebba9-kube-api-access-bczqk\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:47.963470 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.963442 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:47.972262 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.972240 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6"] Jun 09 00:02:47.974992 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.974977 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-hrzw9"] Jun 09 00:02:47.975120 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.975103 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" Jun 09 00:02:47.977301 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.977283 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 00:02:47.977400 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.977367 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:02:47.977400 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.977374 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 00:02:47.977518 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.977423 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6c9s4\"" Jun 09 00:02:47.977518 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.977492 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 00:02:47.977643 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.977615 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:47.979567 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.979548 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 00:02:47.979985 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.979971 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 00:02:47.980124 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.980042 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 00:02:47.980124 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.980058 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-w5zkm\"" Jun 09 00:02:47.980229 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.980185 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:02:47.984571 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.984554 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 00:02:47.987781 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.987762 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6"] Jun 09 00:02:47.988932 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:47.988911 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-hrzw9"] Jun 09 00:02:48.064171 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064145 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8khq\" (UniqueName: \"kubernetes.io/projected/23e2ea38-cbb7-4a18-a6f3-858f73866c55-kube-api-access-n8khq\") pod \"console-operator-668fdbf85c-hrzw9\" (UID: \"23e2ea38-cbb7-4a18-a6f3-858f73866c55\") " pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:48.064274 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064174 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwr8b\" (UniqueName: \"kubernetes.io/projected/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-kube-api-access-xwr8b\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:48.064274 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064200 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:48.064274 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064221 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23e2ea38-cbb7-4a18-a6f3-858f73866c55-trusted-ca\") pod \"console-operator-668fdbf85c-hrzw9\" (UID: \"23e2ea38-cbb7-4a18-a6f3-858f73866c55\") " pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:48.064274 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064244 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97475d09-d6f9-4643-888f-2b941dcebba9-serving-cert\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:48.064501 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064289 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23e2ea38-cbb7-4a18-a6f3-858f73866c55-config\") pod \"console-operator-668fdbf85c-hrzw9\" (UID: \"23e2ea38-cbb7-4a18-a6f3-858f73866c55\") " pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:48.064501 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:48.064309 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 00:02:48.064501 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064336 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dszpx\" (UniqueName: \"kubernetes.io/projected/f7566520-eef1-4e98-8240-1d5561056a0f-kube-api-access-dszpx\") pod \"volume-data-source-validator-78dd696465-92qnq\" (UID: \"f7566520-eef1-4e98-8240-1d5561056a0f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-92qnq" Jun 09 00:02:48.064501 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:48.064374 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs podName:3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e nodeName:}" failed. No retries permitted until 2026-06-09 00:02:48.564355901 +0000 UTC m=+218.522623488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs") pod "router-default-5698bdd995-q7cpq" (UID: "3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e") : secret "router-metrics-certs-default" not found Jun 09 00:02:48.064501 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064395 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23e2ea38-cbb7-4a18-a6f3-858f73866c55-serving-cert\") pod \"console-operator-668fdbf85c-hrzw9\" (UID: \"23e2ea38-cbb7-4a18-a6f3-858f73866c55\") " pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:48.064501 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064431 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97475d09-d6f9-4643-888f-2b941dcebba9-service-ca-bundle\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:48.064501 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064480 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bczqk\" (UniqueName: \"kubernetes.io/projected/97475d09-d6f9-4643-888f-2b941dcebba9-kube-api-access-bczqk\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:48.064911 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97475d09-d6f9-4643-888f-2b941dcebba9-tmp\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:48.064911 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064550 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1000d8f6-3db7-4c2b-b676-3a60dc05dca8-config\") pod \"service-ca-operator-6bc5ff68f5-4vnl6\" (UID: \"1000d8f6-3db7-4c2b-b676-3a60dc05dca8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" Jun 09 00:02:48.064911 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064585 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97475d09-d6f9-4643-888f-2b941dcebba9-trusted-ca-bundle\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:48.064911 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064606 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:48.064911 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064624 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/97475d09-d6f9-4643-888f-2b941dcebba9-snapshots\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:48.064911 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064640 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-stats-auth\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:48.064911 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064656 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfzk8\" (UniqueName: \"kubernetes.io/projected/1000d8f6-3db7-4c2b-b676-3a60dc05dca8-kube-api-access-lfzk8\") pod \"service-ca-operator-6bc5ff68f5-4vnl6\" (UID: \"1000d8f6-3db7-4c2b-b676-3a60dc05dca8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" Jun 09 00:02:48.064911 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064688 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-default-certificate\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:48.064911 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064703 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1000d8f6-3db7-4c2b-b676-3a60dc05dca8-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-4vnl6\" (UID: \"1000d8f6-3db7-4c2b-b676-3a60dc05dca8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" Jun 09 00:02:48.064911 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064891 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97475d09-d6f9-4643-888f-2b941dcebba9-tmp\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:48.065350 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.064991 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97475d09-d6f9-4643-888f-2b941dcebba9-service-ca-bundle\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:48.065350 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:48.065072 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle podName:3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e nodeName:}" failed. No retries permitted until 2026-06-09 00:02:48.565053866 +0000 UTC m=+218.523321451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle") pod "router-default-5698bdd995-q7cpq" (UID: "3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e") : configmap references non-existent config key: service-ca.crt Jun 09 00:02:48.065350 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.065289 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/97475d09-d6f9-4643-888f-2b941dcebba9-snapshots\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:48.065845 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.065822 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97475d09-d6f9-4643-888f-2b941dcebba9-trusted-ca-bundle\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:48.066275 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.066257 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg"] Jun 09 00:02:48.067036 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.067018 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97475d09-d6f9-4643-888f-2b941dcebba9-serving-cert\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:48.067537 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.067511 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-stats-auth\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:48.067629 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.067597 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-default-certificate\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:48.069982 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.069965 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" Jun 09 00:02:48.072323 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.072302 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 00:02:48.072516 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.072462 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 00:02:48.072596 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.072547 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:02:48.072596 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.072550 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 00:02:48.072846 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.072829 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7f7qc\"" Jun 09 00:02:48.077585 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.077564 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwr8b\" (UniqueName: \"kubernetes.io/projected/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-kube-api-access-xwr8b\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:48.078265 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.078248 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg"] Jun 09 00:02:48.081379 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.081357 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dszpx\" (UniqueName: \"kubernetes.io/projected/f7566520-eef1-4e98-8240-1d5561056a0f-kube-api-access-dszpx\") pod \"volume-data-source-validator-78dd696465-92qnq\" (UID: \"f7566520-eef1-4e98-8240-1d5561056a0f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-92qnq" Jun 09 00:02:48.081522 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.081463 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bczqk\" (UniqueName: \"kubernetes.io/projected/97475d09-d6f9-4643-888f-2b941dcebba9-kube-api-access-bczqk\") pod \"insights-operator-896549976-h26mm\" (UID: \"97475d09-d6f9-4643-888f-2b941dcebba9\") " pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:48.135628 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.135567 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:48.165843 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.165821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23e2ea38-cbb7-4a18-a6f3-858f73866c55-trusted-ca\") pod \"console-operator-668fdbf85c-hrzw9\" (UID: \"23e2ea38-cbb7-4a18-a6f3-858f73866c55\") " pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:48.165939 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.165849 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23e2ea38-cbb7-4a18-a6f3-858f73866c55-config\") pod \"console-operator-668fdbf85c-hrzw9\" (UID: \"23e2ea38-cbb7-4a18-a6f3-858f73866c55\") " pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:48.165939 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.165871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23e2ea38-cbb7-4a18-a6f3-858f73866c55-serving-cert\") pod \"console-operator-668fdbf85c-hrzw9\" (UID: \"23e2ea38-cbb7-4a18-a6f3-858f73866c55\") " pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:48.165939 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.165906 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1000d8f6-3db7-4c2b-b676-3a60dc05dca8-config\") pod \"service-ca-operator-6bc5ff68f5-4vnl6\" (UID: \"1000d8f6-3db7-4c2b-b676-3a60dc05dca8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" Jun 09 00:02:48.166080 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.165975 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed9bb569-7c77-4fe2-91e6-271914697329-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g89kg\" (UID: \"ed9bb569-7c77-4fe2-91e6-271914697329\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" Jun 09 00:02:48.166080 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.166008 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfzk8\" (UniqueName: \"kubernetes.io/projected/1000d8f6-3db7-4c2b-b676-3a60dc05dca8-kube-api-access-lfzk8\") pod \"service-ca-operator-6bc5ff68f5-4vnl6\" (UID: \"1000d8f6-3db7-4c2b-b676-3a60dc05dca8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" Jun 09 00:02:48.166080 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.166031 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ed9bb569-7c77-4fe2-91e6-271914697329-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g89kg\" (UID: \"ed9bb569-7c77-4fe2-91e6-271914697329\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" Jun 09 00:02:48.166080 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.166060 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1000d8f6-3db7-4c2b-b676-3a60dc05dca8-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-4vnl6\" (UID: \"1000d8f6-3db7-4c2b-b676-3a60dc05dca8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" Jun 09 00:02:48.166271 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.166110 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zd7f\" (UniqueName: \"kubernetes.io/projected/ed9bb569-7c77-4fe2-91e6-271914697329-kube-api-access-6zd7f\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g89kg\" (UID: \"ed9bb569-7c77-4fe2-91e6-271914697329\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" Jun 09 00:02:48.166271 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.166143 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8khq\" (UniqueName: \"kubernetes.io/projected/23e2ea38-cbb7-4a18-a6f3-858f73866c55-kube-api-access-n8khq\") pod \"console-operator-668fdbf85c-hrzw9\" (UID: \"23e2ea38-cbb7-4a18-a6f3-858f73866c55\") " pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:48.166603 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.166572 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23e2ea38-cbb7-4a18-a6f3-858f73866c55-config\") pod \"console-operator-668fdbf85c-hrzw9\" (UID: \"23e2ea38-cbb7-4a18-a6f3-858f73866c55\") " pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:48.166603 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.166572 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1000d8f6-3db7-4c2b-b676-3a60dc05dca8-config\") pod \"service-ca-operator-6bc5ff68f5-4vnl6\" (UID: \"1000d8f6-3db7-4c2b-b676-3a60dc05dca8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" Jun 09 00:02:48.166763 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.166656 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23e2ea38-cbb7-4a18-a6f3-858f73866c55-trusted-ca\") pod \"console-operator-668fdbf85c-hrzw9\" (UID: \"23e2ea38-cbb7-4a18-a6f3-858f73866c55\") " pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:48.168127 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.168106 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23e2ea38-cbb7-4a18-a6f3-858f73866c55-serving-cert\") pod \"console-operator-668fdbf85c-hrzw9\" (UID: \"23e2ea38-cbb7-4a18-a6f3-858f73866c55\") " pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:48.168224 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.168203 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1000d8f6-3db7-4c2b-b676-3a60dc05dca8-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-4vnl6\" (UID: \"1000d8f6-3db7-4c2b-b676-3a60dc05dca8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" Jun 09 00:02:48.174263 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.174245 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfzk8\" (UniqueName: \"kubernetes.io/projected/1000d8f6-3db7-4c2b-b676-3a60dc05dca8-kube-api-access-lfzk8\") pod \"service-ca-operator-6bc5ff68f5-4vnl6\" (UID: \"1000d8f6-3db7-4c2b-b676-3a60dc05dca8\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" Jun 09 00:02:48.174350 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.174264 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8khq\" (UniqueName: \"kubernetes.io/projected/23e2ea38-cbb7-4a18-a6f3-858f73866c55-kube-api-access-n8khq\") pod \"console-operator-668fdbf85c-hrzw9\" (UID: \"23e2ea38-cbb7-4a18-a6f3-858f73866c55\") " pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:48.188156 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.188143 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-92qnq" Jun 09 00:02:48.200521 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.200503 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-h26mm" Jun 09 00:02:48.224335 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.224306 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:48.267715 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.267247 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed9bb569-7c77-4fe2-91e6-271914697329-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g89kg\" (UID: \"ed9bb569-7c77-4fe2-91e6-271914697329\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" Jun 09 00:02:48.267715 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.267298 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ed9bb569-7c77-4fe2-91e6-271914697329-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g89kg\" (UID: \"ed9bb569-7c77-4fe2-91e6-271914697329\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" Jun 09 00:02:48.267715 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.267358 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zd7f\" (UniqueName: \"kubernetes.io/projected/ed9bb569-7c77-4fe2-91e6-271914697329-kube-api-access-6zd7f\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g89kg\" (UID: \"ed9bb569-7c77-4fe2-91e6-271914697329\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" Jun 09 00:02:48.268013 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.267987 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed9bb569-7c77-4fe2-91e6-271914697329-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g89kg\" (UID: \"ed9bb569-7c77-4fe2-91e6-271914697329\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" Jun 09 00:02:48.270768 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.270732 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ed9bb569-7c77-4fe2-91e6-271914697329-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g89kg\" (UID: \"ed9bb569-7c77-4fe2-91e6-271914697329\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" Jun 09 00:02:48.275510 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.275436 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zd7f\" (UniqueName: \"kubernetes.io/projected/ed9bb569-7c77-4fe2-91e6-271914697329-kube-api-access-6zd7f\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g89kg\" (UID: \"ed9bb569-7c77-4fe2-91e6-271914697329\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" Jun 09 00:02:48.284260 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.284212 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" Jun 09 00:02:48.291133 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.290933 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:48.323407 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.323368 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-92qnq"] Jun 09 00:02:48.327110 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:02:48.327080 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7566520_eef1_4e98_8240_1d5561056a0f.slice/crio-37b646f6b7bdeb2305ff1120b9afa03dbc69762933b0ffbd27715465fecfde1d WatchSource:0}: Error finding container 37b646f6b7bdeb2305ff1120b9afa03dbc69762933b0ffbd27715465fecfde1d: Status 404 returned error can't find the container with id 37b646f6b7bdeb2305ff1120b9afa03dbc69762933b0ffbd27715465fecfde1d Jun 09 00:02:48.339256 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.339234 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-h26mm"] Jun 09 00:02:48.341021 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:02:48.340997 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97475d09_d6f9_4643_888f_2b941dcebba9.slice/crio-441e349185fd443ca2304ba1dbcfcca2ed0c70491d0c0dc96f3421b58f05b07b WatchSource:0}: Error finding container 441e349185fd443ca2304ba1dbcfcca2ed0c70491d0c0dc96f3421b58f05b07b: Status 404 returned error can't find the container with id 441e349185fd443ca2304ba1dbcfcca2ed0c70491d0c0dc96f3421b58f05b07b Jun 09 00:02:48.393052 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.392999 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" Jun 09 00:02:48.424632 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.424601 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-hrzw9"] Jun 09 00:02:48.427639 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:02:48.427603 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e2ea38_cbb7_4a18_a6f3_858f73866c55.slice/crio-6983fc559e29d479b21068b7a703805144ceef30291864eae863ab61528359c4 WatchSource:0}: Error finding container 6983fc559e29d479b21068b7a703805144ceef30291864eae863ab61528359c4: Status 404 returned error can't find the container with id 6983fc559e29d479b21068b7a703805144ceef30291864eae863ab61528359c4 Jun 09 00:02:48.437406 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.437379 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6"] Jun 09 00:02:48.439658 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:02:48.439631 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1000d8f6_3db7_4c2b_b676_3a60dc05dca8.slice/crio-1f9c31202d6fd8ad632755674bc5a62b2c840cc04a53996b182a6250fa7e99a9 WatchSource:0}: Error finding container 1f9c31202d6fd8ad632755674bc5a62b2c840cc04a53996b182a6250fa7e99a9: Status 404 returned error can't find the container with id 1f9c31202d6fd8ad632755674bc5a62b2c840cc04a53996b182a6250fa7e99a9 Jun 09 00:02:48.516280 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.516255 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg"] Jun 09 00:02:48.519053 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:02:48.519029 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded9bb569_7c77_4fe2_91e6_271914697329.slice/crio-152af3a68e40c3de3a143bc76c97d4662ee868ba6b6eb0dcb40928319b2d80b8 WatchSource:0}: Error finding container 152af3a68e40c3de3a143bc76c97d4662ee868ba6b6eb0dcb40928319b2d80b8: Status 404 returned error can't find the container with id 152af3a68e40c3de3a143bc76c97d4662ee868ba6b6eb0dcb40928319b2d80b8 Jun 09 00:02:48.569519 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.569491 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:48.569610 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:48.569546 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:48.569651 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:48.569634 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 00:02:48.569684 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:48.569665 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle podName:3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e nodeName:}" failed. No retries permitted until 2026-06-09 00:02:49.569653059 +0000 UTC m=+219.527920641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle") pod "router-default-5698bdd995-q7cpq" (UID: "3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e") : configmap references non-existent config key: service-ca.crt Jun 09 00:02:48.569724 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:48.569685 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs podName:3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e nodeName:}" failed. No retries permitted until 2026-06-09 00:02:49.569672243 +0000 UTC m=+219.527939825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs") pod "router-default-5698bdd995-q7cpq" (UID: "3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e") : secret "router-metrics-certs-default" not found Jun 09 00:02:49.161495 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:49.161407 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" event={"ID":"23e2ea38-cbb7-4a18-a6f3-858f73866c55","Type":"ContainerStarted","Data":"6983fc559e29d479b21068b7a703805144ceef30291864eae863ab61528359c4"} Jun 09 00:02:49.163608 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:49.163539 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-h26mm" event={"ID":"97475d09-d6f9-4643-888f-2b941dcebba9","Type":"ContainerStarted","Data":"441e349185fd443ca2304ba1dbcfcca2ed0c70491d0c0dc96f3421b58f05b07b"} Jun 09 00:02:49.164848 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:49.164796 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-92qnq" event={"ID":"f7566520-eef1-4e98-8240-1d5561056a0f","Type":"ContainerStarted","Data":"37b646f6b7bdeb2305ff1120b9afa03dbc69762933b0ffbd27715465fecfde1d"} Jun 09 00:02:49.166611 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:49.166582 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" event={"ID":"1000d8f6-3db7-4c2b-b676-3a60dc05dca8","Type":"ContainerStarted","Data":"1f9c31202d6fd8ad632755674bc5a62b2c840cc04a53996b182a6250fa7e99a9"} Jun 09 00:02:49.168279 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:49.168253 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" event={"ID":"ed9bb569-7c77-4fe2-91e6-271914697329","Type":"ContainerStarted","Data":"152af3a68e40c3de3a143bc76c97d4662ee868ba6b6eb0dcb40928319b2d80b8"} Jun 09 00:02:49.578174 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:49.578135 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:49.578421 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:49.578382 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle podName:3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e nodeName:}" failed. No retries permitted until 2026-06-09 00:02:51.578358256 +0000 UTC m=+221.536625851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle") pod "router-default-5698bdd995-q7cpq" (UID: "3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e") : configmap references non-existent config key: service-ca.crt Jun 09 00:02:49.578959 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:49.578588 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:49.578959 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:49.578765 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 00:02:49.578959 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:49.578823 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs podName:3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e nodeName:}" failed. No retries permitted until 2026-06-09 00:02:51.578804964 +0000 UTC m=+221.537072561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs") pod "router-default-5698bdd995-q7cpq" (UID: "3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e") : secret "router-metrics-certs-default" not found Jun 09 00:02:50.173024 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:50.172945 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-92qnq" event={"ID":"f7566520-eef1-4e98-8240-1d5561056a0f","Type":"ContainerStarted","Data":"5eb909eb102a27265df0d4e6bb544700c721676c68ee44aa8a9136fbdd54ccf6"} Jun 09 00:02:50.187630 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:50.187549 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-92qnq" podStartSLOduration=1.578913967 podStartE2EDuration="3.187530949s" totalImagesPullingTime="1.608616982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:02:50.186628234 +0000 UTC m=+220.144895839" watchObservedRunningTime="2026-06-09 00:02:50.187530949 +0000 UTC m=+220.145798555" Jun 09 00:02:50.257584 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:50.257545 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:50.306472 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:50.306434 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:51.596999 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:51.596953 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:51.597479 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:51.597056 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:51.597479 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:51.597151 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle podName:3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e nodeName:}" failed. No retries permitted until 2026-06-09 00:02:55.597130381 +0000 UTC m=+225.555397966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle") pod "router-default-5698bdd995-q7cpq" (UID: "3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e") : configmap references non-existent config key: service-ca.crt Jun 09 00:02:51.597479 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:51.597193 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 00:02:51.597479 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:51.597243 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs podName:3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e nodeName:}" failed. No retries permitted until 2026-06-09 00:02:55.597226752 +0000 UTC m=+225.555494356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs") pod "router-default-5698bdd995-q7cpq" (UID: "3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e") : secret "router-metrics-certs-default" not found Jun 09 00:02:53.182905 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:53.182876 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/0.log" Jun 09 00:02:53.183341 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:53.182915 2573 generic.go:356] "Generic (PLEG): container finished" podID="23e2ea38-cbb7-4a18-a6f3-858f73866c55" containerID="5f678010a65a9d7ed665d824bb814e52ff5dd0d152cdb1654975713fb2388c6e" exitCode=255 Jun 09 00:02:53.183341 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:53.182992 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" event={"ID":"23e2ea38-cbb7-4a18-a6f3-858f73866c55","Type":"ContainerDied","Data":"5f678010a65a9d7ed665d824bb814e52ff5dd0d152cdb1654975713fb2388c6e"} Jun 09 00:02:53.183341 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:53.183246 2573 scope.go:117] "RemoveContainer" containerID="5f678010a65a9d7ed665d824bb814e52ff5dd0d152cdb1654975713fb2388c6e" Jun 09 00:02:53.184698 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:53.184670 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-h26mm" event={"ID":"97475d09-d6f9-4643-888f-2b941dcebba9","Type":"ContainerStarted","Data":"415b700d9ad148a9db98492e21c3379d75407f6c7c17fa608917204d846696af"} Jun 09 00:02:53.186263 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:53.186234 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" event={"ID":"1000d8f6-3db7-4c2b-b676-3a60dc05dca8","Type":"ContainerStarted","Data":"a403f930e5ad1dc5a7cca0bf84551ca09f91d2ee8f78306c44222e5a84f6e573"} Jun 09 00:02:53.187920 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:53.187902 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" event={"ID":"ed9bb569-7c77-4fe2-91e6-271914697329","Type":"ContainerStarted","Data":"216f0b3a8990510a384b800b01c3e66bd61003c847e99d16137e6f4f55a44511"} Jun 09 00:02:53.214725 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:53.214510 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" podStartSLOduration=2.296748194 podStartE2EDuration="6.214495301s" totalImagesPullingTime="3.917747107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:02:53.21392796 +0000 UTC m=+223.172195563" watchObservedRunningTime="2026-06-09 00:02:53.214495301 +0000 UTC m=+223.172762908" Jun 09 00:02:53.228417 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:53.228374 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" podStartSLOduration=1.393477541 podStartE2EDuration="5.228357141s" totalImagesPullingTime="3.8348796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:02:53.22752447 +0000 UTC m=+223.185792074" watchObservedRunningTime="2026-06-09 00:02:53.228357141 +0000 UTC m=+223.186624750" Jun 09 00:02:53.242281 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:53.242236 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-h26mm" podStartSLOduration=2.224614372 podStartE2EDuration="6.242219216s" totalImagesPullingTime="4.017604844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:02:53.241425874 +0000 UTC m=+223.199693479" watchObservedRunningTime="2026-06-09 00:02:53.242219216 +0000 UTC m=+223.200486822" Jun 09 00:02:53.850948 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:53.850912 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:53.947370 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:53.947333 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:54.045506 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:54.045462 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:54.095556 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:54.095520 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:54.192643 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:54.192578 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/1.log" Jun 09 00:02:54.193040 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:54.192999 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/0.log" Jun 09 00:02:54.193040 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:54.193030 2573 generic.go:356] "Generic (PLEG): container finished" podID="23e2ea38-cbb7-4a18-a6f3-858f73866c55" containerID="79bb86bfbf0ea0146280e01c4b03dd39e8c89fa81817e26d49c908e3904dae58" exitCode=255 Jun 09 00:02:54.193115 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:54.193079 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" event={"ID":"23e2ea38-cbb7-4a18-a6f3-858f73866c55","Type":"ContainerDied","Data":"79bb86bfbf0ea0146280e01c4b03dd39e8c89fa81817e26d49c908e3904dae58"} Jun 09 00:02:54.193148 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:54.193133 2573 scope.go:117] "RemoveContainer" containerID="5f678010a65a9d7ed665d824bb814e52ff5dd0d152cdb1654975713fb2388c6e" Jun 09 00:02:54.193336 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:54.193317 2573 scope.go:117] "RemoveContainer" containerID="79bb86bfbf0ea0146280e01c4b03dd39e8c89fa81817e26d49c908e3904dae58" Jun 09 00:02:54.193534 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:54.193507 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-hrzw9_openshift-console-operator(23e2ea38-cbb7-4a18-a6f3-858f73866c55)\"" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" podUID="23e2ea38-cbb7-4a18-a6f3-858f73866c55" Jun 09 00:02:54.469017 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:54.468895 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:54.740709 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:54.740677 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:54.841560 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:54.841521 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:55.197619 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:55.197549 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/1.log" Jun 09 00:02:55.198042 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:55.197882 2573 scope.go:117] "RemoveContainer" containerID="79bb86bfbf0ea0146280e01c4b03dd39e8c89fa81817e26d49c908e3904dae58" Jun 09 00:02:55.198042 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:55.198030 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-hrzw9_openshift-console-operator(23e2ea38-cbb7-4a18-a6f3-858f73866c55)\"" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" podUID="23e2ea38-cbb7-4a18-a6f3-858f73866c55" Jun 09 00:02:55.629033 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:55.628992 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:55.629239 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:55.629065 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:02:55.629239 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:55.629151 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 00:02:55.629239 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:55.629187 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle podName:3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e nodeName:}" failed. No retries permitted until 2026-06-09 00:03:03.629165539 +0000 UTC m=+233.587433132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle") pod "router-default-5698bdd995-q7cpq" (UID: "3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e") : configmap references non-existent config key: service-ca.crt Jun 09 00:02:55.629239 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:55.629215 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs podName:3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e nodeName:}" failed. No retries permitted until 2026-06-09 00:03:03.629205604 +0000 UTC m=+233.587473186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs") pod "router-default-5698bdd995-q7cpq" (UID: "3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e") : secret "router-metrics-certs-default" not found Jun 09 00:02:56.348044 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.348006 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-k6tjz"] Jun 09 00:02:56.352142 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.352119 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-k6tjz" Jun 09 00:02:56.354354 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.354330 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 00:02:56.354476 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.354329 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 00:02:56.354476 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.354446 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 00:02:56.355495 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.355477 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gmwxd\"" Jun 09 00:02:56.355597 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.355482 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 00:02:56.357876 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.357856 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-k6tjz"] Jun 09 00:02:56.383829 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.383800 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:56.435061 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.435034 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwmkz\" (UniqueName: \"kubernetes.io/projected/04125c4f-cd79-4be8-bf6b-d4810acc85fd-kube-api-access-dwmkz\") pod \"service-ca-7d74d578b8-k6tjz\" (UID: \"04125c4f-cd79-4be8-bf6b-d4810acc85fd\") " pod="openshift-service-ca/service-ca-7d74d578b8-k6tjz" Jun 09 00:02:56.435211 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.435089 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/04125c4f-cd79-4be8-bf6b-d4810acc85fd-signing-cabundle\") pod \"service-ca-7d74d578b8-k6tjz\" (UID: \"04125c4f-cd79-4be8-bf6b-d4810acc85fd\") " pod="openshift-service-ca/service-ca-7d74d578b8-k6tjz" Jun 09 00:02:56.435211 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.435197 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/04125c4f-cd79-4be8-bf6b-d4810acc85fd-signing-key\") pod \"service-ca-7d74d578b8-k6tjz\" (UID: \"04125c4f-cd79-4be8-bf6b-d4810acc85fd\") " pod="openshift-service-ca/service-ca-7d74d578b8-k6tjz" Jun 09 00:02:56.482500 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.482469 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:56.529314 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.529292 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r4ksj_3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e/dns-node-resolver/0.log" Jun 09 00:02:56.536013 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.535993 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/04125c4f-cd79-4be8-bf6b-d4810acc85fd-signing-key\") pod \"service-ca-7d74d578b8-k6tjz\" (UID: \"04125c4f-cd79-4be8-bf6b-d4810acc85fd\") " pod="openshift-service-ca/service-ca-7d74d578b8-k6tjz" Jun 09 00:02:56.536115 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.536053 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwmkz\" (UniqueName: \"kubernetes.io/projected/04125c4f-cd79-4be8-bf6b-d4810acc85fd-kube-api-access-dwmkz\") pod \"service-ca-7d74d578b8-k6tjz\" (UID: \"04125c4f-cd79-4be8-bf6b-d4810acc85fd\") " pod="openshift-service-ca/service-ca-7d74d578b8-k6tjz" Jun 09 00:02:56.536115 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.536080 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/04125c4f-cd79-4be8-bf6b-d4810acc85fd-signing-cabundle\") pod \"service-ca-7d74d578b8-k6tjz\" (UID: \"04125c4f-cd79-4be8-bf6b-d4810acc85fd\") " pod="openshift-service-ca/service-ca-7d74d578b8-k6tjz" Jun 09 00:02:56.536836 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.536771 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/04125c4f-cd79-4be8-bf6b-d4810acc85fd-signing-cabundle\") pod \"service-ca-7d74d578b8-k6tjz\" (UID: \"04125c4f-cd79-4be8-bf6b-d4810acc85fd\") " pod="openshift-service-ca/service-ca-7d74d578b8-k6tjz" Jun 09 00:02:56.538589 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.538558 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/04125c4f-cd79-4be8-bf6b-d4810acc85fd-signing-key\") pod \"service-ca-7d74d578b8-k6tjz\" (UID: \"04125c4f-cd79-4be8-bf6b-d4810acc85fd\") " pod="openshift-service-ca/service-ca-7d74d578b8-k6tjz" Jun 09 00:02:56.543578 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.543558 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwmkz\" (UniqueName: \"kubernetes.io/projected/04125c4f-cd79-4be8-bf6b-d4810acc85fd-kube-api-access-dwmkz\") pod \"service-ca-7d74d578b8-k6tjz\" (UID: \"04125c4f-cd79-4be8-bf6b-d4810acc85fd\") " pod="openshift-service-ca/service-ca-7d74d578b8-k6tjz" Jun 09 00:02:56.661188 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.661110 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-k6tjz" Jun 09 00:02:56.780004 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:56.779974 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-k6tjz"] Jun 09 00:02:56.782954 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:02:56.782930 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04125c4f_cd79_4be8_bf6b_d4810acc85fd.slice/crio-411d28a5783ef56f326c5d839dd095dd706fb58fdf817a64405b00379a35b961 WatchSource:0}: Error finding container 411d28a5783ef56f326c5d839dd095dd706fb58fdf817a64405b00379a35b961: Status 404 returned error can't find the container with id 411d28a5783ef56f326c5d839dd095dd706fb58fdf817a64405b00379a35b961 Jun 09 00:02:57.159697 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:57.159663 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:57.205412 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:57.205386 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-k6tjz" event={"ID":"04125c4f-cd79-4be8-bf6b-d4810acc85fd","Type":"ContainerStarted","Data":"95e4ef973215a2e6e0b85b5bbde4b134a46092272d58fc397c180a6df0645185"} Jun 09 00:02:57.205551 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:57.205429 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-k6tjz" event={"ID":"04125c4f-cd79-4be8-bf6b-d4810acc85fd","Type":"ContainerStarted","Data":"411d28a5783ef56f326c5d839dd095dd706fb58fdf817a64405b00379a35b961"} Jun 09 00:02:57.224579 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:57.224535 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-k6tjz" podStartSLOduration=1.224519996 podStartE2EDuration="1.224519996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:02:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:02:57.223945626 +0000 UTC m=+227.182213231" watchObservedRunningTime="2026-06-09 00:02:57.224519996 +0000 UTC m=+227.182787600" Jun 09 00:02:57.726177 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:57.726152 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6cn9v_3de9a184-ebf5-487a-b4c9-0f657559543b/node-ca/0.log" Jun 09 00:02:58.071626 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:58.071544 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:58.170671 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:58.170625 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:58.271290 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:58.271260 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:58.291231 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:58.291202 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:58.291369 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:58.291261 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:02:58.291611 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:58.291596 2573 scope.go:117] "RemoveContainer" containerID="79bb86bfbf0ea0146280e01c4b03dd39e8c89fa81817e26d49c908e3904dae58" Jun 09 00:02:58.291795 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:02:58.291777 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-hrzw9_openshift-console-operator(23e2ea38-cbb7-4a18-a6f3-858f73866c55)\"" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" podUID="23e2ea38-cbb7-4a18-a6f3-858f73866c55" Jun 09 00:02:58.395195 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:58.395126 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:58.557033 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:58.556997 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:58.742653 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:58.742615 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:58.925780 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:58.925733 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qjl4k_2eac10de-440f-4fb9-83f1-b8f24050fd42/serve-healthcheck-canary/0.log" Jun 09 00:02:59.528134 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:59.528108 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-g89kg_ed9bb569-7c77-4fe2-91e6-271914697329/kube-storage-version-migrator-operator/0.log" Jun 09 00:02:59.551470 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:59.551436 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:59.771418 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:59.771385 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:02:59.942413 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:02:59.942325 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:00.147394 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:00.147359 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:00.543472 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:00.543440 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:00.952404 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:00.952303 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:01.138544 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:01.138506 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:01.748817 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:01.748783 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:01.935825 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:01.935787 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:02.037064 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:02.036977 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:02.086787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:02.086749 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:02.143199 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:02.143171 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:02.543275 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:02.543245 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:02.596710 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:02.596676 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:03.074062 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:03.074034 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:03.342136 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:03.342056 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:03.542787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:03.542732 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:03.695514 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:03.695423 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:03:03.695514 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:03.695477 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:03:03.695768 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:03:03.695578 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle podName:3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e nodeName:}" failed. No retries permitted until 2026-06-09 00:03:19.695564649 +0000 UTC m=+249.653832230 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle") pod "router-default-5698bdd995-q7cpq" (UID: "3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e") : configmap references non-existent config key: service-ca.crt Jun 09 00:03:03.698069 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:03.698039 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-metrics-certs\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:03:03.943750 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:03.943697 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:04.142527 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:04.142494 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:04.543992 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:04.543952 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:04.644620 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:04.644585 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:05.141506 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:05.141469 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:05.542104 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:05.542069 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:05.945468 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:05.945386 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:06.341913 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:06.341879 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:06.742214 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:06.742175 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:06.891761 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:06.891705 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:06.991657 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:06.991619 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:07.348553 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:07.348523 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:08.144716 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:08.144676 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:08.341412 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:08.341365 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:08.545955 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:08.545924 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:08.739970 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:08.739936 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:10.527876 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:10.527849 2573 scope.go:117] "RemoveContainer" containerID="79bb86bfbf0ea0146280e01c4b03dd39e8c89fa81817e26d49c908e3904dae58" Jun 09 00:03:11.251470 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:11.251442 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/2.log" Jun 09 00:03:11.251817 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:11.251801 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/1.log" Jun 09 00:03:11.251926 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:11.251837 2573 generic.go:356] "Generic (PLEG): container finished" podID="23e2ea38-cbb7-4a18-a6f3-858f73866c55" containerID="7572843611aa43a23889654cff5d329b96a9873c499810131d49566ed605de5e" exitCode=255 Jun 09 00:03:11.251926 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:11.251911 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" event={"ID":"23e2ea38-cbb7-4a18-a6f3-858f73866c55","Type":"ContainerDied","Data":"7572843611aa43a23889654cff5d329b96a9873c499810131d49566ed605de5e"} Jun 09 00:03:11.252021 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:11.251990 2573 scope.go:117] "RemoveContainer" containerID="79bb86bfbf0ea0146280e01c4b03dd39e8c89fa81817e26d49c908e3904dae58" Jun 09 00:03:11.252348 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:11.252330 2573 scope.go:117] "RemoveContainer" containerID="7572843611aa43a23889654cff5d329b96a9873c499810131d49566ed605de5e" Jun 09 00:03:11.252526 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:03:11.252507 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-hrzw9_openshift-console-operator(23e2ea38-cbb7-4a18-a6f3-858f73866c55)\"" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" podUID="23e2ea38-cbb7-4a18-a6f3-858f73866c55" Jun 09 00:03:12.255778 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:12.255727 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/2.log" Jun 09 00:03:12.924335 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:12.924302 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:13.024699 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:13.024669 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:14.637713 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.637685 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nkszf"] Jun 09 00:03:14.643351 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.643332 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.645923 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.645903 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 00:03:14.646023 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.645906 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rvkn7\"" Jun 09 00:03:14.646891 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.646878 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 00:03:14.652832 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.652813 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nkszf"] Jun 09 00:03:14.775546 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.775510 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:14.780430 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.780409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq99f\" (UniqueName: \"kubernetes.io/projected/5893e69d-fed6-47d6-875e-02698ce882c5-kube-api-access-mq99f\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.780548 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.780474 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5893e69d-fed6-47d6-875e-02698ce882c5-data-volume\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.780548 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.780512 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5893e69d-fed6-47d6-875e-02698ce882c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.780548 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.780537 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5893e69d-fed6-47d6-875e-02698ce882c5-crio-socket\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.780659 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.780609 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5893e69d-fed6-47d6-875e-02698ce882c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.873922 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.873892 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:14.881811 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.881787 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5893e69d-fed6-47d6-875e-02698ce882c5-data-volume\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.881903 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.881826 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5893e69d-fed6-47d6-875e-02698ce882c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.881903 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.881854 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5893e69d-fed6-47d6-875e-02698ce882c5-crio-socket\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.881903 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.881882 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5893e69d-fed6-47d6-875e-02698ce882c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.882068 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.881932 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq99f\" (UniqueName: \"kubernetes.io/projected/5893e69d-fed6-47d6-875e-02698ce882c5-kube-api-access-mq99f\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.882068 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.881982 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5893e69d-fed6-47d6-875e-02698ce882c5-crio-socket\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.882217 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.882200 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5893e69d-fed6-47d6-875e-02698ce882c5-data-volume\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.882453 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.882436 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5893e69d-fed6-47d6-875e-02698ce882c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.884380 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.884362 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5893e69d-fed6-47d6-875e-02698ce882c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.891726 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.891676 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq99f\" (UniqueName: \"kubernetes.io/projected/5893e69d-fed6-47d6-875e-02698ce882c5-kube-api-access-mq99f\") pod \"insights-runtime-extractor-nkszf\" (UID: \"5893e69d-fed6-47d6-875e-02698ce882c5\") " pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:14.952049 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:14.952031 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nkszf" Jun 09 00:03:15.074531 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:15.074497 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nkszf"] Jun 09 00:03:15.078142 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:03:15.078110 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5893e69d_fed6_47d6_875e_02698ce882c5.slice/crio-1d0046ce5c606d9cebc13b62392a090f495b223048bee53229b09449330904fb WatchSource:0}: Error finding container 1d0046ce5c606d9cebc13b62392a090f495b223048bee53229b09449330904fb: Status 404 returned error can't find the container with id 1d0046ce5c606d9cebc13b62392a090f495b223048bee53229b09449330904fb Jun 09 00:03:15.265106 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:15.265078 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nkszf" event={"ID":"5893e69d-fed6-47d6-875e-02698ce882c5","Type":"ContainerStarted","Data":"73b2ab7e995cc1f60a7319cc0e93ca5d6f4be2ca6b1e90b79dddc6b69adc9b0f"} Jun 09 00:03:15.265238 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:15.265131 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nkszf" event={"ID":"5893e69d-fed6-47d6-875e-02698ce882c5","Type":"ContainerStarted","Data":"1d0046ce5c606d9cebc13b62392a090f495b223048bee53229b09449330904fb"} Jun 09 00:03:16.269540 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:16.269508 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nkszf" event={"ID":"5893e69d-fed6-47d6-875e-02698ce882c5","Type":"ContainerStarted","Data":"73b0e3e11eac869618e55181c03586832e35d741b73ae5242ea1a010e1b4e822"} Jun 09 00:03:18.278463 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:18.278428 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nkszf" event={"ID":"5893e69d-fed6-47d6-875e-02698ce882c5","Type":"ContainerStarted","Data":"c660b06dc9ef6156dc599312f9373f3e1d7bbe9e487112f9b0d46f030f0adff8"} Jun 09 00:03:18.291645 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:18.291627 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:03:18.291733 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:18.291665 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:03:18.291935 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:18.291923 2573 scope.go:117] "RemoveContainer" containerID="7572843611aa43a23889654cff5d329b96a9873c499810131d49566ed605de5e" Jun 09 00:03:18.292064 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:03:18.292049 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-hrzw9_openshift-console-operator(23e2ea38-cbb7-4a18-a6f3-858f73866c55)\"" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" podUID="23e2ea38-cbb7-4a18-a6f3-858f73866c55" Jun 09 00:03:18.294927 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:18.294882 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nkszf" podStartSLOduration=1.927615491 podStartE2EDuration="4.294867031s" totalImagesPullingTime="2.36725154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:03:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:18.293626759 +0000 UTC m=+248.251894384" watchObservedRunningTime="2026-06-09 00:03:18.294867031 +0000 UTC m=+248.253134636" Jun 09 00:03:19.717776 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:19.717727 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:03:19.718276 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:19.718258 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e-service-ca-bundle\") pod \"router-default-5698bdd995-q7cpq\" (UID: \"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e\") " pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:03:20.007529 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:20.007502 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zd2q5\"" Jun 09 00:03:20.015397 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:20.015375 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:03:20.171004 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:20.170972 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5698bdd995-q7cpq"] Jun 09 00:03:20.174237 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:03:20.174211 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3429dbd5_d4a7_4e7c_87dc_4b41e453ba5e.slice/crio-3cbb9bc0c6a60069760c9a38ae7e249fb7e0ea36d0825e66b0bad679094560e2 WatchSource:0}: Error finding container 3cbb9bc0c6a60069760c9a38ae7e249fb7e0ea36d0825e66b0bad679094560e2: Status 404 returned error can't find the container with id 3cbb9bc0c6a60069760c9a38ae7e249fb7e0ea36d0825e66b0bad679094560e2 Jun 09 00:03:20.287054 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:20.287028 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5698bdd995-q7cpq" event={"ID":"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e","Type":"ContainerStarted","Data":"3cbb9bc0c6a60069760c9a38ae7e249fb7e0ea36d0825e66b0bad679094560e2"} Jun 09 00:03:21.291927 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:21.291895 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5698bdd995-q7cpq" event={"ID":"3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e","Type":"ContainerStarted","Data":"4aef4c22f9df8ca9ca9b148f4462066fb3cfc7d3d4b9436b00f5707784084867"} Jun 09 00:03:21.310594 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:21.310552 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5698bdd995-q7cpq" podStartSLOduration=34.31053807 podStartE2EDuration="34.31053807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:02:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:21.309201635 +0000 UTC m=+251.267469239" watchObservedRunningTime="2026-06-09 00:03:21.31053807 +0000 UTC m=+251.268805673" Jun 09 00:03:21.505814 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:21.505785 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:21.606884 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:21.606800 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:21.657323 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:21.657287 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:22.015645 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.015616 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:03:22.018065 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.018045 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:03:22.295618 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.295544 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:03:22.296712 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.296690 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5698bdd995-q7cpq" Jun 09 00:03:22.333442 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.333412 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:22.337393 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.337370 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 09 00:03:22.340397 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.340364 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/314dabf5-096d-442a-9db1-83512bf87f66-metrics-certs\") pod \"network-metrics-daemon-tcxq6\" (UID: \"314dabf5-096d-442a-9db1-83512bf87f66\") " pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 09 00:03:22.430600 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.430571 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k7v6c\"" Jun 09 00:03:22.436061 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.436037 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:22.438870 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.438851 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxq6" Jun 09 00:03:22.497097 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.497054 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gwtfg"] Jun 09 00:03:22.497375 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.497349 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:22.499234 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.499213 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gwtfg" Jun 09 00:03:22.501529 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.501510 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 00:03:22.501609 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.501574 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nqlrf\"" Jun 09 00:03:22.507206 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.507184 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gwtfg"] Jun 09 00:03:22.565877 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.565796 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tcxq6"] Jun 09 00:03:22.568398 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.568371 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:22.568930 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:03:22.568905 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod314dabf5_096d_442a_9db1_83512bf87f66.slice/crio-17e70764518c35374b8efc82ec6a16dbb02ec167945e71fa8ea75c5319dea804 WatchSource:0}: Error finding container 17e70764518c35374b8efc82ec6a16dbb02ec167945e71fa8ea75c5319dea804: Status 404 returned error can't find the container with id 17e70764518c35374b8efc82ec6a16dbb02ec167945e71fa8ea75c5319dea804 Jun 09 00:03:22.640156 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.640129 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d4f1e2f4-1a8c-4b6d-93ee-2723a860800b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gwtfg\" (UID: \"d4f1e2f4-1a8c-4b6d-93ee-2723a860800b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gwtfg" Jun 09 00:03:22.740793 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.740765 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d4f1e2f4-1a8c-4b6d-93ee-2723a860800b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gwtfg\" (UID: \"d4f1e2f4-1a8c-4b6d-93ee-2723a860800b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gwtfg" Jun 09 00:03:22.743330 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.743301 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d4f1e2f4-1a8c-4b6d-93ee-2723a860800b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gwtfg\" (UID: \"d4f1e2f4-1a8c-4b6d-93ee-2723a860800b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gwtfg" Jun 09 00:03:22.810181 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.810156 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gwtfg" Jun 09 00:03:22.927297 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:22.927274 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gwtfg"] Jun 09 00:03:22.929498 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:03:22.929471 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f1e2f4_1a8c_4b6d_93ee_2723a860800b.slice/crio-55e3f865d13f7b56d76b6cd4656fb378f3e39e4917225bc9da9cc3d77f45506c WatchSource:0}: Error finding container 55e3f865d13f7b56d76b6cd4656fb378f3e39e4917225bc9da9cc3d77f45506c: Status 404 returned error can't find the container with id 55e3f865d13f7b56d76b6cd4656fb378f3e39e4917225bc9da9cc3d77f45506c Jun 09 00:03:23.299516 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:23.299483 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gwtfg" event={"ID":"d4f1e2f4-1a8c-4b6d-93ee-2723a860800b","Type":"ContainerStarted","Data":"55e3f865d13f7b56d76b6cd4656fb378f3e39e4917225bc9da9cc3d77f45506c"} Jun 09 00:03:23.300691 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:23.300664 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tcxq6" event={"ID":"314dabf5-096d-442a-9db1-83512bf87f66","Type":"ContainerStarted","Data":"17e70764518c35374b8efc82ec6a16dbb02ec167945e71fa8ea75c5319dea804"} Jun 09 00:03:24.305874 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.305798 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gwtfg" event={"ID":"d4f1e2f4-1a8c-4b6d-93ee-2723a860800b","Type":"ContainerStarted","Data":"67e8a4a0cf0cfcdacc7dacf14a8058909e0f92d682e56d24debe50dc3a4513b2"} Jun 09 00:03:24.305874 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.305861 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gwtfg" Jun 09 00:03:24.307706 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.307681 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tcxq6" event={"ID":"314dabf5-096d-442a-9db1-83512bf87f66","Type":"ContainerStarted","Data":"102146ea6b29abe34a7d39c923bb121a8d60b919fae905696d21d95f326b1c1e"} Jun 09 00:03:24.307856 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.307731 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tcxq6" event={"ID":"314dabf5-096d-442a-9db1-83512bf87f66","Type":"ContainerStarted","Data":"2b9e1fd773936cf49baa11301e136eebc9265cb676b3de188bdcde6d8f9889a3"} Jun 09 00:03:24.310790 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.310771 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gwtfg" Jun 09 00:03:24.320098 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.320061 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gwtfg" podStartSLOduration=1.163546196 podStartE2EDuration="2.320048368s" totalImagesPullingTime="1.156502172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:24.318864043 +0000 UTC m=+254.277131648" watchObservedRunningTime="2026-06-09 00:03:24.320048368 +0000 UTC m=+254.278315971" Jun 09 00:03:24.348490 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.348451 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tcxq6" podStartSLOduration=253.135122819 podStartE2EDuration="4m14.348437859s" totalImagesPullingTime="1.21331504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:24.347491205 +0000 UTC m=+254.305758810" watchObservedRunningTime="2026-06-09 00:03:24.348437859 +0000 UTC m=+254.306705463" Jun 09 00:03:24.452195 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.452170 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:24.554595 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.554565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:24.558044 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.557987 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k"] Jun 09 00:03:24.560534 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.560510 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" Jun 09 00:03:24.562898 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.562876 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 00:03:24.562898 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.562896 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 00:03:24.563065 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.562876 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 00:03:24.564029 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.564012 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 00:03:24.564101 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.564034 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vdldp\"" Jun 09 00:03:24.564152 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.564015 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 00:03:24.568761 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.568722 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k"] Jun 09 00:03:24.608238 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.608212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:24.658776 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.658734 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:24.757016 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.756987 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69qxp\" (UniqueName: \"kubernetes.io/projected/66de382a-aa45-45c4-b3cc-b3c6a9f60d86-kube-api-access-69qxp\") pod \"prometheus-operator-7f7d445d84-d7t5k\" (UID: \"66de382a-aa45-45c4-b3cc-b3c6a9f60d86\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" Jun 09 00:03:24.757108 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.757060 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66de382a-aa45-45c4-b3cc-b3c6a9f60d86-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-d7t5k\" (UID: \"66de382a-aa45-45c4-b3cc-b3c6a9f60d86\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" Jun 09 00:03:24.757108 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.757089 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/66de382a-aa45-45c4-b3cc-b3c6a9f60d86-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-d7t5k\" (UID: \"66de382a-aa45-45c4-b3cc-b3c6a9f60d86\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" Jun 09 00:03:24.757192 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.757119 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66de382a-aa45-45c4-b3cc-b3c6a9f60d86-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-d7t5k\" (UID: \"66de382a-aa45-45c4-b3cc-b3c6a9f60d86\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" Jun 09 00:03:24.858342 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.858285 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66de382a-aa45-45c4-b3cc-b3c6a9f60d86-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-d7t5k\" (UID: \"66de382a-aa45-45c4-b3cc-b3c6a9f60d86\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" Jun 09 00:03:24.858342 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.858310 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/66de382a-aa45-45c4-b3cc-b3c6a9f60d86-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-d7t5k\" (UID: \"66de382a-aa45-45c4-b3cc-b3c6a9f60d86\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" Jun 09 00:03:24.858342 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.858331 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66de382a-aa45-45c4-b3cc-b3c6a9f60d86-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-d7t5k\" (UID: \"66de382a-aa45-45c4-b3cc-b3c6a9f60d86\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" Jun 09 00:03:24.858535 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.858451 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69qxp\" (UniqueName: \"kubernetes.io/projected/66de382a-aa45-45c4-b3cc-b3c6a9f60d86-kube-api-access-69qxp\") pod \"prometheus-operator-7f7d445d84-d7t5k\" (UID: \"66de382a-aa45-45c4-b3cc-b3c6a9f60d86\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" Jun 09 00:03:24.859014 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.858996 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66de382a-aa45-45c4-b3cc-b3c6a9f60d86-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-d7t5k\" (UID: \"66de382a-aa45-45c4-b3cc-b3c6a9f60d86\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" Jun 09 00:03:24.860977 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.860960 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66de382a-aa45-45c4-b3cc-b3c6a9f60d86-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-d7t5k\" (UID: \"66de382a-aa45-45c4-b3cc-b3c6a9f60d86\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" Jun 09 00:03:24.861070 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.861054 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/66de382a-aa45-45c4-b3cc-b3c6a9f60d86-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-d7t5k\" (UID: \"66de382a-aa45-45c4-b3cc-b3c6a9f60d86\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" Jun 09 00:03:24.866403 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.866340 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69qxp\" (UniqueName: \"kubernetes.io/projected/66de382a-aa45-45c4-b3cc-b3c6a9f60d86-kube-api-access-69qxp\") pod \"prometheus-operator-7f7d445d84-d7t5k\" (UID: \"66de382a-aa45-45c4-b3cc-b3c6a9f60d86\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" Jun 09 00:03:24.870899 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.870880 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" Jun 09 00:03:24.994243 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:24.994214 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k"] Jun 09 00:03:24.996354 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:03:24.996329 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66de382a_aa45_45c4_b3cc_b3c6a9f60d86.slice/crio-a27619052ea26bd33128ee10b8cdf8592a6108f98dfe12db12d9e25823c019e2 WatchSource:0}: Error finding container a27619052ea26bd33128ee10b8cdf8592a6108f98dfe12db12d9e25823c019e2: Status 404 returned error can't find the container with id a27619052ea26bd33128ee10b8cdf8592a6108f98dfe12db12d9e25823c019e2 Jun 09 00:03:25.312561 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:25.312528 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" event={"ID":"66de382a-aa45-45c4-b3cc-b3c6a9f60d86","Type":"ContainerStarted","Data":"a27619052ea26bd33128ee10b8cdf8592a6108f98dfe12db12d9e25823c019e2"} Jun 09 00:03:25.538337 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:25.538301 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:25.593495 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:25.593421 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:26.813371 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:26.813287 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:27.320893 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:27.320859 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" event={"ID":"66de382a-aa45-45c4-b3cc-b3c6a9f60d86","Type":"ContainerStarted","Data":"e98b9dd2e5ac6cbe3fb564681f2002063c3ef8f173c2f6e997d4448eb9a7e5fe"} Jun 09 00:03:27.321057 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:27.320911 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" event={"ID":"66de382a-aa45-45c4-b3cc-b3c6a9f60d86","Type":"ContainerStarted","Data":"577aed9dd9c2b4c6056e03f3fce2af8c0e2ccaba5bd42b5fa1210e657b36c19c"} Jun 09 00:03:27.336931 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:27.336883 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-d7t5k" podStartSLOduration=1.7772036660000001 podStartE2EDuration="3.336865328s" totalImagesPullingTime="1.559661662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:03:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:27.335302265 +0000 UTC m=+257.293569880" watchObservedRunningTime="2026-06-09 00:03:27.336865328 +0000 UTC m=+257.295132932" Jun 09 00:03:28.656317 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.656282 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:28.880847 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.880792 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:28.893355 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.893325 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7"] Jun 09 00:03:28.897131 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.897112 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:28.899765 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.899726 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 00:03:28.899881 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.899761 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dz5wl\"" Jun 09 00:03:28.899881 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.899859 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 00:03:28.906298 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.906271 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7"] Jun 09 00:03:28.934253 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.934187 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r54vt"] Jun 09 00:03:28.937616 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.937599 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:28.939900 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.939879 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g5hh8\"" Jun 09 00:03:28.940064 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.940042 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 00:03:28.940177 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.940151 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 00:03:28.940234 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.940175 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 00:03:28.960277 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.960254 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:28.993374 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.993347 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-metrics-client-ca\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:28.993480 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.993383 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82390fe9-ff3f-4e43-83a7-fd4177de8788-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-jjvt7\" (UID: \"82390fe9-ff3f-4e43-83a7-fd4177de8788\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:28.993480 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.993422 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-root\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:28.993480 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.993469 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-textfile\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:28.993626 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.993512 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8b4x\" (UniqueName: \"kubernetes.io/projected/82390fe9-ff3f-4e43-83a7-fd4177de8788-kube-api-access-w8b4x\") pod \"openshift-state-metrics-65f78d5c66-jjvt7\" (UID: \"82390fe9-ff3f-4e43-83a7-fd4177de8788\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:28.993626 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.993545 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82390fe9-ff3f-4e43-83a7-fd4177de8788-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-jjvt7\" (UID: \"82390fe9-ff3f-4e43-83a7-fd4177de8788\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:28.993626 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.993617 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-wtmp\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:28.993790 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.993642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82390fe9-ff3f-4e43-83a7-fd4177de8788-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-jjvt7\" (UID: \"82390fe9-ff3f-4e43-83a7-fd4177de8788\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:28.993790 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.993679 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:28.993790 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.993703 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-accelerators-collector-config\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:28.993790 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.993754 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-sys\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:28.993790 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.993777 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-tls\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:28.994025 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:28.993805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9sr7\" (UniqueName: \"kubernetes.io/projected/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-kube-api-access-p9sr7\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.020271 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.020249 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:29.094450 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.094419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8b4x\" (UniqueName: \"kubernetes.io/projected/82390fe9-ff3f-4e43-83a7-fd4177de8788-kube-api-access-w8b4x\") pod \"openshift-state-metrics-65f78d5c66-jjvt7\" (UID: \"82390fe9-ff3f-4e43-83a7-fd4177de8788\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:29.094598 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.094467 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82390fe9-ff3f-4e43-83a7-fd4177de8788-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-jjvt7\" (UID: \"82390fe9-ff3f-4e43-83a7-fd4177de8788\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:29.094598 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.094536 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-wtmp\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.094598 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.094561 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82390fe9-ff3f-4e43-83a7-fd4177de8788-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-jjvt7\" (UID: \"82390fe9-ff3f-4e43-83a7-fd4177de8788\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:29.094598 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.094590 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.094809 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.094615 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-accelerators-collector-config\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.094809 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.094645 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-sys\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.094809 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:03:29.094652 2573 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 00:03:29.094809 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.094668 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-tls\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.094809 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.094695 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9sr7\" (UniqueName: \"kubernetes.io/projected/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-kube-api-access-p9sr7\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.094809 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:03:29.094718 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82390fe9-ff3f-4e43-83a7-fd4177de8788-openshift-state-metrics-tls podName:82390fe9-ff3f-4e43-83a7-fd4177de8788 nodeName:}" failed. No retries permitted until 2026-06-09 00:03:29.59469886 +0000 UTC m=+259.552966454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/82390fe9-ff3f-4e43-83a7-fd4177de8788-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-jjvt7" (UID: "82390fe9-ff3f-4e43-83a7-fd4177de8788") : secret "openshift-state-metrics-tls" not found Jun 09 00:03:29.094809 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.094789 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-metrics-client-ca\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.095112 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.095003 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-wtmp\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.095424 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.095389 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-sys\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.095507 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.095482 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82390fe9-ff3f-4e43-83a7-fd4177de8788-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-jjvt7\" (UID: \"82390fe9-ff3f-4e43-83a7-fd4177de8788\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:29.095507 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.095489 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-metrics-client-ca\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.095620 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.095510 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-accelerators-collector-config\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.095620 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.095544 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-root\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.095620 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.095571 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-textfile\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.095793 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.095651 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-root\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.095924 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.095900 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-textfile\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.096227 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.096137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82390fe9-ff3f-4e43-83a7-fd4177de8788-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-jjvt7\" (UID: \"82390fe9-ff3f-4e43-83a7-fd4177de8788\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:29.098156 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.098128 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82390fe9-ff3f-4e43-83a7-fd4177de8788-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-jjvt7\" (UID: \"82390fe9-ff3f-4e43-83a7-fd4177de8788\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:29.098413 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.098388 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.098693 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.098672 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-node-exporter-tls\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.102641 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.102619 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8b4x\" (UniqueName: \"kubernetes.io/projected/82390fe9-ff3f-4e43-83a7-fd4177de8788-kube-api-access-w8b4x\") pod \"openshift-state-metrics-65f78d5c66-jjvt7\" (UID: \"82390fe9-ff3f-4e43-83a7-fd4177de8788\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:29.103116 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.103090 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9sr7\" (UniqueName: \"kubernetes.io/projected/0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3-kube-api-access-p9sr7\") pod \"node-exporter-r54vt\" (UID: \"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3\") " pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.122315 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.122290 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:29.223364 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.223337 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:29.248938 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.248910 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r54vt" Jun 09 00:03:29.261773 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:03:29.261729 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bab9443_ae84_4ee1_8aaa_f87b43c5dbd3.slice/crio-1f1517bcabd7438247a48f56e22a491ba990fbbf3546f241e7e148d9b4ce81f1 WatchSource:0}: Error finding container 1f1517bcabd7438247a48f56e22a491ba990fbbf3546f241e7e148d9b4ce81f1: Status 404 returned error can't find the container with id 1f1517bcabd7438247a48f56e22a491ba990fbbf3546f241e7e148d9b4ce81f1 Jun 09 00:03:29.321039 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.320983 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:29.328918 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.328889 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r54vt" event={"ID":"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3","Type":"ContainerStarted","Data":"1f1517bcabd7438247a48f56e22a491ba990fbbf3546f241e7e148d9b4ce81f1"} Jun 09 00:03:29.420745 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.420715 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:29.598536 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.598471 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82390fe9-ff3f-4e43-83a7-fd4177de8788-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-jjvt7\" (UID: \"82390fe9-ff3f-4e43-83a7-fd4177de8788\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:29.598665 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:03:29.598607 2573 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 00:03:29.598719 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:03:29.598662 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82390fe9-ff3f-4e43-83a7-fd4177de8788-openshift-state-metrics-tls podName:82390fe9-ff3f-4e43-83a7-fd4177de8788 nodeName:}" failed. No retries permitted until 2026-06-09 00:03:30.598647452 +0000 UTC m=+260.556915037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/82390fe9-ff3f-4e43-83a7-fd4177de8788-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-jjvt7" (UID: "82390fe9-ff3f-4e43-83a7-fd4177de8788") : secret "openshift-state-metrics-tls" not found Jun 09 00:03:29.733769 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.733717 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:29.883513 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.883404 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:29.967540 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:29.967503 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:30.089393 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:30.089034 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:30.184379 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:30.184244 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:30.607268 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:30.607219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82390fe9-ff3f-4e43-83a7-fd4177de8788-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-jjvt7\" (UID: \"82390fe9-ff3f-4e43-83a7-fd4177de8788\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:30.609673 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:30.609642 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82390fe9-ff3f-4e43-83a7-fd4177de8788-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-jjvt7\" (UID: \"82390fe9-ff3f-4e43-83a7-fd4177de8788\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:30.708953 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:30.708927 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" Jun 09 00:03:30.836366 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:30.836336 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7"] Jun 09 00:03:30.839303 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:03:30.839278 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82390fe9_ff3f_4e43_83a7_fd4177de8788.slice/crio-7d21a303c29fd15ce327cedb23951945eaa7836b950d80f339744afbda3a5eb6 WatchSource:0}: Error finding container 7d21a303c29fd15ce327cedb23951945eaa7836b950d80f339744afbda3a5eb6: Status 404 returned error can't find the container with id 7d21a303c29fd15ce327cedb23951945eaa7836b950d80f339744afbda3a5eb6 Jun 09 00:03:31.337486 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:31.337453 2573 generic.go:356] "Generic (PLEG): container finished" podID="0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3" containerID="77b4f2d9b5f5d37c46891e5f8930cfcca075b6efa6468c42cbcbf48939a710d2" exitCode=0 Jun 09 00:03:31.337650 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:31.337530 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r54vt" event={"ID":"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3","Type":"ContainerDied","Data":"77b4f2d9b5f5d37c46891e5f8930cfcca075b6efa6468c42cbcbf48939a710d2"} Jun 09 00:03:31.339474 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:31.339451 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" event={"ID":"82390fe9-ff3f-4e43-83a7-fd4177de8788","Type":"ContainerStarted","Data":"2bb16ce971516905f7ebc3712adcda9fc2cbe372cef7595591bb34cece77886f"} Jun 09 00:03:31.339556 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:31.339504 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" event={"ID":"82390fe9-ff3f-4e43-83a7-fd4177de8788","Type":"ContainerStarted","Data":"997d0524057cc6f959427e84b335d71d97e45458593594843f417b2131fc0902"} Jun 09 00:03:31.339556 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:31.339523 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" event={"ID":"82390fe9-ff3f-4e43-83a7-fd4177de8788","Type":"ContainerStarted","Data":"7d21a303c29fd15ce327cedb23951945eaa7836b950d80f339744afbda3a5eb6"} Jun 09 00:03:31.824913 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:31.824864 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:31.925253 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:31.925218 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:32.000287 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:32.000260 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:32.133173 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:32.133094 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:32.345285 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:32.345250 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" event={"ID":"82390fe9-ff3f-4e43-83a7-fd4177de8788","Type":"ContainerStarted","Data":"d7c7561ee2a6917f8bdc8c2bc2779232824e686dc9b2057b7b0275cd8666b425"} Jun 09 00:03:32.347305 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:32.347284 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r54vt" event={"ID":"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3","Type":"ContainerStarted","Data":"c3fd4d3464d5315e6f5e259b782f04ceb3d0ddfce65d45119dac24902cb72189"} Jun 09 00:03:32.347434 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:32.347320 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r54vt" event={"ID":"0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3","Type":"ContainerStarted","Data":"3b818292218b81a4707a5ebcce3bd00efe228b6d65614ed5ddd07d9e734b8854"} Jun 09 00:03:32.360919 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:32.360874 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jjvt7" podStartSLOduration=3.327791628 podStartE2EDuration="4.360858702s" totalImagesPullingTime="1.033067074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:32.359688215 +0000 UTC m=+262.317955819" watchObservedRunningTime="2026-06-09 00:03:32.360858702 +0000 UTC m=+262.319126307" Jun 09 00:03:32.376499 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:32.376464 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r54vt" podStartSLOduration=3.246871723 podStartE2EDuration="4.376451205s" totalImagesPullingTime="1.059199166s" totalInitContainerRuntime="70.380316ms" isStatefulPod=true podCreationTimestamp="2026-06-09 00:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:32.375081646 +0000 UTC m=+262.333349249" watchObservedRunningTime="2026-06-09 00:03:32.376451205 +0000 UTC m=+262.334718809" Jun 09 00:03:32.526362 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:32.526338 2573 scope.go:117] "RemoveContainer" containerID="7572843611aa43a23889654cff5d329b96a9873c499810131d49566ed605de5e" Jun 09 00:03:33.290606 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.290566 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-jf6pl"] Jun 09 00:03:33.293973 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.293946 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-jf6pl" Jun 09 00:03:33.296290 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.296266 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 00:03:33.296533 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.296511 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 00:03:33.296642 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.296612 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-frqzw\"" Jun 09 00:03:33.306404 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.306381 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-jf6pl"] Jun 09 00:03:33.311053 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.311018 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:33.332045 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.332016 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w8p9\" (UniqueName: \"kubernetes.io/projected/0fb0b7bc-1c28-4aa6-868c-ac54c7ec608a-kube-api-access-9w8p9\") pod \"downloads-6657875f97-jf6pl\" (UID: \"0fb0b7bc-1c28-4aa6-868c-ac54c7ec608a\") " pod="openshift-console/downloads-6657875f97-jf6pl" Jun 09 00:03:33.353906 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.353886 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/2.log" Jun 09 00:03:33.354030 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.353997 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" event={"ID":"23e2ea38-cbb7-4a18-a6f3-858f73866c55","Type":"ContainerStarted","Data":"40eebed486ab4e03ab362615efcf6c9bfb8ecf8e5d47957f8634bb95f49c7497"} Jun 09 00:03:33.354635 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.354611 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:03:33.359049 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.359030 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" Jun 09 00:03:33.372803 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.372779 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:33.375923 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.375887 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-hrzw9" podStartSLOduration=42.449679802 podStartE2EDuration="46.375874542s" totalImagesPullingTime="3.92619474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:33.375082112 +0000 UTC m=+263.333349717" watchObservedRunningTime="2026-06-09 00:03:33.375874542 +0000 UTC m=+263.334142159" Jun 09 00:03:33.428005 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.427973 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:33.433368 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.433343 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w8p9\" (UniqueName: \"kubernetes.io/projected/0fb0b7bc-1c28-4aa6-868c-ac54c7ec608a-kube-api-access-9w8p9\") pod \"downloads-6657875f97-jf6pl\" (UID: \"0fb0b7bc-1c28-4aa6-868c-ac54c7ec608a\") " pod="openshift-console/downloads-6657875f97-jf6pl" Jun 09 00:03:33.440942 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.440921 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w8p9\" (UniqueName: \"kubernetes.io/projected/0fb0b7bc-1c28-4aa6-868c-ac54c7ec608a-kube-api-access-9w8p9\") pod \"downloads-6657875f97-jf6pl\" (UID: \"0fb0b7bc-1c28-4aa6-868c-ac54c7ec608a\") " pod="openshift-console/downloads-6657875f97-jf6pl" Jun 09 00:03:33.587625 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.587526 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:33.603434 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.603411 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-jf6pl" Jun 09 00:03:33.677786 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.677754 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd"] Jun 09 00:03:33.681965 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.681942 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd" Jun 09 00:03:33.684265 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.684240 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 00:03:33.684265 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.684262 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b5zhs\"" Jun 09 00:03:33.692455 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.692434 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:33.692848 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.692705 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd"] Jun 09 00:03:33.738038 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.738008 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8916f13-b757-4cec-a113-2d911ab93e82-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-l6vjd\" (UID: \"e8916f13-b757-4cec-a113-2d911ab93e82\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd" Jun 09 00:03:33.738184 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.738055 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j46x7\" (UniqueName: \"kubernetes.io/projected/e8916f13-b757-4cec-a113-2d911ab93e82-kube-api-access-j46x7\") pod \"monitoring-plugin-76b68cc874-l6vjd\" (UID: \"e8916f13-b757-4cec-a113-2d911ab93e82\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd" Jun 09 00:03:33.750371 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.750349 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-jf6pl"] Jun 09 00:03:33.753347 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:03:33.753317 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb0b7bc_1c28_4aa6_868c_ac54c7ec608a.slice/crio-f5c64e3862402da0bbbee43aa9415beab62a9a8fb320e86b0f50989b3142c4a0 WatchSource:0}: Error finding container f5c64e3862402da0bbbee43aa9415beab62a9a8fb320e86b0f50989b3142c4a0: Status 404 returned error can't find the container with id f5c64e3862402da0bbbee43aa9415beab62a9a8fb320e86b0f50989b3142c4a0 Jun 09 00:03:33.785295 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.785267 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:33.833470 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.833447 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:33.838427 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.838382 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8916f13-b757-4cec-a113-2d911ab93e82-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-l6vjd\" (UID: \"e8916f13-b757-4cec-a113-2d911ab93e82\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd" Jun 09 00:03:33.838427 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.838413 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j46x7\" (UniqueName: \"kubernetes.io/projected/e8916f13-b757-4cec-a113-2d911ab93e82-kube-api-access-j46x7\") pod \"monitoring-plugin-76b68cc874-l6vjd\" (UID: \"e8916f13-b757-4cec-a113-2d911ab93e82\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd" Jun 09 00:03:33.838538 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:03:33.838525 2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 09 00:03:33.838596 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:03:33.838584 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8916f13-b757-4cec-a113-2d911ab93e82-monitoring-plugin-cert podName:e8916f13-b757-4cec-a113-2d911ab93e82 nodeName:}" failed. No retries permitted until 2026-06-09 00:03:34.33856706 +0000 UTC m=+264.296834641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e8916f13-b757-4cec-a113-2d911ab93e82-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-l6vjd" (UID: "e8916f13-b757-4cec-a113-2d911ab93e82") : secret "monitoring-plugin-cert" not found Jun 09 00:03:33.846628 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.846598 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j46x7\" (UniqueName: \"kubernetes.io/projected/e8916f13-b757-4cec-a113-2d911ab93e82-kube-api-access-j46x7\") pod \"monitoring-plugin-76b68cc874-l6vjd\" (UID: \"e8916f13-b757-4cec-a113-2d911ab93e82\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd" Jun 09 00:03:33.962358 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:33.962325 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:34.014249 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:34.014222 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:34.343502 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:34.343470 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8916f13-b757-4cec-a113-2d911ab93e82-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-l6vjd\" (UID: \"e8916f13-b757-4cec-a113-2d911ab93e82\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd" Jun 09 00:03:34.346084 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:34.346059 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8916f13-b757-4cec-a113-2d911ab93e82-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-l6vjd\" (UID: \"e8916f13-b757-4cec-a113-2d911ab93e82\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd" Jun 09 00:03:34.358714 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:34.358686 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-jf6pl" event={"ID":"0fb0b7bc-1c28-4aa6-868c-ac54c7ec608a","Type":"ContainerStarted","Data":"f5c64e3862402da0bbbee43aa9415beab62a9a8fb320e86b0f50989b3142c4a0"} Jun 09 00:03:34.374495 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:34.374473 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:34.475181 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:34.475153 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:34.594731 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:34.594663 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd" Jun 09 00:03:34.595216 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:34.595195 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:34.700856 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:34.700806 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:34.732426 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:34.732369 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd"] Jun 09 00:03:34.734790 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:03:34.734768 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8916f13_b757_4cec_a113_2d911ab93e82.slice/crio-091cbbbec2de20f4a15621266933f6a42251b83c4ad5852b61f67125b878dadf WatchSource:0}: Error finding container 091cbbbec2de20f4a15621266933f6a42251b83c4ad5852b61f67125b878dadf: Status 404 returned error can't find the container with id 091cbbbec2de20f4a15621266933f6a42251b83c4ad5852b61f67125b878dadf Jun 09 00:03:34.797491 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:34.797454 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:35.001947 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.001913 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:35.102631 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.102589 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:35.104654 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.104631 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 00:03:35.110449 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.110421 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.113240 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.113217 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 00:03:35.113473 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.113299 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 00:03:35.113602 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.113315 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 00:03:35.113663 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.113313 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 00:03:35.113716 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.113486 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 00:03:35.113787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.113486 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 00:03:35.113843 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.113530 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 00:03:35.114325 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.114305 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 00:03:35.114434 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.114409 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vjp77\"" Jun 09 00:03:35.114434 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.114426 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ljj6go5mmumv\"" Jun 09 00:03:35.114617 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.114473 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 00:03:35.114617 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.114323 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 00:03:35.114617 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.114329 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 00:03:35.115024 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.114885 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 00:03:35.115024 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.114902 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 00:03:35.115024 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.114884 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 00:03:35.117417 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.117398 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 00:03:35.124939 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.124247 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 00:03:35.154030 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.153799 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154030 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.153849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154030 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.153877 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154030 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.153913 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154030 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.153937 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl8hc\" (UniqueName: \"kubernetes.io/projected/60997e5b-c080-4d22-a963-f90b26b5da53-kube-api-access-cl8hc\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154030 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.153979 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60997e5b-c080-4d22-a963-f90b26b5da53-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154030 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.154002 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154030 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.154025 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154504 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.154050 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-web-config\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154504 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.154073 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154504 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.154108 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154504 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.154162 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60997e5b-c080-4d22-a963-f90b26b5da53-config-out\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154504 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.154248 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-config\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154504 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.154308 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154504 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.154352 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154504 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.154390 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154504 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.154425 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154504 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.154447 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154504 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.154491 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.154967 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.154534 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.214679 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.214641 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:35.255195 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255119 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.255195 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255162 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.255195 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255179 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.255195 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255197 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.255484 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255216 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.255484 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255232 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl8hc\" (UniqueName: \"kubernetes.io/projected/60997e5b-c080-4d22-a963-f90b26b5da53-kube-api-access-cl8hc\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.255484 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255272 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60997e5b-c080-4d22-a963-f90b26b5da53-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.255484 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255296 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.255484 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255319 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.255484 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255346 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-web-config\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.255484 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255370 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.255484 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255398 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.255484 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60997e5b-c080-4d22-a963-f90b26b5da53-config-out\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.255484 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255449 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-config\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.255484 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255476 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.256062 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255502 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.256062 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255529 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.256062 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255557 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.256062 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255595 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.256062 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.256062 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.255938 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.256324 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.256076 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.256324 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.256229 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.256963 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.256932 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.257221 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.257194 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.257351 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.257338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.259394 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.259352 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.259613 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.259566 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.259613 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.259602 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.259986 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.259964 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60997e5b-c080-4d22-a963-f90b26b5da53-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.260776 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.260094 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.260776 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.260590 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.260776 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.260650 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.261171 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.261145 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.261607 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.261445 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-web-config\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.261607 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.261576 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-config\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.262423 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.262005 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.262423 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.262386 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.262733 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.262708 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60997e5b-c080-4d22-a963-f90b26b5da53-config-out\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.264306 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.264102 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl8hc\" (UniqueName: \"kubernetes.io/projected/60997e5b-c080-4d22-a963-f90b26b5da53-kube-api-access-cl8hc\") pod \"prometheus-k8s-0\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.366366 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.366293 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd" event={"ID":"e8916f13-b757-4cec-a113-2d911ab93e82","Type":"ContainerStarted","Data":"091cbbbec2de20f4a15621266933f6a42251b83c4ad5852b61f67125b878dadf"} Jun 09 00:03:35.426192 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.426150 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:35.598221 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:35.598198 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 00:03:35.599958 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:03:35.599931 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60997e5b_c080_4d22_a963_f90b26b5da53.slice/crio-d65f7a821f18c06f74c09b741b9f0723e134b1f007613e0d38b1a097802f2bd7 WatchSource:0}: Error finding container d65f7a821f18c06f74c09b741b9f0723e134b1f007613e0d38b1a097802f2bd7: Status 404 returned error can't find the container with id d65f7a821f18c06f74c09b741b9f0723e134b1f007613e0d38b1a097802f2bd7 Jun 09 00:03:36.371770 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:36.371722 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerStarted","Data":"d65f7a821f18c06f74c09b741b9f0723e134b1f007613e0d38b1a097802f2bd7"} Jun 09 00:03:36.660964 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:36.660879 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:37.377236 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:37.377200 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd" event={"ID":"e8916f13-b757-4cec-a113-2d911ab93e82","Type":"ContainerStarted","Data":"44623ef619086159ac13a00b5495dd6345e95f39cd6fd33a7159cb25fc9dad9f"} Jun 09 00:03:37.377698 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:37.377265 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd" Jun 09 00:03:37.378718 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:37.378692 2573 generic.go:356] "Generic (PLEG): container finished" podID="60997e5b-c080-4d22-a963-f90b26b5da53" containerID="829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946" exitCode=0 Jun 09 00:03:37.378933 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:37.378787 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerDied","Data":"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946"} Jun 09 00:03:37.382694 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:37.382673 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd" Jun 09 00:03:37.391794 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:37.391759 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-l6vjd" podStartSLOduration=2.388783838 podStartE2EDuration="4.391729205s" totalImagesPullingTime="2.002945367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:03:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:37.390137674 +0000 UTC m=+267.348405272" watchObservedRunningTime="2026-06-09 00:03:37.391729205 +0000 UTC m=+267.349996856" Jun 09 00:03:41.402181 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:41.402141 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerStarted","Data":"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453"} Jun 09 00:03:41.402554 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:41.402219 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerStarted","Data":"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b"} Jun 09 00:03:43.423729 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:43.423684 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerStarted","Data":"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14"} Jun 09 00:03:43.424116 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:43.423799 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerStarted","Data":"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57"} Jun 09 00:03:43.424116 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:43.423842 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerStarted","Data":"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3"} Jun 09 00:03:43.424116 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:43.423879 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerStarted","Data":"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d"} Jun 09 00:03:43.451183 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:43.451134 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.775964581 podStartE2EDuration="8.451111945s" totalImagesPullingTime="6.652752494s" totalInitContainerRuntime="22.39487ms" isStatefulPod=false podCreationTimestamp="2026-06-09 00:03:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:43.449640925 +0000 UTC m=+273.407908566" watchObservedRunningTime="2026-06-09 00:03:43.451111945 +0000 UTC m=+273.409379548" Jun 09 00:03:45.427078 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:45.427044 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:03:50.195901 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:50.195852 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:50.247376 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:50.247336 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:52.018165 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:03:52.018125 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" podUID="dba8bef0-1813-4dd2-802b-0db068169b98" Jun 09 00:03:52.018165 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:03:52.018126 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4ch68" podUID="7ab4dd6e-79b1-4298-b7a8-d77b6f985b82" Jun 09 00:03:52.095052 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:52.095010 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:52.196787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:52.196724 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:52.459884 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:52.459807 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4ch68" Jun 09 00:03:52.460029 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:52.459808 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 09 00:03:54.203902 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:54.203869 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:54.251312 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:54.251277 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:03:55.346336 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:55.346299 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 09 00:03:55.346923 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:55.346353 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 09 00:03:55.349259 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:55.349230 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4dd6e-79b1-4298-b7a8-d77b6f985b82-metrics-tls\") pod \"dns-default-4ch68\" (UID: \"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82\") " pod="openshift-dns/dns-default-4ch68" Jun 09 00:03:55.349408 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:55.349386 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls\") pod \"image-registry-59f4f5cff8-kq5cp\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 09 00:03:55.464028 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:55.463992 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cw7xv\"" Jun 09 00:03:55.464203 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:55.463992 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cn964\"" Jun 09 00:03:55.471628 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:55.471594 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 09 00:03:55.471773 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:03:55.471709 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4ch68" Jun 09 00:04:00.011197 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:00.011133 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4ch68"] Jun 09 00:04:00.012842 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:00.012812 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:00.014007 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:04:00.013977 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab4dd6e_79b1_4298_b7a8_d77b6f985b82.slice/crio-86ac6184c06ee2b144289aab83f2d54e831cb5c51b1525a51a54e7498c23bf53 WatchSource:0}: Error finding container 86ac6184c06ee2b144289aab83f2d54e831cb5c51b1525a51a54e7498c23bf53: Status 404 returned error can't find the container with id 86ac6184c06ee2b144289aab83f2d54e831cb5c51b1525a51a54e7498c23bf53 Jun 09 00:04:00.030555 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:00.030527 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f4f5cff8-kq5cp"] Jun 09 00:04:00.049008 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:04:00.048967 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba8bef0_1813_4dd2_802b_0db068169b98.slice/crio-6c675e06bacf81acc9573e488e7edd79534cea08d72fac2368f9bbb9f9221ca3 WatchSource:0}: Error finding container 6c675e06bacf81acc9573e488e7edd79534cea08d72fac2368f9bbb9f9221ca3: Status 404 returned error can't find the container with id 6c675e06bacf81acc9573e488e7edd79534cea08d72fac2368f9bbb9f9221ca3 Jun 09 00:04:00.499955 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:00.499878 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4ch68" event={"ID":"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82","Type":"ContainerStarted","Data":"86ac6184c06ee2b144289aab83f2d54e831cb5c51b1525a51a54e7498c23bf53"} Jun 09 00:04:00.502284 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:00.502245 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" event={"ID":"dba8bef0-1813-4dd2-802b-0db068169b98","Type":"ContainerStarted","Data":"9224700be1f89ae1298d8b29cb9446e93878fb4f9ccdbae65e80c54347b93bd9"} Jun 09 00:04:00.502424 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:00.502309 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" event={"ID":"dba8bef0-1813-4dd2-802b-0db068169b98","Type":"ContainerStarted","Data":"6c675e06bacf81acc9573e488e7edd79534cea08d72fac2368f9bbb9f9221ca3"} Jun 09 00:04:00.502664 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:00.502645 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 09 00:04:00.505572 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:00.505547 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-jf6pl" event={"ID":"0fb0b7bc-1c28-4aa6-868c-ac54c7ec608a","Type":"ContainerStarted","Data":"86e92f3f59330da98a980616b4592bbb5730866cf8459744d6e1b299c1b04074"} Jun 09 00:04:00.506204 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:00.506180 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-jf6pl" Jun 09 00:04:00.512442 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:00.512399 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-jf6pl" Jun 09 00:04:00.523286 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:00.523228 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" podStartSLOduration=289.52320955 podStartE2EDuration="4m49.52320955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:04:00.520706344 +0000 UTC m=+290.478973953" watchObservedRunningTime="2026-06-09 00:04:00.52320955 +0000 UTC m=+290.481477155" Jun 09 00:04:00.543793 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:00.543641 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-jf6pl" podStartSLOduration=1.309154138 podStartE2EDuration="27.543622224s" totalImagesPullingTime="26.234468086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:03:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:04:00.538799772 +0000 UTC m=+290.497067401" watchObservedRunningTime="2026-06-09 00:04:00.543622224 +0000 UTC m=+290.501889823" Jun 09 00:04:02.008471 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:02.008432 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:02.058292 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:02.058260 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:02.519498 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:02.519468 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4ch68" event={"ID":"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82","Type":"ContainerStarted","Data":"493ee1172a63c9b4c36df7539e4e8357eb3a33235a4ce66af58bc38671f53a5b"} Jun 09 00:04:03.528487 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:03.528452 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4ch68" event={"ID":"7ab4dd6e-79b1-4298-b7a8-d77b6f985b82","Type":"ContainerStarted","Data":"d4007674c894984bb4bec6d4e195969d0a32cf71e7895670d8434a4d1467a53a"} Jun 09 00:04:03.529012 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:03.528713 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4ch68" Jun 09 00:04:03.545734 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:03.545679 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4ch68" podStartSLOduration=256.248276153 podStartE2EDuration="4m18.545660481s" totalImagesPullingTime="2.297384328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:04:03.543123563 +0000 UTC m=+293.501391168" watchObservedRunningTime="2026-06-09 00:04:03.545660481 +0000 UTC m=+293.503928090" Jun 09 00:04:08.553984 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:08.553947 2573 generic.go:356] "Generic (PLEG): container finished" podID="97475d09-d6f9-4643-888f-2b941dcebba9" containerID="415b700d9ad148a9db98492e21c3379d75407f6c7c17fa608917204d846696af" exitCode=0 Jun 09 00:04:08.554418 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:08.554021 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-h26mm" event={"ID":"97475d09-d6f9-4643-888f-2b941dcebba9","Type":"ContainerDied","Data":"415b700d9ad148a9db98492e21c3379d75407f6c7c17fa608917204d846696af"} Jun 09 00:04:08.554418 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:08.554383 2573 scope.go:117] "RemoveContainer" containerID="415b700d9ad148a9db98492e21c3379d75407f6c7c17fa608917204d846696af" Jun 09 00:04:09.564701 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:09.564662 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-h26mm" event={"ID":"97475d09-d6f9-4643-888f-2b941dcebba9","Type":"ContainerStarted","Data":"378bf4f2750875c021c1195b03e4b2d69bb6375288aa6043a1578fae55306823"} Jun 09 00:04:10.470197 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:10.470165 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/2.log" Jun 09 00:04:10.471293 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:10.471270 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/2.log" Jun 09 00:04:10.474962 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:10.474939 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-twgfd_219c3767-e998-4f79-a227-45681847cac2/ovn-acl-logging/0.log" Jun 09 00:04:10.475915 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:10.475896 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-twgfd_219c3767-e998-4f79-a227-45681847cac2/ovn-acl-logging/0.log" Jun 09 00:04:10.482151 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:10.482132 2573 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 00:04:10.693622 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:10.693473 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:11.522501 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:11.522464 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:11.623563 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:11.623528 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:12.925759 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:12.925717 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:13.536250 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:13.536217 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4ch68" Jun 09 00:04:13.583546 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:13.583463 2573 generic.go:356] "Generic (PLEG): container finished" podID="1000d8f6-3db7-4c2b-b676-3a60dc05dca8" containerID="a403f930e5ad1dc5a7cca0bf84551ca09f91d2ee8f78306c44222e5a84f6e573" exitCode=0 Jun 09 00:04:13.583546 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:13.583511 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" event={"ID":"1000d8f6-3db7-4c2b-b676-3a60dc05dca8","Type":"ContainerDied","Data":"a403f930e5ad1dc5a7cca0bf84551ca09f91d2ee8f78306c44222e5a84f6e573"} Jun 09 00:04:13.583912 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:13.583892 2573 scope.go:117] "RemoveContainer" containerID="a403f930e5ad1dc5a7cca0bf84551ca09f91d2ee8f78306c44222e5a84f6e573" Jun 09 00:04:13.794674 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:13.794637 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-l6vjd_e8916f13-b757-4cec-a113-2d911ab93e82/monitoring-plugin/0.log" Jun 09 00:04:14.589724 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:14.589685 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4vnl6" event={"ID":"1000d8f6-3db7-4c2b-b676-3a60dc05dca8","Type":"ContainerStarted","Data":"e94432f18bce6ad22adf5f87e264f93b97f2b61d5a8e1c18fd3ee3c5ce021883"} Jun 09 00:04:15.002394 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:15.002363 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:15.194365 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:15.194339 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r54vt_0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3/init-textfile/0.log" Jun 09 00:04:15.395802 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:15.395726 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r54vt_0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3/node-exporter/0.log" Jun 09 00:04:15.594732 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:15.594702 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r54vt_0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3/kube-rbac-proxy/0.log" Jun 09 00:04:15.794757 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:15.794697 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jjvt7_82390fe9-ff3f-4e43-83a7-fd4177de8788/kube-rbac-proxy-main/0.log" Jun 09 00:04:15.994258 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:15.994231 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jjvt7_82390fe9-ff3f-4e43-83a7-fd4177de8788/kube-rbac-proxy-self/0.log" Jun 09 00:04:16.195106 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:16.195021 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jjvt7_82390fe9-ff3f-4e43-83a7-fd4177de8788/openshift-state-metrics/0.log" Jun 09 00:04:16.394982 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:16.394959 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_60997e5b-c080-4d22-a963-f90b26b5da53/init-config-reloader/0.log" Jun 09 00:04:16.596991 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:16.596954 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_60997e5b-c080-4d22-a963-f90b26b5da53/prometheus/0.log" Jun 09 00:04:16.795144 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:16.795126 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_60997e5b-c080-4d22-a963-f90b26b5da53/config-reloader/0.log" Jun 09 00:04:16.995118 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:16.995090 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_60997e5b-c080-4d22-a963-f90b26b5da53/thanos-sidecar/0.log" Jun 09 00:04:17.196831 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:17.196805 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_60997e5b-c080-4d22-a963-f90b26b5da53/kube-rbac-proxy-web/0.log" Jun 09 00:04:17.395064 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:17.394995 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_60997e5b-c080-4d22-a963-f90b26b5da53/kube-rbac-proxy/0.log" Jun 09 00:04:17.595664 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:17.595639 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_60997e5b-c080-4d22-a963-f90b26b5da53/kube-rbac-proxy-thanos/0.log" Jun 09 00:04:17.731653 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:17.731618 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:17.799346 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:17.799310 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-d7t5k_66de382a-aa45-45c4-b3cc-b3c6a9f60d86/prometheus-operator/0.log" Jun 09 00:04:17.994467 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:17.994397 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-d7t5k_66de382a-aa45-45c4-b3cc-b3c6a9f60d86/kube-rbac-proxy/0.log" Jun 09 00:04:18.194604 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:18.194575 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-gwtfg_d4f1e2f4-1a8c-4b6d-93ee-2723a860800b/prometheus-operator-admission-webhook/0.log" Jun 09 00:04:19.471619 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:19.471577 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:19.894236 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:19.894202 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:19.944008 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:19.943986 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:20.250939 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:20.250905 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:20.299236 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:20.299191 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:20.394564 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:20.394534 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/2.log" Jun 09 00:04:20.596783 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:20.596688 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/3.log" Jun 09 00:04:20.657733 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:20.657702 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:20.701722 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:20.701691 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:21.196999 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:21.196961 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-jf6pl_0fb0b7bc-1c28-4aa6-868c-ac54c7ec608a/download-server/0.log" Jun 09 00:04:21.394937 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:21.394908 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4ch68_7ab4dd6e-79b1-4298-b7a8-d77b6f985b82/dns/0.log" Jun 09 00:04:21.515696 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:21.515670 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 09 00:04:21.594520 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:21.594488 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4ch68_7ab4dd6e-79b1-4298-b7a8-d77b6f985b82/kube-rbac-proxy/0.log" Jun 09 00:04:21.684185 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:21.684149 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:21.785135 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:21.785063 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:22.594379 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:22.594354 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r4ksj_3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e/dns-node-resolver/0.log" Jun 09 00:04:23.053567 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:23.053535 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:23.395498 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:23.395424 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59f4f5cff8-kq5cp_dba8bef0-1813-4dd2-802b-0db068169b98/registry/0.log" Jun 09 00:04:23.795039 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:23.795011 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6cn9v_3de9a184-ebf5-487a-b4c9-0f657559543b/node-ca/0.log" Jun 09 00:04:24.396051 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:24.396015 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5698bdd995-q7cpq_3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e/router/0.log" Jun 09 00:04:24.994853 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:24.994827 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qjl4k_2eac10de-440f-4fb9-83f1-b8f24050fd42/serve-healthcheck-canary/0.log" Jun 09 00:04:26.736579 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:26.736544 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:26.783714 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:26.783682 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:27.968415 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:27.968379 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:28.023472 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:28.023431 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:28.649541 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:28.649509 2573 generic.go:356] "Generic (PLEG): container finished" podID="ed9bb569-7c77-4fe2-91e6-271914697329" containerID="216f0b3a8990510a384b800b01c3e66bd61003c847e99d16137e6f4f55a44511" exitCode=0 Jun 09 00:04:28.649719 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:28.649557 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" event={"ID":"ed9bb569-7c77-4fe2-91e6-271914697329","Type":"ContainerDied","Data":"216f0b3a8990510a384b800b01c3e66bd61003c847e99d16137e6f4f55a44511"} Jun 09 00:04:28.649941 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:28.649926 2573 scope.go:117] "RemoveContainer" containerID="216f0b3a8990510a384b800b01c3e66bd61003c847e99d16137e6f4f55a44511" Jun 09 00:04:29.233201 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:29.233165 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:29.289674 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:29.289640 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:29.655528 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:29.655449 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g89kg" event={"ID":"ed9bb569-7c77-4fe2-91e6-271914697329","Type":"ContainerStarted","Data":"d5f53e94e1095bb90f105488046440d2183ed9e9261f2e2c408d7bd6fbeac54e"} Jun 09 00:04:35.426511 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:35.426472 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:35.442625 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:35.442601 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:35.695182 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:35.695107 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:36.967850 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:36.967821 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:37.073720 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:37.073683 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:37.118779 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:37.118718 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:38.400520 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:38.400478 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:38.501111 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:38.501059 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:42.762482 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:42.762450 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59f4f5cff8-kq5cp"] Jun 09 00:04:42.824972 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:42.824933 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:42.926340 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:42.926290 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:42.976833 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:42.976793 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:44.958714 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:44.958679 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:45.006309 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:45.006272 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:47.911532 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:47.911505 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:47.963944 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:47.963915 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:48.059527 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:48.059497 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:48.160471 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:48.160440 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:48.655968 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:48.655923 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:48.708079 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:48.708048 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:53.427444 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.427367 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 00:04:53.427942 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.427644 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="prometheus" containerID="cri-o://4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b" gracePeriod=600 Jun 09 00:04:53.427942 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.427664 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="kube-rbac-proxy" containerID="cri-o://00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57" gracePeriod=600 Jun 09 00:04:53.427942 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.427710 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="config-reloader" containerID="cri-o://41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453" gracePeriod=600 Jun 09 00:04:53.427942 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.427733 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="kube-rbac-proxy-web" containerID="cri-o://cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3" gracePeriod=600 Jun 09 00:04:53.427942 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.427791 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="kube-rbac-proxy-thanos" containerID="cri-o://93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14" gracePeriod=600 Jun 09 00:04:53.427942 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.427928 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="thanos-sidecar" containerID="cri-o://d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d" gracePeriod=600 Jun 09 00:04:53.688889 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.688859 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:53.754761 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.754709 2573 generic.go:356] "Generic (PLEG): container finished" podID="60997e5b-c080-4d22-a963-f90b26b5da53" containerID="93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14" exitCode=0 Jun 09 00:04:53.754761 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.754760 2573 generic.go:356] "Generic (PLEG): container finished" podID="60997e5b-c080-4d22-a963-f90b26b5da53" containerID="00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57" exitCode=0 Jun 09 00:04:53.755001 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.754773 2573 generic.go:356] "Generic (PLEG): container finished" podID="60997e5b-c080-4d22-a963-f90b26b5da53" containerID="cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3" exitCode=0 Jun 09 00:04:53.755001 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.754781 2573 generic.go:356] "Generic (PLEG): container finished" podID="60997e5b-c080-4d22-a963-f90b26b5da53" containerID="d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d" exitCode=0 Jun 09 00:04:53.755001 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.754789 2573 generic.go:356] "Generic (PLEG): container finished" podID="60997e5b-c080-4d22-a963-f90b26b5da53" containerID="41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453" exitCode=0 Jun 09 00:04:53.755001 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.754783 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerDied","Data":"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14"} Jun 09 00:04:53.755001 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.754818 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:53.755001 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.754866 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerDied","Data":"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57"} Jun 09 00:04:53.755001 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.754906 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerDied","Data":"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3"} Jun 09 00:04:53.755001 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.754943 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerDied","Data":"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d"} Jun 09 00:04:53.755001 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.754986 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerDied","Data":"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453"} Jun 09 00:04:53.755381 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.755023 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerDied","Data":"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b"} Jun 09 00:04:53.755381 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.755076 2573 scope.go:117] "RemoveContainer" containerID="93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14" Jun 09 00:04:53.755381 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.754797 2573 generic.go:356] "Generic (PLEG): container finished" podID="60997e5b-c080-4d22-a963-f90b26b5da53" containerID="4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b" exitCode=0 Jun 09 00:04:53.755381 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.755282 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60997e5b-c080-4d22-a963-f90b26b5da53","Type":"ContainerDied","Data":"d65f7a821f18c06f74c09b741b9f0723e134b1f007613e0d38b1a097802f2bd7"} Jun 09 00:04:53.763476 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.763454 2573 scope.go:117] "RemoveContainer" containerID="00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57" Jun 09 00:04:53.771116 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.771094 2573 scope.go:117] "RemoveContainer" containerID="cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3" Jun 09 00:04:53.778718 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.778678 2573 scope.go:117] "RemoveContainer" containerID="d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d" Jun 09 00:04:53.785714 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.785691 2573 scope.go:117] "RemoveContainer" containerID="41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453" Jun 09 00:04:53.792601 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.792584 2573 scope.go:117] "RemoveContainer" containerID="4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b" Jun 09 00:04:53.799902 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.799884 2573 scope.go:117] "RemoveContainer" containerID="829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946" Jun 09 00:04:53.808926 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.808910 2573 scope.go:117] "RemoveContainer" containerID="93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14" Jun 09 00:04:53.809192 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:04:53.809171 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14\": container with ID starting with 93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14 not found: ID does not exist" containerID="93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14" Jun 09 00:04:53.809262 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.809204 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14"} err="failed to get container status \"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14\": rpc error: code = NotFound desc = could not find container \"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14\": container with ID starting with 93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14 not found: ID does not exist" Jun 09 00:04:53.809262 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.809246 2573 scope.go:117] "RemoveContainer" containerID="00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57" Jun 09 00:04:53.809489 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:04:53.809472 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57\": container with ID starting with 00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57 not found: ID does not exist" containerID="00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57" Jun 09 00:04:53.809527 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.809495 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57"} err="failed to get container status \"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57\": rpc error: code = NotFound desc = could not find container \"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57\": container with ID starting with 00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57 not found: ID does not exist" Jun 09 00:04:53.809527 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.809511 2573 scope.go:117] "RemoveContainer" containerID="cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3" Jun 09 00:04:53.809723 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:04:53.809705 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3\": container with ID starting with cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3 not found: ID does not exist" containerID="cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3" Jun 09 00:04:53.809788 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.809728 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3"} err="failed to get container status \"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3\": rpc error: code = NotFound desc = could not find container \"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3\": container with ID starting with cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3 not found: ID does not exist" Jun 09 00:04:53.809788 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.809765 2573 scope.go:117] "RemoveContainer" containerID="d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d" Jun 09 00:04:53.809976 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:04:53.809959 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d\": container with ID starting with d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d not found: ID does not exist" containerID="d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d" Jun 09 00:04:53.810038 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.809984 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d"} err="failed to get container status \"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d\": rpc error: code = NotFound desc = could not find container \"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d\": container with ID starting with d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d not found: ID does not exist" Jun 09 00:04:53.810038 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.810004 2573 scope.go:117] "RemoveContainer" containerID="41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453" Jun 09 00:04:53.810248 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:04:53.810234 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453\": container with ID starting with 41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453 not found: ID does not exist" containerID="41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453" Jun 09 00:04:53.810311 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.810253 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453"} err="failed to get container status \"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453\": rpc error: code = NotFound desc = could not find container \"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453\": container with ID starting with 41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453 not found: ID does not exist" Jun 09 00:04:53.810311 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.810271 2573 scope.go:117] "RemoveContainer" containerID="4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b" Jun 09 00:04:53.810486 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:04:53.810470 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b\": container with ID starting with 4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b not found: ID does not exist" containerID="4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b" Jun 09 00:04:53.810522 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.810489 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b"} err="failed to get container status \"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b\": rpc error: code = NotFound desc = could not find container \"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b\": container with ID starting with 4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b not found: ID does not exist" Jun 09 00:04:53.810522 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.810502 2573 scope.go:117] "RemoveContainer" containerID="829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946" Jun 09 00:04:53.810716 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:04:53.810699 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946\": container with ID starting with 829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946 not found: ID does not exist" containerID="829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946" Jun 09 00:04:53.810787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.810723 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946"} err="failed to get container status \"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946\": rpc error: code = NotFound desc = could not find container \"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946\": container with ID starting with 829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946 not found: ID does not exist" Jun 09 00:04:53.810787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.810758 2573 scope.go:117] "RemoveContainer" containerID="93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14" Jun 09 00:04:53.810989 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.810973 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14"} err="failed to get container status \"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14\": rpc error: code = NotFound desc = could not find container \"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14\": container with ID starting with 93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14 not found: ID does not exist" Jun 09 00:04:53.811042 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.810989 2573 scope.go:117] "RemoveContainer" containerID="00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57" Jun 09 00:04:53.811199 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.811178 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57"} err="failed to get container status \"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57\": rpc error: code = NotFound desc = could not find container \"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57\": container with ID starting with 00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57 not found: ID does not exist" Jun 09 00:04:53.811199 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.811198 2573 scope.go:117] "RemoveContainer" containerID="cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3" Jun 09 00:04:53.811388 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.811372 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3"} err="failed to get container status \"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3\": rpc error: code = NotFound desc = could not find container \"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3\": container with ID starting with cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3 not found: ID does not exist" Jun 09 00:04:53.811434 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.811388 2573 scope.go:117] "RemoveContainer" containerID="d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d" Jun 09 00:04:53.811562 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.811548 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d"} err="failed to get container status \"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d\": rpc error: code = NotFound desc = could not find container \"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d\": container with ID starting with d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d not found: ID does not exist" Jun 09 00:04:53.811609 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.811561 2573 scope.go:117] "RemoveContainer" containerID="41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453" Jun 09 00:04:53.811729 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.811714 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453"} err="failed to get container status \"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453\": rpc error: code = NotFound desc = could not find container \"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453\": container with ID starting with 41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453 not found: ID does not exist" Jun 09 00:04:53.811810 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.811729 2573 scope.go:117] "RemoveContainer" containerID="4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b" Jun 09 00:04:53.811920 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.811901 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b"} err="failed to get container status \"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b\": rpc error: code = NotFound desc = could not find container \"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b\": container with ID starting with 4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b not found: ID does not exist" Jun 09 00:04:53.811959 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.811921 2573 scope.go:117] "RemoveContainer" containerID="829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946" Jun 09 00:04:53.812165 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.812148 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946"} err="failed to get container status \"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946\": rpc error: code = NotFound desc = could not find container \"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946\": container with ID starting with 829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946 not found: ID does not exist" Jun 09 00:04:53.812211 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.812165 2573 scope.go:117] "RemoveContainer" containerID="93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14" Jun 09 00:04:53.812335 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.812318 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14"} err="failed to get container status \"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14\": rpc error: code = NotFound desc = could not find container \"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14\": container with ID starting with 93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14 not found: ID does not exist" Jun 09 00:04:53.812370 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.812335 2573 scope.go:117] "RemoveContainer" containerID="00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57" Jun 09 00:04:53.812516 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.812502 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57"} err="failed to get container status \"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57\": rpc error: code = NotFound desc = could not find container \"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57\": container with ID starting with 00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57 not found: ID does not exist" Jun 09 00:04:53.812555 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.812516 2573 scope.go:117] "RemoveContainer" containerID="cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3" Jun 09 00:04:53.812715 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.812697 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3"} err="failed to get container status \"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3\": rpc error: code = NotFound desc = could not find container \"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3\": container with ID starting with cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3 not found: ID does not exist" Jun 09 00:04:53.812793 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.812716 2573 scope.go:117] "RemoveContainer" containerID="d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d" Jun 09 00:04:53.812971 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.812952 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d"} err="failed to get container status \"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d\": rpc error: code = NotFound desc = could not find container \"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d\": container with ID starting with d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d not found: ID does not exist" Jun 09 00:04:53.813032 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.812971 2573 scope.go:117] "RemoveContainer" containerID="41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453" Jun 09 00:04:53.813197 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.813181 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453"} err="failed to get container status \"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453\": rpc error: code = NotFound desc = could not find container \"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453\": container with ID starting with 41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453 not found: ID does not exist" Jun 09 00:04:53.813242 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.813199 2573 scope.go:117] "RemoveContainer" containerID="4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b" Jun 09 00:04:53.813414 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.813397 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b"} err="failed to get container status \"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b\": rpc error: code = NotFound desc = could not find container \"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b\": container with ID starting with 4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b not found: ID does not exist" Jun 09 00:04:53.813459 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.813416 2573 scope.go:117] "RemoveContainer" containerID="829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946" Jun 09 00:04:53.813576 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.813562 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946"} err="failed to get container status \"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946\": rpc error: code = NotFound desc = could not find container \"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946\": container with ID starting with 829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946 not found: ID does not exist" Jun 09 00:04:53.813627 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.813578 2573 scope.go:117] "RemoveContainer" containerID="93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14" Jun 09 00:04:53.813821 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.813806 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14"} err="failed to get container status \"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14\": rpc error: code = NotFound desc = could not find container \"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14\": container with ID starting with 93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14 not found: ID does not exist" Jun 09 00:04:53.813821 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.813821 2573 scope.go:117] "RemoveContainer" containerID="00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57" Jun 09 00:04:53.814048 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.814032 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57"} err="failed to get container status \"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57\": rpc error: code = NotFound desc = could not find container \"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57\": container with ID starting with 00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57 not found: ID does not exist" Jun 09 00:04:53.814090 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.814048 2573 scope.go:117] "RemoveContainer" containerID="cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3" Jun 09 00:04:53.814253 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.814237 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3"} err="failed to get container status \"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3\": rpc error: code = NotFound desc = could not find container \"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3\": container with ID starting with cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3 not found: ID does not exist" Jun 09 00:04:53.814294 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.814253 2573 scope.go:117] "RemoveContainer" containerID="d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d" Jun 09 00:04:53.814440 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.814424 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d"} err="failed to get container status \"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d\": rpc error: code = NotFound desc = could not find container \"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d\": container with ID starting with d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d not found: ID does not exist" Jun 09 00:04:53.814480 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.814440 2573 scope.go:117] "RemoveContainer" containerID="41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453" Jun 09 00:04:53.814647 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.814631 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453"} err="failed to get container status \"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453\": rpc error: code = NotFound desc = could not find container \"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453\": container with ID starting with 41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453 not found: ID does not exist" Jun 09 00:04:53.814647 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.814646 2573 scope.go:117] "RemoveContainer" containerID="4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b" Jun 09 00:04:53.814852 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.814838 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b"} err="failed to get container status \"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b\": rpc error: code = NotFound desc = could not find container \"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b\": container with ID starting with 4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b not found: ID does not exist" Jun 09 00:04:53.814852 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.814852 2573 scope.go:117] "RemoveContainer" containerID="829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946" Jun 09 00:04:53.815018 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.815002 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946"} err="failed to get container status \"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946\": rpc error: code = NotFound desc = could not find container \"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946\": container with ID starting with 829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946 not found: ID does not exist" Jun 09 00:04:53.815018 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.815018 2573 scope.go:117] "RemoveContainer" containerID="93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14" Jun 09 00:04:53.815175 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.815160 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14"} err="failed to get container status \"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14\": rpc error: code = NotFound desc = could not find container \"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14\": container with ID starting with 93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14 not found: ID does not exist" Jun 09 00:04:53.815216 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.815175 2573 scope.go:117] "RemoveContainer" containerID="00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57" Jun 09 00:04:53.815390 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.815375 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57"} err="failed to get container status \"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57\": rpc error: code = NotFound desc = could not find container \"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57\": container with ID starting with 00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57 not found: ID does not exist" Jun 09 00:04:53.815432 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.815390 2573 scope.go:117] "RemoveContainer" containerID="cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3" Jun 09 00:04:53.815575 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.815560 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3"} err="failed to get container status \"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3\": rpc error: code = NotFound desc = could not find container \"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3\": container with ID starting with cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3 not found: ID does not exist" Jun 09 00:04:53.815626 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.815575 2573 scope.go:117] "RemoveContainer" containerID="d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d" Jun 09 00:04:53.815811 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.815792 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d"} err="failed to get container status \"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d\": rpc error: code = NotFound desc = could not find container \"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d\": container with ID starting with d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d not found: ID does not exist" Jun 09 00:04:53.815856 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.815812 2573 scope.go:117] "RemoveContainer" containerID="41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453" Jun 09 00:04:53.816016 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.816000 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453"} err="failed to get container status \"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453\": rpc error: code = NotFound desc = could not find container \"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453\": container with ID starting with 41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453 not found: ID does not exist" Jun 09 00:04:53.816016 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.816015 2573 scope.go:117] "RemoveContainer" containerID="4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b" Jun 09 00:04:53.816202 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.816184 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b"} err="failed to get container status \"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b\": rpc error: code = NotFound desc = could not find container \"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b\": container with ID starting with 4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b not found: ID does not exist" Jun 09 00:04:53.816252 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.816202 2573 scope.go:117] "RemoveContainer" containerID="829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946" Jun 09 00:04:53.816397 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.816379 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946"} err="failed to get container status \"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946\": rpc error: code = NotFound desc = could not find container \"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946\": container with ID starting with 829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946 not found: ID does not exist" Jun 09 00:04:53.816397 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.816396 2573 scope.go:117] "RemoveContainer" containerID="93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14" Jun 09 00:04:53.816589 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.816575 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14"} err="failed to get container status \"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14\": rpc error: code = NotFound desc = could not find container \"93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14\": container with ID starting with 93d748afdd9eee885658fba06795b4784e6b8200c8f815f03782b07f953a2b14 not found: ID does not exist" Jun 09 00:04:53.816631 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.816589 2573 scope.go:117] "RemoveContainer" containerID="00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57" Jun 09 00:04:53.816783 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.816768 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57"} err="failed to get container status \"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57\": rpc error: code = NotFound desc = could not find container \"00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57\": container with ID starting with 00e8d5bc0ed80804ed97acacf8b1d5ed64ced6beb4a47910037ecd8a05e48e57 not found: ID does not exist" Jun 09 00:04:53.816831 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.816783 2573 scope.go:117] "RemoveContainer" containerID="cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3" Jun 09 00:04:53.816976 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.816961 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3"} err="failed to get container status \"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3\": rpc error: code = NotFound desc = could not find container \"cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3\": container with ID starting with cb4fa4b1ea7bc6b0e1a562eccd98de7b8b2ddd82592d756a006b9a17a637ecb3 not found: ID does not exist" Jun 09 00:04:53.817025 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.816976 2573 scope.go:117] "RemoveContainer" containerID="d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d" Jun 09 00:04:53.817178 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.817164 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d"} err="failed to get container status \"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d\": rpc error: code = NotFound desc = could not find container \"d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d\": container with ID starting with d936ac2da36cf13b6fdb170b7f3e41d41efa362965ed027e507d49b60499f24d not found: ID does not exist" Jun 09 00:04:53.817178 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.817177 2573 scope.go:117] "RemoveContainer" containerID="41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453" Jun 09 00:04:53.817375 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.817359 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453"} err="failed to get container status \"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453\": rpc error: code = NotFound desc = could not find container \"41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453\": container with ID starting with 41b82215842d2869a9fbf36e83711dbc210552c96396c106fbfaea4ebf0ca453 not found: ID does not exist" Jun 09 00:04:53.817425 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.817374 2573 scope.go:117] "RemoveContainer" containerID="4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b" Jun 09 00:04:53.817557 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.817542 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b"} err="failed to get container status \"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b\": rpc error: code = NotFound desc = could not find container \"4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b\": container with ID starting with 4382d576ca9cbaf1c0c3bb2895139823f300ec677581686739eb1ff87ee9916b not found: ID does not exist" Jun 09 00:04:53.817599 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.817558 2573 scope.go:117] "RemoveContainer" containerID="829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946" Jun 09 00:04:53.817761 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.817723 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946"} err="failed to get container status \"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946\": rpc error: code = NotFound desc = could not find container \"829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946\": container with ID starting with 829e321420b456e865443e343d666eff6b03a2fd3e774e59b641aa89294cd946 not found: ID does not exist" Jun 09 00:04:53.867809 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.867786 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.867924 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.867814 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-kubelet-serving-ca-bundle\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.867924 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.867836 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-trusted-ca-bundle\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.867924 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.867857 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-web-config\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.867924 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.867879 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-metrics-client-certs\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.867924 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.867904 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-2\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.868180 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.867945 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-serving-certs-ca-bundle\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.868180 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.867993 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl8hc\" (UniqueName: \"kubernetes.io/projected/60997e5b-c080-4d22-a963-f90b26b5da53-kube-api-access-cl8hc\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.868180 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868021 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-kube-rbac-proxy\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.868180 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868071 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-metrics-client-ca\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.868180 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868103 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-0\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.868180 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868131 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60997e5b-c080-4d22-a963-f90b26b5da53-tls-assets\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.868444 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868188 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-db\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.868444 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868211 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-grpc-tls\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.868444 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868247 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-1\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.868444 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868282 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-config\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.868444 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868311 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.868444 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868349 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60997e5b-c080-4d22-a963-f90b26b5da53-config-out\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.868444 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868382 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-thanos-prometheus-http-client-file\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.868819 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868472 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-tls\") pod \"60997e5b-c080-4d22-a963-f90b26b5da53\" (UID: \"60997e5b-c080-4d22-a963-f90b26b5da53\") " Jun 09 00:04:53.870363 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868242 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:04:53.870363 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868274 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:04:53.870363 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868499 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:04:53.870363 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868523 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:04:53.870363 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.868886 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:04:53.870363 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.870036 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:04:53.870363 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.870220 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:04:53.871240 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.871105 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:53.871610 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.871530 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:53.871610 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.871547 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60997e5b-c080-4d22-a963-f90b26b5da53-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:04:53.871610 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.871574 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60997e5b-c080-4d22-a963-f90b26b5da53-kube-api-access-cl8hc" (OuterVolumeSpecName: "kube-api-access-cl8hc") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "kube-api-access-cl8hc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:04:53.871955 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.871928 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:53.872547 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.872518 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:04:53.872902 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.872877 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:53.873270 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.873238 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60997e5b-c080-4d22-a963-f90b26b5da53-config-out" (OuterVolumeSpecName: "config-out") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:04:53.873270 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.873255 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:53.873403 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.873382 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:53.873648 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.873627 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:53.873880 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.873863 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-config" (OuterVolumeSpecName: "config") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:53.882106 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.882086 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-web-config" (OuterVolumeSpecName: "web-config") pod "60997e5b-c080-4d22-a963-f90b26b5da53" (UID: "60997e5b-c080-4d22-a963-f90b26b5da53"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:53.969639 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969582 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969639 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969606 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969639 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969616 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969639 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969626 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969639 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969636 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-web-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969645 2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-metrics-client-certs\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969653 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969662 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969669 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl8hc\" (UniqueName: \"kubernetes.io/projected/60997e5b-c080-4d22-a963-f90b26b5da53-kube-api-access-cl8hc\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969677 2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-kube-rbac-proxy\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969686 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-configmap-metrics-client-ca\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969693 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969701 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60997e5b-c080-4d22-a963-f90b26b5da53-tls-assets\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969709 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-db\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969717 2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-grpc-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969724 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60997e5b-c080-4d22-a963-f90b26b5da53-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969731 2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969768 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969781 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60997e5b-c080-4d22-a963-f90b26b5da53-config-out\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:53.969869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:53.969789 2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60997e5b-c080-4d22-a963-f90b26b5da53-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:04:54.078023 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.077995 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 00:04:54.084487 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.084466 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 00:04:54.108304 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108279 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 00:04:54.108545 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108533 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="kube-rbac-proxy" Jun 09 00:04:54.108586 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108546 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="kube-rbac-proxy" Jun 09 00:04:54.108586 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108558 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="thanos-sidecar" Jun 09 00:04:54.108586 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108564 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="thanos-sidecar" Jun 09 00:04:54.108586 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108577 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="init-config-reloader" Jun 09 00:04:54.108586 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108582 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="init-config-reloader" Jun 09 00:04:54.108787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108592 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="prometheus" Jun 09 00:04:54.108787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108597 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="prometheus" Jun 09 00:04:54.108787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108603 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="config-reloader" Jun 09 00:04:54.108787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108608 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="config-reloader" Jun 09 00:04:54.108787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108614 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="kube-rbac-proxy-thanos" Jun 09 00:04:54.108787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108619 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="kube-rbac-proxy-thanos" Jun 09 00:04:54.108787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108628 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="kube-rbac-proxy-web" Jun 09 00:04:54.108787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108633 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="kube-rbac-proxy-web" Jun 09 00:04:54.108787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108675 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="prometheus" Jun 09 00:04:54.108787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108682 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="config-reloader" Jun 09 00:04:54.108787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108687 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="thanos-sidecar" Jun 09 00:04:54.108787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108693 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="kube-rbac-proxy" Jun 09 00:04:54.108787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108699 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="kube-rbac-proxy-web" Jun 09 00:04:54.108787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.108705 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" containerName="kube-rbac-proxy-thanos" Jun 09 00:04:54.113915 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.113896 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.119078 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.119059 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 00:04:54.119368 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.119349 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 00:04:54.119486 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.119358 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 00:04:54.119682 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.119661 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 00:04:54.119823 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.119733 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ljj6go5mmumv\"" Jun 09 00:04:54.119914 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.119858 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 00:04:54.119914 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.119901 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 00:04:54.120040 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.120010 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 00:04:54.120116 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.120108 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 00:04:54.120198 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.120186 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 00:04:54.120272 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.120255 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 00:04:54.120340 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.120301 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 00:04:54.120340 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.120331 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vjp77\"" Jun 09 00:04:54.120454 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.120367 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 00:04:54.120454 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.120426 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 00:04:54.125583 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.125551 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 00:04:54.130857 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.130823 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 00:04:54.132293 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.132272 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 00:04:54.271974 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.271938 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272116 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.271979 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-config\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272116 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.271997 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272116 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272012 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272116 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272116 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272111 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272326 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272136 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272326 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272174 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272326 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272191 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272326 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272220 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272326 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272245 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0693718-9f76-490c-95e9-0f6e44a242db-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272326 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272279 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272326 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272296 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272326 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272319 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272557 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272336 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0693718-9f76-490c-95e9-0f6e44a242db-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272557 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272351 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272557 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272366 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbkzv\" (UniqueName: \"kubernetes.io/projected/e0693718-9f76-490c-95e9-0f6e44a242db-kube-api-access-qbkzv\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272557 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272415 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272557 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272437 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.272557 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.272455 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373431 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373392 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0693718-9f76-490c-95e9-0f6e44a242db-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373431 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373434 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373659 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373496 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbkzv\" (UniqueName: \"kubernetes.io/projected/e0693718-9f76-490c-95e9-0f6e44a242db-kube-api-access-qbkzv\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373659 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373547 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373659 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373570 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373659 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373595 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373659 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373624 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373659 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373656 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-config\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373993 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373679 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373993 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373703 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373993 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373757 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373993 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373786 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373993 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373830 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373993 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373866 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373993 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373892 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373993 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.373993 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373979 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.374421 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.374254 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377043 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.374939 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377043 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.375027 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377043 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.375669 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377043 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.376376 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377043 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.376408 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0693718-9f76-490c-95e9-0f6e44a242db-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377043 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.373985 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0693718-9f76-490c-95e9-0f6e44a242db-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377043 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.376466 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377043 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.376496 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377043 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.376528 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377043 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.376854 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0693718-9f76-490c-95e9-0f6e44a242db-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377043 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.376934 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377043 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.376938 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377043 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.376959 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377980 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.377123 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.377980 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.377861 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.378213 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.378189 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0693718-9f76-490c-95e9-0f6e44a242db-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.379376 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.379344 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.379461 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.379384 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-config\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.379461 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.379428 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.379554 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.379501 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.379649 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.379634 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0693718-9f76-490c-95e9-0f6e44a242db-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.381277 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.381257 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbkzv\" (UniqueName: \"kubernetes.io/projected/e0693718-9f76-490c-95e9-0f6e44a242db-kube-api-access-qbkzv\") pod \"prometheus-k8s-0\" (UID: \"e0693718-9f76-490c-95e9-0f6e44a242db\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.426347 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.426312 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:04:54.532417 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.532278 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60997e5b-c080-4d22-a963-f90b26b5da53" path="/var/lib/kubelet/pods/60997e5b-c080-4d22-a963-f90b26b5da53/volumes" Jun 09 00:04:54.562407 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.562381 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 00:04:54.566043 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:04:54.566013 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0693718_9f76_490c_95e9_0f6e44a242db.slice/crio-325fb6c0d89112dbb3d27f845e2bfa723d41be6b05c72d40463aa377dc56af54 WatchSource:0}: Error finding container 325fb6c0d89112dbb3d27f845e2bfa723d41be6b05c72d40463aa377dc56af54: Status 404 returned error can't find the container with id 325fb6c0d89112dbb3d27f845e2bfa723d41be6b05c72d40463aa377dc56af54 Jun 09 00:04:54.760906 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.760877 2573 generic.go:356] "Generic (PLEG): container finished" podID="e0693718-9f76-490c-95e9-0f6e44a242db" containerID="cff46ae06f3e3ab205835b4e8a89b3f56f9b051dd8c51b2ff76f846c97d701bd" exitCode=0 Jun 09 00:04:54.761088 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.760952 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0693718-9f76-490c-95e9-0f6e44a242db","Type":"ContainerDied","Data":"cff46ae06f3e3ab205835b4e8a89b3f56f9b051dd8c51b2ff76f846c97d701bd"} Jun 09 00:04:54.761088 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:54.761026 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0693718-9f76-490c-95e9-0f6e44a242db","Type":"ContainerStarted","Data":"325fb6c0d89112dbb3d27f845e2bfa723d41be6b05c72d40463aa377dc56af54"} Jun 09 00:04:55.120513 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:55.120487 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:55.218473 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:55.218444 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:55.768895 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:55.768865 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0693718-9f76-490c-95e9-0f6e44a242db","Type":"ContainerStarted","Data":"988694b3d68e29ae2fc38cc46b3b19b0697bf370baee20b541a0e9475e103277"} Jun 09 00:04:55.769358 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:55.768950 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0693718-9f76-490c-95e9-0f6e44a242db","Type":"ContainerStarted","Data":"30d0367f1132df9300da88bc91772b36e60504715afa2ebb42f254eb787f33db"} Jun 09 00:04:55.769358 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:55.768978 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0693718-9f76-490c-95e9-0f6e44a242db","Type":"ContainerStarted","Data":"49ee0cb228d0f96fe3d88556ace64c8b0ae77c9be5ba4bc169028b48c4a06f2a"} Jun 09 00:04:55.769358 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:55.769011 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0693718-9f76-490c-95e9-0f6e44a242db","Type":"ContainerStarted","Data":"b2c80f549a243fa8b3309da59d3f554f8f00ca63a8f0d51cf77329f1f7fc726d"} Jun 09 00:04:55.769358 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:55.769035 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0693718-9f76-490c-95e9-0f6e44a242db","Type":"ContainerStarted","Data":"a2b4f08adf9640f2dbdd3fb8b367319a31badec1e016d821cb0f4ae43833e02e"} Jun 09 00:04:55.769358 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:55.769058 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0693718-9f76-490c-95e9-0f6e44a242db","Type":"ContainerStarted","Data":"0dcff85467768ff9603237c89c64e7ea490ce90cb895f87bb9dc78adc98815fe"} Jun 09 00:04:55.794586 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:55.794521 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.775758248 podStartE2EDuration="1.794502882s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.744634ms" isStatefulPod=false podCreationTimestamp="2026-06-09 00:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:04:55.792638145 +0000 UTC m=+345.750905749" watchObservedRunningTime="2026-06-09 00:04:55.794502882 +0000 UTC m=+345.752770486" Jun 09 00:04:57.925120 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:57.925084 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:57.975528 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:57.975493 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:58.027232 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:58.027206 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:59.022674 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:59.022641 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:59.071415 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:59.071380 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:59.124849 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:59.124814 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:59.172709 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:59.172680 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:04:59.427298 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:04:59.427208 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:05:07.783279 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:07.783237 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" podUID="dba8bef0-1813-4dd2-802b-0db068169b98" containerName="registry" containerID="cri-o://9224700be1f89ae1298d8b29cb9446e93878fb4f9ccdbae65e80c54347b93bd9" gracePeriod=30 Jun 09 00:05:08.033652 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.033597 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 09 00:05:08.086305 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.086275 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dba8bef0-1813-4dd2-802b-0db068169b98-ca-trust-extracted\") pod \"dba8bef0-1813-4dd2-802b-0db068169b98\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " Jun 09 00:05:08.086446 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.086319 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-bound-sa-token\") pod \"dba8bef0-1813-4dd2-802b-0db068169b98\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " Jun 09 00:05:08.086446 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.086340 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dba8bef0-1813-4dd2-802b-0db068169b98-trusted-ca\") pod \"dba8bef0-1813-4dd2-802b-0db068169b98\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " Jun 09 00:05:08.086446 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.086369 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls\") pod \"dba8bef0-1813-4dd2-802b-0db068169b98\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " Jun 09 00:05:08.086587 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.086556 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dba8bef0-1813-4dd2-802b-0db068169b98-registry-certificates\") pod \"dba8bef0-1813-4dd2-802b-0db068169b98\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " Jun 09 00:05:08.086642 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.086610 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dba8bef0-1813-4dd2-802b-0db068169b98-installation-pull-secrets\") pod \"dba8bef0-1813-4dd2-802b-0db068169b98\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " Jun 09 00:05:08.086698 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.086639 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dba8bef0-1813-4dd2-802b-0db068169b98-image-registry-private-configuration\") pod \"dba8bef0-1813-4dd2-802b-0db068169b98\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " Jun 09 00:05:08.086698 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.086671 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psckc\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-kube-api-access-psckc\") pod \"dba8bef0-1813-4dd2-802b-0db068169b98\" (UID: \"dba8bef0-1813-4dd2-802b-0db068169b98\") " Jun 09 00:05:08.086823 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.086782 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dba8bef0-1813-4dd2-802b-0db068169b98-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dba8bef0-1813-4dd2-802b-0db068169b98" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:05:08.087264 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.087025 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dba8bef0-1813-4dd2-802b-0db068169b98-trusted-ca\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:05:08.087264 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.087026 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dba8bef0-1813-4dd2-802b-0db068169b98-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dba8bef0-1813-4dd2-802b-0db068169b98" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:05:08.089334 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.089289 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dba8bef0-1813-4dd2-802b-0db068169b98-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dba8bef0-1813-4dd2-802b-0db068169b98" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:05:08.089334 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.089299 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dba8bef0-1813-4dd2-802b-0db068169b98" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:05:08.089334 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.089304 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dba8bef0-1813-4dd2-802b-0db068169b98" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:05:08.089621 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.089599 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-kube-api-access-psckc" (OuterVolumeSpecName: "kube-api-access-psckc") pod "dba8bef0-1813-4dd2-802b-0db068169b98" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98"). InnerVolumeSpecName "kube-api-access-psckc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:05:08.089683 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.089612 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dba8bef0-1813-4dd2-802b-0db068169b98-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dba8bef0-1813-4dd2-802b-0db068169b98" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:05:08.095432 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.095411 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dba8bef0-1813-4dd2-802b-0db068169b98-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dba8bef0-1813-4dd2-802b-0db068169b98" (UID: "dba8bef0-1813-4dd2-802b-0db068169b98"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:05:08.187448 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.187426 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:05:08.187448 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.187447 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dba8bef0-1813-4dd2-802b-0db068169b98-registry-certificates\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:05:08.187565 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.187456 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dba8bef0-1813-4dd2-802b-0db068169b98-installation-pull-secrets\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:05:08.187565 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.187465 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dba8bef0-1813-4dd2-802b-0db068169b98-image-registry-private-configuration\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:05:08.187565 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.187473 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psckc\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-kube-api-access-psckc\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:05:08.187565 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.187481 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dba8bef0-1813-4dd2-802b-0db068169b98-ca-trust-extracted\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:05:08.187565 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.187489 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dba8bef0-1813-4dd2-802b-0db068169b98-bound-sa-token\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:05:08.822009 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.821917 2573 generic.go:356] "Generic (PLEG): container finished" podID="dba8bef0-1813-4dd2-802b-0db068169b98" containerID="9224700be1f89ae1298d8b29cb9446e93878fb4f9ccdbae65e80c54347b93bd9" exitCode=0 Jun 09 00:05:08.822009 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.821958 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" event={"ID":"dba8bef0-1813-4dd2-802b-0db068169b98","Type":"ContainerDied","Data":"9224700be1f89ae1298d8b29cb9446e93878fb4f9ccdbae65e80c54347b93bd9"} Jun 09 00:05:08.822009 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.821993 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" Jun 09 00:05:08.822608 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.822023 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f4f5cff8-kq5cp" event={"ID":"dba8bef0-1813-4dd2-802b-0db068169b98","Type":"ContainerDied","Data":"6c675e06bacf81acc9573e488e7edd79534cea08d72fac2368f9bbb9f9221ca3"} Jun 09 00:05:08.822608 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.822044 2573 scope.go:117] "RemoveContainer" containerID="9224700be1f89ae1298d8b29cb9446e93878fb4f9ccdbae65e80c54347b93bd9" Jun 09 00:05:08.830598 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.830582 2573 scope.go:117] "RemoveContainer" containerID="9224700be1f89ae1298d8b29cb9446e93878fb4f9ccdbae65e80c54347b93bd9" Jun 09 00:05:08.830862 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:05:08.830843 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9224700be1f89ae1298d8b29cb9446e93878fb4f9ccdbae65e80c54347b93bd9\": container with ID starting with 9224700be1f89ae1298d8b29cb9446e93878fb4f9ccdbae65e80c54347b93bd9 not found: ID does not exist" containerID="9224700be1f89ae1298d8b29cb9446e93878fb4f9ccdbae65e80c54347b93bd9" Jun 09 00:05:08.830916 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.830869 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9224700be1f89ae1298d8b29cb9446e93878fb4f9ccdbae65e80c54347b93bd9"} err="failed to get container status \"9224700be1f89ae1298d8b29cb9446e93878fb4f9ccdbae65e80c54347b93bd9\": rpc error: code = NotFound desc = could not find container \"9224700be1f89ae1298d8b29cb9446e93878fb4f9ccdbae65e80c54347b93bd9\": container with ID starting with 9224700be1f89ae1298d8b29cb9446e93878fb4f9ccdbae65e80c54347b93bd9 not found: ID does not exist" Jun 09 00:05:08.842852 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.842821 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59f4f5cff8-kq5cp"] Jun 09 00:05:08.846074 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:08.846052 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59f4f5cff8-kq5cp"] Jun 09 00:05:10.530638 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:10.530609 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dba8bef0-1813-4dd2-802b-0db068169b98" path="/var/lib/kubelet/pods/dba8bef0-1813-4dd2-802b-0db068169b98/volumes" Jun 09 00:05:12.934659 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:12.934622 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:05:13.033800 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:13.033763 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:05:39.329721 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:39.329677 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:05:39.431110 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:39.431072 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:05:54.427229 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:54.427180 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:05:54.443044 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:54.443021 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:05:55.025967 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:55.025941 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 00:05:58.684661 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:58.684621 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:05:58.785216 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:05:58.785186 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:00.494519 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:00.494479 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:00.595592 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:00.595556 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:30.202123 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:30.202040 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:30.974886 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:30.974850 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:33.606607 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:33.606569 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:33.706636 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:33.706603 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:34.665122 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:34.665071 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:34.772332 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:34.772300 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:34.898841 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:34.898811 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:38.291663 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:38.291623 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:38.670432 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:38.670341 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:40.595649 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:40.595613 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:40.696949 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:40.696910 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:44.208909 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:44.208876 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:44.308462 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:44.308429 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:45.678496 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:45.678469 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:50.038786 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:50.038731 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:50.139594 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:50.139551 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:06:51.859388 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:06:51.859350 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:07.622001 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:07.621949 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:07.713350 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:07.713309 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:08.219187 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.219146 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:08.452690 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.452654 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:08.555982 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.555931 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:08.589788 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.589760 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz"] Jun 09 00:07:08.590080 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.590068 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dba8bef0-1813-4dd2-802b-0db068169b98" containerName="registry" Jun 09 00:07:08.590123 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.590082 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dba8bef0-1813-4dd2-802b-0db068169b98" containerName="registry" Jun 09 00:07:08.590157 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.590144 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dba8bef0-1813-4dd2-802b-0db068169b98" containerName="registry" Jun 09 00:07:08.593222 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.593202 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.597225 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.597207 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 00:07:08.597323 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.597211 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 00:07:08.598699 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.598671 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 00:07:08.600139 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.600105 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 00:07:08.600247 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.600200 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zkkk7\"" Jun 09 00:07:08.674590 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.674564 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz"] Jun 09 00:07:08.717664 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.717639 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-manifests\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.717793 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.717727 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.717854 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.717802 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkb5d\" (UniqueName: \"kubernetes.io/projected/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-kube-api-access-bkb5d\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.717854 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.717830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-tmp\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.717935 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.717863 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.737427 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.737396 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:08.818668 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.818610 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.818668 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.818655 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-manifests\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.818865 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.818698 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.818865 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.818765 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkb5d\" (UniqueName: \"kubernetes.io/projected/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-kube-api-access-bkb5d\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.818963 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.818910 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-tmp\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.819129 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.819107 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-manifests\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.821133 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.821105 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-tmp\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.821295 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.821273 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.821362 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.821350 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.830110 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.830091 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkb5d\" (UniqueName: \"kubernetes.io/projected/3c6f1abf-b12e-433e-9e8c-63ed84c992b1-kube-api-access-bkb5d\") pod \"opendatahub-operator-controller-manager-569d667bc9-gzvhz\" (UID: \"3c6f1abf-b12e-433e-9e8c-63ed84c992b1\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.842716 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.842694 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:08.903480 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.903458 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:08.937324 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:08.937298 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:09.013095 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:09.013057 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:09.033692 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:09.033672 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz"] Jun 09 00:07:09.037577 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:07:09.036762 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c6f1abf_b12e_433e_9e8c_63ed84c992b1.slice/crio-8801d442f29c468773ba9df9f32a277fc73df9026e036558cdaa8310c7421908 WatchSource:0}: Error finding container 8801d442f29c468773ba9df9f32a277fc73df9026e036558cdaa8310c7421908: Status 404 returned error can't find the container with id 8801d442f29c468773ba9df9f32a277fc73df9026e036558cdaa8310c7421908 Jun 09 00:07:09.038968 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:09.038934 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:07:09.069728 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:09.069660 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:09.169574 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:09.169547 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:09.272117 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:09.272084 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:09.302941 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:09.302916 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" event={"ID":"3c6f1abf-b12e-433e-9e8c-63ed84c992b1","Type":"ContainerStarted","Data":"8801d442f29c468773ba9df9f32a277fc73df9026e036558cdaa8310c7421908"} Jun 09 00:07:11.148122 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:11.148082 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:11.246111 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:11.246061 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:13.324261 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:13.324224 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" event={"ID":"3c6f1abf-b12e-433e-9e8c-63ed84c992b1","Type":"ContainerStarted","Data":"a5f2aead0f889110596ff4d4c101af511576c9dfc1e08e4b53b812ee97278ad9"} Jun 09 00:07:14.330127 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:14.330044 2573 generic.go:356] "Generic (PLEG): container finished" podID="3c6f1abf-b12e-433e-9e8c-63ed84c992b1" containerID="a5f2aead0f889110596ff4d4c101af511576c9dfc1e08e4b53b812ee97278ad9" exitCode=0 Jun 09 00:07:14.330127 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:14.330113 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" event={"ID":"3c6f1abf-b12e-433e-9e8c-63ed84c992b1","Type":"ContainerDied","Data":"a5f2aead0f889110596ff4d4c101af511576c9dfc1e08e4b53b812ee97278ad9"} Jun 09 00:07:15.336724 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:15.336686 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" event={"ID":"3c6f1abf-b12e-433e-9e8c-63ed84c992b1","Type":"ContainerStarted","Data":"2ba2492e557c397e3883b876b463a451d150c73ce6b2ab37c3e0b79536271304"} Jun 09 00:07:15.337237 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:15.336879 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:15.357660 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:15.357603 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" podStartSLOduration=2.099020414 podStartE2EDuration="7.357588802s" totalImagesPullingTime="4.302179251s" totalInitContainerRuntime="956.389137ms" isStatefulPod=false podCreationTimestamp="2026-06-09 00:07:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:07:15.355657603 +0000 UTC m=+485.313925207" watchObservedRunningTime="2026-06-09 00:07:15.357588802 +0000 UTC m=+485.315856406" Jun 09 00:07:15.366897 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:15.366874 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:15.426878 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:15.426847 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:16.068274 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:16.068239 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:16.170885 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:16.170845 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:17.564338 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:17.564300 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:17.625387 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:17.625356 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:26.343213 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:26.343178 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-gzvhz" Jun 09 00:07:28.091642 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:28.091601 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:28.203286 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:28.203249 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:28.783949 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:28.783917 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:28.880611 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:28.880566 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:28.981224 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:28.981183 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:29.083905 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:29.083798 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:29.287006 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:29.286968 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:29.517559 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:29.517503 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:33.789848 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:33.789812 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:33.882650 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:33.882616 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:34.104478 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:34.104390 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:37.736061 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.736029 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:37.803211 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.803177 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg"] Jun 09 00:07:37.809063 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.809034 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg" Jun 09 00:07:37.811471 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.811446 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 00:07:37.811648 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.811446 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-6864g\"" Jun 09 00:07:37.815703 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.815681 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg"] Jun 09 00:07:37.822916 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.822893 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:37.865731 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.865705 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8fa6092-7a47-4eab-883a-6d99c4fab20f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-p8bjg\" (UID: \"f8fa6092-7a47-4eab-883a-6d99c4fab20f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg" Jun 09 00:07:37.865874 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.865734 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mmxl\" (UniqueName: \"kubernetes.io/projected/f8fa6092-7a47-4eab-883a-6d99c4fab20f-kube-api-access-5mmxl\") pod \"llmisvc-controller-manager-864bfd7bc9-p8bjg\" (UID: \"f8fa6092-7a47-4eab-883a-6d99c4fab20f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg" Jun 09 00:07:37.892283 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.892256 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x"] Jun 09 00:07:37.894272 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.894256 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:37.896929 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.896896 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 00:07:37.897096 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.896934 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 00:07:37.897096 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.897088 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 00:07:37.897328 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.897304 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:07:37.897437 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.897355 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-np6xr\"" Jun 09 00:07:37.897437 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.897354 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 00:07:37.906458 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.906435 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x"] Jun 09 00:07:37.912054 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.912031 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:37.966803 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.966776 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/425588f3-c856-4316-a776-7bf0cd239558-metrics-cert\") pod \"lws-controller-manager-5f4484c748-6pb7x\" (UID: \"425588f3-c856-4316-a776-7bf0cd239558\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:37.966906 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.966811 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8fa6092-7a47-4eab-883a-6d99c4fab20f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-p8bjg\" (UID: \"f8fa6092-7a47-4eab-883a-6d99c4fab20f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg" Jun 09 00:07:37.966906 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.966829 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mmxl\" (UniqueName: \"kubernetes.io/projected/f8fa6092-7a47-4eab-883a-6d99c4fab20f-kube-api-access-5mmxl\") pod \"llmisvc-controller-manager-864bfd7bc9-p8bjg\" (UID: \"f8fa6092-7a47-4eab-883a-6d99c4fab20f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg" Jun 09 00:07:37.967024 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.966905 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/425588f3-c856-4316-a776-7bf0cd239558-manager-config\") pod \"lws-controller-manager-5f4484c748-6pb7x\" (UID: \"425588f3-c856-4316-a776-7bf0cd239558\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:37.967485 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.966958 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brg79\" (UniqueName: \"kubernetes.io/projected/425588f3-c856-4316-a776-7bf0cd239558-kube-api-access-brg79\") pod \"lws-controller-manager-5f4484c748-6pb7x\" (UID: \"425588f3-c856-4316-a776-7bf0cd239558\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:37.967485 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.967410 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/425588f3-c856-4316-a776-7bf0cd239558-cert\") pod \"lws-controller-manager-5f4484c748-6pb7x\" (UID: \"425588f3-c856-4316-a776-7bf0cd239558\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:37.974343 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.970591 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8fa6092-7a47-4eab-883a-6d99c4fab20f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-p8bjg\" (UID: \"f8fa6092-7a47-4eab-883a-6d99c4fab20f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg" Jun 09 00:07:37.978518 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:37.978498 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mmxl\" (UniqueName: \"kubernetes.io/projected/f8fa6092-7a47-4eab-883a-6d99c4fab20f-kube-api-access-5mmxl\") pod \"llmisvc-controller-manager-864bfd7bc9-p8bjg\" (UID: \"f8fa6092-7a47-4eab-883a-6d99c4fab20f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg" Jun 09 00:07:38.068801 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.068719 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/425588f3-c856-4316-a776-7bf0cd239558-manager-config\") pod \"lws-controller-manager-5f4484c748-6pb7x\" (UID: \"425588f3-c856-4316-a776-7bf0cd239558\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:38.068929 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.068804 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brg79\" (UniqueName: \"kubernetes.io/projected/425588f3-c856-4316-a776-7bf0cd239558-kube-api-access-brg79\") pod \"lws-controller-manager-5f4484c748-6pb7x\" (UID: \"425588f3-c856-4316-a776-7bf0cd239558\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:38.068929 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.068837 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/425588f3-c856-4316-a776-7bf0cd239558-cert\") pod \"lws-controller-manager-5f4484c748-6pb7x\" (UID: \"425588f3-c856-4316-a776-7bf0cd239558\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:38.068929 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.068896 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/425588f3-c856-4316-a776-7bf0cd239558-metrics-cert\") pod \"lws-controller-manager-5f4484c748-6pb7x\" (UID: \"425588f3-c856-4316-a776-7bf0cd239558\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:38.069502 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.069464 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/425588f3-c856-4316-a776-7bf0cd239558-manager-config\") pod \"lws-controller-manager-5f4484c748-6pb7x\" (UID: \"425588f3-c856-4316-a776-7bf0cd239558\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:38.071379 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.071352 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/425588f3-c856-4316-a776-7bf0cd239558-metrics-cert\") pod \"lws-controller-manager-5f4484c748-6pb7x\" (UID: \"425588f3-c856-4316-a776-7bf0cd239558\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:38.071546 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.071526 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/425588f3-c856-4316-a776-7bf0cd239558-cert\") pod \"lws-controller-manager-5f4484c748-6pb7x\" (UID: \"425588f3-c856-4316-a776-7bf0cd239558\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:38.083818 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.083794 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brg79\" (UniqueName: \"kubernetes.io/projected/425588f3-c856-4316-a776-7bf0cd239558-kube-api-access-brg79\") pod \"lws-controller-manager-5f4484c748-6pb7x\" (UID: \"425588f3-c856-4316-a776-7bf0cd239558\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:38.122573 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.122548 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg" Jun 09 00:07:38.135663 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.135639 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:38.203158 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.203048 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:38.256901 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.256794 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg"] Jun 09 00:07:38.260224 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:07:38.260189 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf8fa6092_7a47_4eab_883a_6d99c4fab20f.slice/crio-407eb4c24920a8698b41a7208b996a628c20033c06685d0b10691640c6ce048b WatchSource:0}: Error finding container 407eb4c24920a8698b41a7208b996a628c20033c06685d0b10691640c6ce048b: Status 404 returned error can't find the container with id 407eb4c24920a8698b41a7208b996a628c20033c06685d0b10691640c6ce048b Jun 09 00:07:38.356880 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.356799 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x"] Jun 09 00:07:38.359865 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:07:38.359822 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod425588f3_c856_4316_a776_7bf0cd239558.slice/crio-f5076fcac98cc452012e71f192dfdb7b55d90f62665808e610397fd977149807 WatchSource:0}: Error finding container f5076fcac98cc452012e71f192dfdb7b55d90f62665808e610397fd977149807: Status 404 returned error can't find the container with id f5076fcac98cc452012e71f192dfdb7b55d90f62665808e610397fd977149807 Jun 09 00:07:38.437097 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.437064 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" event={"ID":"425588f3-c856-4316-a776-7bf0cd239558","Type":"ContainerStarted","Data":"f5076fcac98cc452012e71f192dfdb7b55d90f62665808e610397fd977149807"} Jun 09 00:07:38.438333 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:38.438290 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg" event={"ID":"f8fa6092-7a47-4eab-883a-6d99c4fab20f","Type":"ContainerStarted","Data":"407eb4c24920a8698b41a7208b996a628c20033c06685d0b10691640c6ce048b"} Jun 09 00:07:39.032552 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:39.032507 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:39.081455 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:39.081411 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:41.458179 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:41.458080 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" event={"ID":"425588f3-c856-4316-a776-7bf0cd239558","Type":"ContainerStarted","Data":"98341b71761035e343c3fc53a0f9ce60588251548c3e93d178ba25b9605da490"} Jun 09 00:07:41.458179 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:41.458150 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:41.476046 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:41.475997 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" podStartSLOduration=1.824554606 podStartE2EDuration="4.47598189s" totalImagesPullingTime="2.651427284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:07:41.473467779 +0000 UTC m=+511.431735385" watchObservedRunningTime="2026-06-09 00:07:41.47598189 +0000 UTC m=+511.434249493" Jun 09 00:07:42.463827 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:42.463724 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg" event={"ID":"f8fa6092-7a47-4eab-883a-6d99c4fab20f","Type":"ContainerStarted","Data":"15ed555c1e8b247d1aacb4b91a676086aee60c87a0ce90975552b7290cc8af52"} Jun 09 00:07:42.464180 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:42.463876 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg" Jun 09 00:07:42.483098 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:42.483058 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg" podStartSLOduration=1.672589255 podStartE2EDuration="5.483044395s" totalImagesPullingTime="3.81045514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:07:42.482049081 +0000 UTC m=+512.440316687" watchObservedRunningTime="2026-06-09 00:07:42.483044395 +0000 UTC m=+512.441311999" Jun 09 00:07:48.285517 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:48.285478 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:48.411085 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:48.411052 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:49.348238 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:49.348201 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:50.402934 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.402887 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:50.516320 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.516273 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:50.540996 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.540968 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-679cf9c744-dxmlt"] Jun 09 00:07:50.543178 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.543163 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-679cf9c744-dxmlt" Jun 09 00:07:50.545963 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.545942 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 00:07:50.546070 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.546055 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dtb2r\"" Jun 09 00:07:50.553957 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.553940 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-679cf9c744-dxmlt"] Jun 09 00:07:50.602253 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.602227 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:50.683526 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.683461 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/bb2954fb-cf17-4c5a-8be8-8881f526c23a-redirect-config\") pod \"dashboard-redirect-679cf9c744-dxmlt\" (UID: \"bb2954fb-cf17-4c5a-8be8-8881f526c23a\") " pod="opendatahub/dashboard-redirect-679cf9c744-dxmlt" Jun 09 00:07:50.683526 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.683512 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmtwl\" (UniqueName: \"kubernetes.io/projected/bb2954fb-cf17-4c5a-8be8-8881f526c23a-kube-api-access-gmtwl\") pod \"dashboard-redirect-679cf9c744-dxmlt\" (UID: \"bb2954fb-cf17-4c5a-8be8-8881f526c23a\") " pod="opendatahub/dashboard-redirect-679cf9c744-dxmlt" Jun 09 00:07:50.784451 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.784420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/bb2954fb-cf17-4c5a-8be8-8881f526c23a-redirect-config\") pod \"dashboard-redirect-679cf9c744-dxmlt\" (UID: \"bb2954fb-cf17-4c5a-8be8-8881f526c23a\") " pod="opendatahub/dashboard-redirect-679cf9c744-dxmlt" Jun 09 00:07:50.784587 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.784472 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtwl\" (UniqueName: \"kubernetes.io/projected/bb2954fb-cf17-4c5a-8be8-8881f526c23a-kube-api-access-gmtwl\") pod \"dashboard-redirect-679cf9c744-dxmlt\" (UID: \"bb2954fb-cf17-4c5a-8be8-8881f526c23a\") " pod="opendatahub/dashboard-redirect-679cf9c744-dxmlt" Jun 09 00:07:50.785163 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.785143 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/bb2954fb-cf17-4c5a-8be8-8881f526c23a-redirect-config\") pod \"dashboard-redirect-679cf9c744-dxmlt\" (UID: \"bb2954fb-cf17-4c5a-8be8-8881f526c23a\") " pod="opendatahub/dashboard-redirect-679cf9c744-dxmlt" Jun 09 00:07:50.792853 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.792831 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmtwl\" (UniqueName: \"kubernetes.io/projected/bb2954fb-cf17-4c5a-8be8-8881f526c23a-kube-api-access-gmtwl\") pod \"dashboard-redirect-679cf9c744-dxmlt\" (UID: \"bb2954fb-cf17-4c5a-8be8-8881f526c23a\") " pod="opendatahub/dashboard-redirect-679cf9c744-dxmlt" Jun 09 00:07:50.854521 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.854495 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-679cf9c744-dxmlt" Jun 09 00:07:50.991752 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:50.991623 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-679cf9c744-dxmlt"] Jun 09 00:07:50.993913 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:07:50.993880 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb2954fb_cf17_4c5a_8be8_8881f526c23a.slice/crio-f0fc18169fab1c127cf7d8fe5d57ffb386e29fe27aebb60c28add376d3b515d7 WatchSource:0}: Error finding container f0fc18169fab1c127cf7d8fe5d57ffb386e29fe27aebb60c28add376d3b515d7: Status 404 returned error can't find the container with id f0fc18169fab1c127cf7d8fe5d57ffb386e29fe27aebb60c28add376d3b515d7 Jun 09 00:07:51.502755 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:51.502709 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-679cf9c744-dxmlt" event={"ID":"bb2954fb-cf17-4c5a-8be8-8881f526c23a","Type":"ContainerStarted","Data":"f0fc18169fab1c127cf7d8fe5d57ffb386e29fe27aebb60c28add376d3b515d7"} Jun 09 00:07:52.423034 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:52.422970 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:07:52.467109 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:52.467078 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f4484c748-6pb7x" Jun 09 00:07:53.514261 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:53.514226 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-679cf9c744-dxmlt" event={"ID":"bb2954fb-cf17-4c5a-8be8-8881f526c23a","Type":"ContainerStarted","Data":"a63d1ddb272520504940b0ab963af19994a478d1568f5c5b120dd6d386ce4c5d"} Jun 09 00:07:53.540791 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:07:53.540724 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-679cf9c744-dxmlt" podStartSLOduration=1.595914657 podStartE2EDuration="3.540708966s" totalImagesPullingTime="1.944794309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:07:53.539413919 +0000 UTC m=+523.497681522" watchObservedRunningTime="2026-06-09 00:07:53.540708966 +0000 UTC m=+523.498976569" Jun 09 00:08:02.763342 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:02.763298 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:02.829643 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:02.829614 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:02.930769 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:02.930716 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:03.323451 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:03.323417 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:07.687384 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:07.687346 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:07.787928 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:07.787898 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:07.942990 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:07.942905 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz"] Jun 09 00:08:07.945983 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:07.945961 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:07.948661 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:07.948643 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4fs2n\"" Jun 09 00:08:07.948792 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:07.948727 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 00:08:07.958111 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:07.958089 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz"] Jun 09 00:08:07.961437 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:07.961410 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:08.035274 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.035245 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c313963f-8d52-4937-a813-a47038d8a18c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.035414 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.035284 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.035414 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.035307 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c313963f-8d52-4937-a813-a47038d8a18c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.035414 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.035361 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.035586 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.035426 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.035586 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.035450 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c313963f-8d52-4937-a813-a47038d8a18c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.035586 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.035504 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.035586 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.035530 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlng7\" (UniqueName: \"kubernetes.io/projected/c313963f-8d52-4937-a813-a47038d8a18c-kube-api-access-rlng7\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.035586 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.035548 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.117249 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.117201 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:08.136250 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.136217 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c313963f-8d52-4937-a813-a47038d8a18c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.136423 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.136268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.136423 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.136306 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c313963f-8d52-4937-a813-a47038d8a18c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.136423 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.136361 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.136606 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.136437 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.136606 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.136473 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c313963f-8d52-4937-a813-a47038d8a18c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.136606 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.136517 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.136606 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.136556 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlng7\" (UniqueName: \"kubernetes.io/projected/c313963f-8d52-4937-a813-a47038d8a18c-kube-api-access-rlng7\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.136833 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.136644 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.136931 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.136881 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.137066 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.137046 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.137197 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.137134 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c313963f-8d52-4937-a813-a47038d8a18c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.137326 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.137301 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.137422 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.137406 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.139011 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.138994 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.139528 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.139508 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c313963f-8d52-4937-a813-a47038d8a18c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.154928 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.154902 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlng7\" (UniqueName: \"kubernetes.io/projected/c313963f-8d52-4937-a813-a47038d8a18c-kube-api-access-rlng7\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.155129 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.155110 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c313963f-8d52-4937-a813-a47038d8a18c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.219935 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.219843 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:08.256977 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.256951 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:08.387874 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.387830 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz"] Jun 09 00:08:08.390065 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:08:08.390037 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc313963f_8d52_4937_a813_a47038d8a18c.slice/crio-9fcb175a61307350c2701a763110e0cf160d95f71ad11b1ed187180b306084f1 WatchSource:0}: Error finding container 9fcb175a61307350c2701a763110e0cf160d95f71ad11b1ed187180b306084f1: Status 404 returned error can't find the container with id 9fcb175a61307350c2701a763110e0cf160d95f71ad11b1ed187180b306084f1 Jun 09 00:08:08.579414 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:08.579384 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" event={"ID":"c313963f-8d52-4937-a813-a47038d8a18c","Type":"ContainerStarted","Data":"9fcb175a61307350c2701a763110e0cf160d95f71ad11b1ed187180b306084f1"} Jun 09 00:08:11.182317 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:11.182279 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:11.294329 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:11.294296 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 00:08:11.294418 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:11.294364 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 00:08:11.294418 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:11.294390 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 00:08:11.593525 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:11.593489 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" event={"ID":"c313963f-8d52-4937-a813-a47038d8a18c","Type":"ContainerStarted","Data":"66855535944f27f58366b81ae12fa559a43402e4ea0591cd1edee5077ad5f26c"} Jun 09 00:08:11.624832 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:11.624784 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" podStartSLOduration=1.722776546 podStartE2EDuration="4.624769529s" totalImagesPullingTime="2.901992983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:08:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:08:11.622811422 +0000 UTC m=+541.581079028" watchObservedRunningTime="2026-06-09 00:08:11.624769529 +0000 UTC m=+541.583037133" Jun 09 00:08:12.257912 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:12.257881 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:12.258987 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:12.258959 2573 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jun 09 00:08:12.259109 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:12.259010 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" podUID="c313963f-8d52-4937-a813-a47038d8a18c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jun 09 00:08:13.258007 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:13.257971 2573 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jun 09 00:08:13.258410 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:13.258026 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" podUID="c313963f-8d52-4937-a813-a47038d8a18c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jun 09 00:08:13.470569 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:13.470537 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p8bjg" Jun 09 00:08:13.741357 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:13.741326 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz"] Jun 09 00:08:14.257374 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:14.257344 2573 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jun 09 00:08:14.257536 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:14.257401 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" podUID="c313963f-8d52-4937-a813-a47038d8a18c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jun 09 00:08:14.607345 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:14.607262 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" podUID="c313963f-8d52-4937-a813-a47038d8a18c" containerName="istio-proxy" containerID="cri-o://66855535944f27f58366b81ae12fa559a43402e4ea0591cd1edee5077ad5f26c" gracePeriod=30 Jun 09 00:08:19.864232 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.864207 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:19.938448 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.938380 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-istio-data\") pod \"c313963f-8d52-4937-a813-a47038d8a18c\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " Jun 09 00:08:19.938448 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.938427 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c313963f-8d52-4937-a813-a47038d8a18c-istiod-ca-cert\") pod \"c313963f-8d52-4937-a813-a47038d8a18c\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " Jun 09 00:08:19.938448 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.938453 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c313963f-8d52-4937-a813-a47038d8a18c-istio-token\") pod \"c313963f-8d52-4937-a813-a47038d8a18c\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " Jun 09 00:08:19.938643 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.938477 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-workload-certs\") pod \"c313963f-8d52-4937-a813-a47038d8a18c\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " Jun 09 00:08:19.938700 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.938668 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-istio-data" (OuterVolumeSpecName: "istio-data") pod "c313963f-8d52-4937-a813-a47038d8a18c" (UID: "c313963f-8d52-4937-a813-a47038d8a18c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:08:19.938700 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.938672 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c313963f-8d52-4937-a813-a47038d8a18c-istio-podinfo\") pod \"c313963f-8d52-4937-a813-a47038d8a18c\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " Jun 09 00:08:19.938835 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.938764 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-istio-envoy\") pod \"c313963f-8d52-4937-a813-a47038d8a18c\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " Jun 09 00:08:19.938835 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.938764 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c313963f-8d52-4937-a813-a47038d8a18c" (UID: "c313963f-8d52-4937-a813-a47038d8a18c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:08:19.938835 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.938788 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c313963f-8d52-4937-a813-a47038d8a18c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c313963f-8d52-4937-a813-a47038d8a18c" (UID: "c313963f-8d52-4937-a813-a47038d8a18c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:08:19.938835 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.938823 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-workload-socket\") pod \"c313963f-8d52-4937-a813-a47038d8a18c\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " Jun 09 00:08:19.939035 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.938850 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlng7\" (UniqueName: \"kubernetes.io/projected/c313963f-8d52-4937-a813-a47038d8a18c-kube-api-access-rlng7\") pod \"c313963f-8d52-4937-a813-a47038d8a18c\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " Jun 09 00:08:19.939035 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.938921 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-credential-socket\") pod \"c313963f-8d52-4937-a813-a47038d8a18c\" (UID: \"c313963f-8d52-4937-a813-a47038d8a18c\") " Jun 09 00:08:19.939035 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.938991 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c313963f-8d52-4937-a813-a47038d8a18c" (UID: "c313963f-8d52-4937-a813-a47038d8a18c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:08:19.939184 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.939165 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c313963f-8d52-4937-a813-a47038d8a18c" (UID: "c313963f-8d52-4937-a813-a47038d8a18c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:08:19.939412 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.939351 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-workload-socket\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:08:19.939412 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.939375 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-credential-socket\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:08:19.939412 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.939389 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-istio-data\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:08:19.939412 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.939402 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c313963f-8d52-4937-a813-a47038d8a18c-istiod-ca-cert\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:08:19.939412 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.939415 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-workload-certs\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:08:19.940880 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.940854 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c313963f-8d52-4937-a813-a47038d8a18c-istio-token" (OuterVolumeSpecName: "istio-token") pod "c313963f-8d52-4937-a813-a47038d8a18c" (UID: "c313963f-8d52-4937-a813-a47038d8a18c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:08:19.940992 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.940935 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c313963f-8d52-4937-a813-a47038d8a18c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c313963f-8d52-4937-a813-a47038d8a18c" (UID: "c313963f-8d52-4937-a813-a47038d8a18c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 09 00:08:19.940992 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.940977 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c313963f-8d52-4937-a813-a47038d8a18c" (UID: "c313963f-8d52-4937-a813-a47038d8a18c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:08:19.941174 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:19.941159 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c313963f-8d52-4937-a813-a47038d8a18c-kube-api-access-rlng7" (OuterVolumeSpecName: "kube-api-access-rlng7") pod "c313963f-8d52-4937-a813-a47038d8a18c" (UID: "c313963f-8d52-4937-a813-a47038d8a18c"). InnerVolumeSpecName "kube-api-access-rlng7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:08:20.040559 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:20.040535 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c313963f-8d52-4937-a813-a47038d8a18c-istio-token\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:08:20.040559 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:20.040557 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c313963f-8d52-4937-a813-a47038d8a18c-istio-podinfo\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:08:20.040559 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:20.040566 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c313963f-8d52-4937-a813-a47038d8a18c-istio-envoy\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:08:20.040764 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:20.040574 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlng7\" (UniqueName: \"kubernetes.io/projected/c313963f-8d52-4937-a813-a47038d8a18c-kube-api-access-rlng7\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:08:20.632584 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:20.632549 2573 generic.go:356] "Generic (PLEG): container finished" podID="c313963f-8d52-4937-a813-a47038d8a18c" containerID="66855535944f27f58366b81ae12fa559a43402e4ea0591cd1edee5077ad5f26c" exitCode=0 Jun 09 00:08:20.632762 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:20.632579 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" event={"ID":"c313963f-8d52-4937-a813-a47038d8a18c","Type":"ContainerDied","Data":"66855535944f27f58366b81ae12fa559a43402e4ea0591cd1edee5077ad5f26c"} Jun 09 00:08:20.632762 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:20.632606 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" Jun 09 00:08:20.632762 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:20.632633 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz" event={"ID":"c313963f-8d52-4937-a813-a47038d8a18c","Type":"ContainerDied","Data":"9fcb175a61307350c2701a763110e0cf160d95f71ad11b1ed187180b306084f1"} Jun 09 00:08:20.632762 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:20.632660 2573 scope.go:117] "RemoveContainer" containerID="66855535944f27f58366b81ae12fa559a43402e4ea0591cd1edee5077ad5f26c" Jun 09 00:08:20.642404 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:20.642380 2573 scope.go:117] "RemoveContainer" containerID="66855535944f27f58366b81ae12fa559a43402e4ea0591cd1edee5077ad5f26c" Jun 09 00:08:20.642608 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:08:20.642589 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66855535944f27f58366b81ae12fa559a43402e4ea0591cd1edee5077ad5f26c\": container with ID starting with 66855535944f27f58366b81ae12fa559a43402e4ea0591cd1edee5077ad5f26c not found: ID does not exist" containerID="66855535944f27f58366b81ae12fa559a43402e4ea0591cd1edee5077ad5f26c" Jun 09 00:08:20.642681 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:20.642633 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66855535944f27f58366b81ae12fa559a43402e4ea0591cd1edee5077ad5f26c"} err="failed to get container status \"66855535944f27f58366b81ae12fa559a43402e4ea0591cd1edee5077ad5f26c\": rpc error: code = NotFound desc = could not find container \"66855535944f27f58366b81ae12fa559a43402e4ea0591cd1edee5077ad5f26c\": container with ID starting with 66855535944f27f58366b81ae12fa559a43402e4ea0591cd1edee5077ad5f26c not found: ID does not exist" Jun 09 00:08:20.651140 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:20.651117 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz"] Jun 09 00:08:20.656535 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:20.656514 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-76bfbbd597b9rdz"] Jun 09 00:08:22.531374 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:22.531339 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c313963f-8d52-4937-a813-a47038d8a18c" path="/var/lib/kubelet/pods/c313963f-8d52-4937-a813-a47038d8a18c/volumes" Jun 09 00:08:29.670059 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:29.670021 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:29.767578 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:29.767540 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:29.795963 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:29.795933 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hxbq5"] Jun 09 00:08:29.796243 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:29.796232 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c313963f-8d52-4937-a813-a47038d8a18c" containerName="istio-proxy" Jun 09 00:08:29.796285 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:29.796244 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c313963f-8d52-4937-a813-a47038d8a18c" containerName="istio-proxy" Jun 09 00:08:29.796318 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:29.796313 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c313963f-8d52-4937-a813-a47038d8a18c" containerName="istio-proxy" Jun 09 00:08:29.808155 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:29.808132 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hxbq5" Jun 09 00:08:29.808717 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:29.808256 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hxbq5"] Jun 09 00:08:29.811353 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:29.811287 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-z5nwl\"" Jun 09 00:08:29.811353 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:29.811288 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 00:08:29.811541 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:29.811289 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 00:08:29.866059 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:29.866033 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:29.920541 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:29.920481 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2khk6\" (UniqueName: \"kubernetes.io/projected/9b812b1d-927c-42dc-88da-e3b96f2ad8c7-kube-api-access-2khk6\") pod \"kuadrant-operator-catalog-hxbq5\" (UID: \"9b812b1d-927c-42dc-88da-e3b96f2ad8c7\") " pod="kuadrant-system/kuadrant-operator-catalog-hxbq5" Jun 09 00:08:30.021885 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:30.021852 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2khk6\" (UniqueName: \"kubernetes.io/projected/9b812b1d-927c-42dc-88da-e3b96f2ad8c7-kube-api-access-2khk6\") pod \"kuadrant-operator-catalog-hxbq5\" (UID: \"9b812b1d-927c-42dc-88da-e3b96f2ad8c7\") " pod="kuadrant-system/kuadrant-operator-catalog-hxbq5" Jun 09 00:08:30.029555 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:30.029537 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2khk6\" (UniqueName: \"kubernetes.io/projected/9b812b1d-927c-42dc-88da-e3b96f2ad8c7-kube-api-access-2khk6\") pod \"kuadrant-operator-catalog-hxbq5\" (UID: \"9b812b1d-927c-42dc-88da-e3b96f2ad8c7\") " pod="kuadrant-system/kuadrant-operator-catalog-hxbq5" Jun 09 00:08:30.118670 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:30.118636 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hxbq5" Jun 09 00:08:30.167884 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:30.167853 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hxbq5"] Jun 09 00:08:30.246328 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:30.246304 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hxbq5"] Jun 09 00:08:30.248160 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:08:30.248133 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b812b1d_927c_42dc_88da_e3b96f2ad8c7.slice/crio-c79a57241fcef3bcc6f74b7b0dde09c159db7fc2cbe565f45f2919ef192e7509 WatchSource:0}: Error finding container c79a57241fcef3bcc6f74b7b0dde09c159db7fc2cbe565f45f2919ef192e7509: Status 404 returned error can't find the container with id c79a57241fcef3bcc6f74b7b0dde09c159db7fc2cbe565f45f2919ef192e7509 Jun 09 00:08:30.378089 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:30.378059 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgvmv"] Jun 09 00:08:30.382910 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:30.382894 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jgvmv" Jun 09 00:08:30.389896 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:30.389677 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgvmv"] Jun 09 00:08:30.526279 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:30.526250 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78cj2\" (UniqueName: \"kubernetes.io/projected/d6ca2ed7-e83c-422a-bbab-51f35745de69-kube-api-access-78cj2\") pod \"kuadrant-operator-catalog-jgvmv\" (UID: \"d6ca2ed7-e83c-422a-bbab-51f35745de69\") " pod="kuadrant-system/kuadrant-operator-catalog-jgvmv" Jun 09 00:08:30.627243 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:30.627212 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78cj2\" (UniqueName: \"kubernetes.io/projected/d6ca2ed7-e83c-422a-bbab-51f35745de69-kube-api-access-78cj2\") pod \"kuadrant-operator-catalog-jgvmv\" (UID: \"d6ca2ed7-e83c-422a-bbab-51f35745de69\") " pod="kuadrant-system/kuadrant-operator-catalog-jgvmv" Jun 09 00:08:30.640705 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:30.640668 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78cj2\" (UniqueName: \"kubernetes.io/projected/d6ca2ed7-e83c-422a-bbab-51f35745de69-kube-api-access-78cj2\") pod \"kuadrant-operator-catalog-jgvmv\" (UID: \"d6ca2ed7-e83c-422a-bbab-51f35745de69\") " pod="kuadrant-system/kuadrant-operator-catalog-jgvmv" Jun 09 00:08:30.676776 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:30.676734 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hxbq5" event={"ID":"9b812b1d-927c-42dc-88da-e3b96f2ad8c7","Type":"ContainerStarted","Data":"c79a57241fcef3bcc6f74b7b0dde09c159db7fc2cbe565f45f2919ef192e7509"} Jun 09 00:08:30.693116 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:30.693096 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jgvmv" Jun 09 00:08:30.823192 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:30.823169 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgvmv"] Jun 09 00:08:30.825486 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:08:30.825459 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ca2ed7_e83c_422a_bbab_51f35745de69.slice/crio-3b3f5dbc269430e8a7c578f1924ad1036f6a9b6ccbda74fa9187cdda40c7be3f WatchSource:0}: Error finding container 3b3f5dbc269430e8a7c578f1924ad1036f6a9b6ccbda74fa9187cdda40c7be3f: Status 404 returned error can't find the container with id 3b3f5dbc269430e8a7c578f1924ad1036f6a9b6ccbda74fa9187cdda40c7be3f Jun 09 00:08:31.683588 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:31.683554 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jgvmv" event={"ID":"d6ca2ed7-e83c-422a-bbab-51f35745de69","Type":"ContainerStarted","Data":"3b3f5dbc269430e8a7c578f1924ad1036f6a9b6ccbda74fa9187cdda40c7be3f"} Jun 09 00:08:32.696869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:32.696764 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jgvmv" event={"ID":"d6ca2ed7-e83c-422a-bbab-51f35745de69","Type":"ContainerStarted","Data":"cbfb2b3e2fd9c47944bca3620827d76e1dd1e6a16afcf0226455f4028c2e6c38"} Jun 09 00:08:32.698128 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:32.698099 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hxbq5" event={"ID":"9b812b1d-927c-42dc-88da-e3b96f2ad8c7","Type":"ContainerStarted","Data":"cbfc1d9787f1e54a5f4ad62fca1c99b7d1d0016cbb5020e821d8f2ded6236bde"} Jun 09 00:08:32.698243 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:32.698196 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hxbq5" podUID="9b812b1d-927c-42dc-88da-e3b96f2ad8c7" containerName="registry-server" containerID="cri-o://cbfc1d9787f1e54a5f4ad62fca1c99b7d1d0016cbb5020e821d8f2ded6236bde" gracePeriod=2 Jun 09 00:08:32.711838 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:32.711799 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jgvmv" podStartSLOduration=1.240331774 podStartE2EDuration="2.711785555s" totalImagesPullingTime="1.471453781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:08:32.709860384 +0000 UTC m=+562.668127991" watchObservedRunningTime="2026-06-09 00:08:32.711785555 +0000 UTC m=+562.670053159" Jun 09 00:08:32.724448 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:32.724412 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hxbq5" podStartSLOduration=1.675639181 podStartE2EDuration="3.724399642s" totalImagesPullingTime="2.048760461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:08:32.722889492 +0000 UTC m=+562.681157093" watchObservedRunningTime="2026-06-09 00:08:32.724399642 +0000 UTC m=+562.682667246" Jun 09 00:08:32.936294 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:32.936272 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hxbq5" Jun 09 00:08:33.047627 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:33.047585 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2khk6\" (UniqueName: \"kubernetes.io/projected/9b812b1d-927c-42dc-88da-e3b96f2ad8c7-kube-api-access-2khk6\") pod \"9b812b1d-927c-42dc-88da-e3b96f2ad8c7\" (UID: \"9b812b1d-927c-42dc-88da-e3b96f2ad8c7\") " Jun 09 00:08:33.049885 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:33.049859 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b812b1d-927c-42dc-88da-e3b96f2ad8c7-kube-api-access-2khk6" (OuterVolumeSpecName: "kube-api-access-2khk6") pod "9b812b1d-927c-42dc-88da-e3b96f2ad8c7" (UID: "9b812b1d-927c-42dc-88da-e3b96f2ad8c7"). InnerVolumeSpecName "kube-api-access-2khk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:08:33.149088 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:33.149065 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2khk6\" (UniqueName: \"kubernetes.io/projected/9b812b1d-927c-42dc-88da-e3b96f2ad8c7-kube-api-access-2khk6\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:08:33.703841 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:33.703760 2573 generic.go:356] "Generic (PLEG): container finished" podID="9b812b1d-927c-42dc-88da-e3b96f2ad8c7" containerID="cbfc1d9787f1e54a5f4ad62fca1c99b7d1d0016cbb5020e821d8f2ded6236bde" exitCode=0 Jun 09 00:08:33.703841 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:33.703801 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hxbq5" Jun 09 00:08:33.704308 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:33.703837 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hxbq5" event={"ID":"9b812b1d-927c-42dc-88da-e3b96f2ad8c7","Type":"ContainerDied","Data":"cbfc1d9787f1e54a5f4ad62fca1c99b7d1d0016cbb5020e821d8f2ded6236bde"} Jun 09 00:08:33.704308 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:33.703885 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hxbq5" event={"ID":"9b812b1d-927c-42dc-88da-e3b96f2ad8c7","Type":"ContainerDied","Data":"c79a57241fcef3bcc6f74b7b0dde09c159db7fc2cbe565f45f2919ef192e7509"} Jun 09 00:08:33.704308 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:33.703908 2573 scope.go:117] "RemoveContainer" containerID="cbfc1d9787f1e54a5f4ad62fca1c99b7d1d0016cbb5020e821d8f2ded6236bde" Jun 09 00:08:33.713534 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:33.713517 2573 scope.go:117] "RemoveContainer" containerID="cbfc1d9787f1e54a5f4ad62fca1c99b7d1d0016cbb5020e821d8f2ded6236bde" Jun 09 00:08:33.713789 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:08:33.713774 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbfc1d9787f1e54a5f4ad62fca1c99b7d1d0016cbb5020e821d8f2ded6236bde\": container with ID starting with cbfc1d9787f1e54a5f4ad62fca1c99b7d1d0016cbb5020e821d8f2ded6236bde not found: ID does not exist" containerID="cbfc1d9787f1e54a5f4ad62fca1c99b7d1d0016cbb5020e821d8f2ded6236bde" Jun 09 00:08:33.713853 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:33.713795 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbfc1d9787f1e54a5f4ad62fca1c99b7d1d0016cbb5020e821d8f2ded6236bde"} err="failed to get container status \"cbfc1d9787f1e54a5f4ad62fca1c99b7d1d0016cbb5020e821d8f2ded6236bde\": rpc error: code = NotFound desc = could not find container \"cbfc1d9787f1e54a5f4ad62fca1c99b7d1d0016cbb5020e821d8f2ded6236bde\": container with ID starting with cbfc1d9787f1e54a5f4ad62fca1c99b7d1d0016cbb5020e821d8f2ded6236bde not found: ID does not exist" Jun 09 00:08:33.724149 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:33.724128 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hxbq5"] Jun 09 00:08:33.726495 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:33.726472 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hxbq5"] Jun 09 00:08:34.531479 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:34.531448 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b812b1d-927c-42dc-88da-e3b96f2ad8c7" path="/var/lib/kubelet/pods/9b812b1d-927c-42dc-88da-e3b96f2ad8c7/volumes" Jun 09 00:08:40.693905 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:40.693872 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-jgvmv" Jun 09 00:08:40.694326 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:40.693924 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-jgvmv" Jun 09 00:08:40.718067 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:40.718046 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-jgvmv" Jun 09 00:08:40.757640 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:40.757615 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-jgvmv" Jun 09 00:08:41.542641 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:41.542608 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:43.078968 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:43.078916 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:43.179556 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:43.179522 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:52.219778 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:52.219719 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:52.281383 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:52.281350 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:52.841477 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:52.841445 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:54.747104 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:54.747065 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:57.493053 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.493014 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq"] Jun 09 00:08:57.493643 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.493350 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b812b1d-927c-42dc-88da-e3b96f2ad8c7" containerName="registry-server" Jun 09 00:08:57.493643 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.493361 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b812b1d-927c-42dc-88da-e3b96f2ad8c7" containerName="registry-server" Jun 09 00:08:57.493643 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.493423 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b812b1d-927c-42dc-88da-e3b96f2ad8c7" containerName="registry-server" Jun 09 00:08:57.496428 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.496411 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:08:57.498897 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.498874 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zvsct\"" Jun 09 00:08:57.512718 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.512698 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq"] Jun 09 00:08:57.648028 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.648001 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qq5l\" (UniqueName: \"kubernetes.io/projected/cf75b093-b35c-4f66-a156-880220320453-kube-api-access-7qq5l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" (UID: \"cf75b093-b35c-4f66-a156-880220320453\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:08:57.648169 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.648093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf75b093-b35c-4f66-a156-880220320453-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" (UID: \"cf75b093-b35c-4f66-a156-880220320453\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:08:57.749086 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.749008 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf75b093-b35c-4f66-a156-880220320453-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" (UID: \"cf75b093-b35c-4f66-a156-880220320453\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:08:57.749086 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.749059 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qq5l\" (UniqueName: \"kubernetes.io/projected/cf75b093-b35c-4f66-a156-880220320453-kube-api-access-7qq5l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" (UID: \"cf75b093-b35c-4f66-a156-880220320453\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:08:57.749388 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.749367 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf75b093-b35c-4f66-a156-880220320453-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" (UID: \"cf75b093-b35c-4f66-a156-880220320453\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:08:57.776137 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.776107 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qq5l\" (UniqueName: \"kubernetes.io/projected/cf75b093-b35c-4f66-a156-880220320453-kube-api-access-7qq5l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" (UID: \"cf75b093-b35c-4f66-a156-880220320453\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:08:57.806217 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.806195 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:08:57.824066 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.824027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:57.936403 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:57.936370 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq"] Jun 09 00:08:57.939604 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:08:57.939572 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf75b093_b35c_4f66_a156_880220320453.slice/crio-c82f7221d5ccc750b9f28fbc5f97c99790aff6d6566e3678e14835cc9845af13 WatchSource:0}: Error finding container c82f7221d5ccc750b9f28fbc5f97c99790aff6d6566e3678e14835cc9845af13: Status 404 returned error can't find the container with id c82f7221d5ccc750b9f28fbc5f97c99790aff6d6566e3678e14835cc9845af13 Jun 09 00:08:58.206594 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:58.206512 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:08:58.823041 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:08:58.823012 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" event={"ID":"cf75b093-b35c-4f66-a156-880220320453","Type":"ContainerStarted","Data":"c82f7221d5ccc750b9f28fbc5f97c99790aff6d6566e3678e14835cc9845af13"} Jun 09 00:09:00.065140 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:00.065095 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:01.006169 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:01.006099 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:02.862823 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:02.862788 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g"] Jun 09 00:09:02.866307 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:02.866287 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:02.868661 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:02.868633 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-c7vcv\"" Jun 09 00:09:02.873346 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:02.873042 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g"] Jun 09 00:09:02.889803 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:02.889767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw8v5\" (UniqueName: \"kubernetes.io/projected/b77fa3e6-2c29-436c-bb55-fcc3530de8a3-kube-api-access-bw8v5\") pod \"limitador-operator-controller-manager-859d7b78bd-h8p7g\" (UID: \"b77fa3e6-2c29-436c-bb55-fcc3530de8a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:02.991115 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:02.991089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw8v5\" (UniqueName: \"kubernetes.io/projected/b77fa3e6-2c29-436c-bb55-fcc3530de8a3-kube-api-access-bw8v5\") pod \"limitador-operator-controller-manager-859d7b78bd-h8p7g\" (UID: \"b77fa3e6-2c29-436c-bb55-fcc3530de8a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:03.000104 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:03.000083 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw8v5\" (UniqueName: \"kubernetes.io/projected/b77fa3e6-2c29-436c-bb55-fcc3530de8a3-kube-api-access-bw8v5\") pod \"limitador-operator-controller-manager-859d7b78bd-h8p7g\" (UID: \"b77fa3e6-2c29-436c-bb55-fcc3530de8a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:03.177398 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:03.177322 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:03.265295 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:03.265239 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:03.321899 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:03.321818 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g"] Jun 09 00:09:03.324637 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:09:03.324597 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77fa3e6_2c29_436c_bb55_fcc3530de8a3.slice/crio-728fd16073d3229a28e50a67e95573d091abeb9cb38683122294c1311ca410b9 WatchSource:0}: Error finding container 728fd16073d3229a28e50a67e95573d091abeb9cb38683122294c1311ca410b9: Status 404 returned error can't find the container with id 728fd16073d3229a28e50a67e95573d091abeb9cb38683122294c1311ca410b9 Jun 09 00:09:03.415668 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:03.415637 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:03.846792 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:03.846760 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" event={"ID":"b77fa3e6-2c29-436c-bb55-fcc3530de8a3","Type":"ContainerStarted","Data":"728fd16073d3229a28e50a67e95573d091abeb9cb38683122294c1311ca410b9"} Jun 09 00:09:06.138670 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:06.138574 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:06.864033 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:06.863996 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" event={"ID":"cf75b093-b35c-4f66-a156-880220320453","Type":"ContainerStarted","Data":"3d5b6899975fc863463f07fc718c8a400b825871ca6ba08588af250a665d457d"} Jun 09 00:09:06.864239 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:06.864215 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:06.865627 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:06.865591 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" event={"ID":"b77fa3e6-2c29-436c-bb55-fcc3530de8a3","Type":"ContainerStarted","Data":"6d57736a1dfa13638f6e1676572ab8b5dd677d869621fd84ff864b5f5951b8de"} Jun 09 00:09:06.865767 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:06.865695 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:06.881852 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:06.881811 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" podStartSLOduration=1.9868619920000001 podStartE2EDuration="9.881798939s" totalImagesPullingTime="7.894936947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:09:06.880397846 +0000 UTC m=+596.838665452" watchObservedRunningTime="2026-06-09 00:09:06.881798939 +0000 UTC m=+596.840066542" Jun 09 00:09:06.898169 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:06.898126 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" podStartSLOduration=2.3943311400000002 podStartE2EDuration="4.898107657s" totalImagesPullingTime="2.503776517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:09:06.897250513 +0000 UTC m=+596.855518114" watchObservedRunningTime="2026-06-09 00:09:06.898107657 +0000 UTC m=+596.856375258" Jun 09 00:09:07.804355 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:07.804316 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:07.856433 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:07.856375 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:08.699246 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.699214 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k"] Jun 09 00:09:08.702677 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.702654 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k" Jun 09 00:09:08.705014 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.704979 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 00:09:08.705332 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.705303 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8thkf\"" Jun 09 00:09:08.705454 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.705339 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 00:09:08.705868 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.705843 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:08.713493 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.713469 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k"] Jun 09 00:09:08.744347 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.744321 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82b595b6-4056-44f1-8710-a4475a554612-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5v54k\" (UID: \"82b595b6-4056-44f1-8710-a4475a554612\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k" Jun 09 00:09:08.744460 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.744355 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/82b595b6-4056-44f1-8710-a4475a554612-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5v54k\" (UID: \"82b595b6-4056-44f1-8710-a4475a554612\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k" Jun 09 00:09:08.744460 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.744381 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2tff\" (UniqueName: \"kubernetes.io/projected/82b595b6-4056-44f1-8710-a4475a554612-kube-api-access-z2tff\") pod \"kuadrant-console-plugin-66b5774985-5v54k\" (UID: \"82b595b6-4056-44f1-8710-a4475a554612\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k" Jun 09 00:09:08.845451 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.845423 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2tff\" (UniqueName: \"kubernetes.io/projected/82b595b6-4056-44f1-8710-a4475a554612-kube-api-access-z2tff\") pod \"kuadrant-console-plugin-66b5774985-5v54k\" (UID: \"82b595b6-4056-44f1-8710-a4475a554612\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k" Jun 09 00:09:08.845796 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.845481 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82b595b6-4056-44f1-8710-a4475a554612-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5v54k\" (UID: \"82b595b6-4056-44f1-8710-a4475a554612\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k" Jun 09 00:09:08.845796 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.845506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/82b595b6-4056-44f1-8710-a4475a554612-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5v54k\" (UID: \"82b595b6-4056-44f1-8710-a4475a554612\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k" Jun 09 00:09:08.846230 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.846211 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82b595b6-4056-44f1-8710-a4475a554612-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5v54k\" (UID: \"82b595b6-4056-44f1-8710-a4475a554612\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k" Jun 09 00:09:08.848187 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.848164 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/82b595b6-4056-44f1-8710-a4475a554612-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5v54k\" (UID: \"82b595b6-4056-44f1-8710-a4475a554612\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k" Jun 09 00:09:08.853664 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.853638 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2tff\" (UniqueName: \"kubernetes.io/projected/82b595b6-4056-44f1-8710-a4475a554612-kube-api-access-z2tff\") pod \"kuadrant-console-plugin-66b5774985-5v54k\" (UID: \"82b595b6-4056-44f1-8710-a4475a554612\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k" Jun 09 00:09:08.868825 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:08.868798 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:09.020698 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:09.020673 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k" Jun 09 00:09:09.145146 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:09.145121 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k"] Jun 09 00:09:09.147784 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:09:09.147756 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82b595b6_4056_44f1_8710_a4475a554612.slice/crio-49c08a7580ec41d9951eafe1d2f8bba0e36214299f1d2ff8bb393aab92494bba WatchSource:0}: Error finding container 49c08a7580ec41d9951eafe1d2f8bba0e36214299f1d2ff8bb393aab92494bba: Status 404 returned error can't find the container with id 49c08a7580ec41d9951eafe1d2f8bba0e36214299f1d2ff8bb393aab92494bba Jun 09 00:09:09.880275 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:09.880241 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k" event={"ID":"82b595b6-4056-44f1-8710-a4475a554612","Type":"ContainerStarted","Data":"49c08a7580ec41d9951eafe1d2f8bba0e36214299f1d2ff8bb393aab92494bba"} Jun 09 00:09:10.509258 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:10.509229 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/2.log" Jun 09 00:09:10.509602 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:10.509583 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/2.log" Jun 09 00:09:10.516011 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:10.515988 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-twgfd_219c3767-e998-4f79-a227-45681847cac2/ovn-acl-logging/0.log" Jun 09 00:09:10.516871 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:10.516848 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-twgfd_219c3767-e998-4f79-a227-45681847cac2/ovn-acl-logging/0.log" Jun 09 00:09:17.230598 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:17.230559 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:17.872698 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:17.872661 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:17.872912 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:17.872784 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:18.521589 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:18.521549 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:18.973768 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:18.973721 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn"] Jun 09 00:09:18.977332 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:18.977313 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:18.996985 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:18.996959 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn"] Jun 09 00:09:19.045067 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.045040 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkb79\" (UniqueName: \"kubernetes.io/projected/01c4b51d-24ff-4a74-ab75-cb61017e1b98-kube-api-access-nkb79\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jrlvn\" (UID: \"01c4b51d-24ff-4a74-ab75-cb61017e1b98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:19.045174 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.045111 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01c4b51d-24ff-4a74-ab75-cb61017e1b98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jrlvn\" (UID: \"01c4b51d-24ff-4a74-ab75-cb61017e1b98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:19.146110 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.146073 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01c4b51d-24ff-4a74-ab75-cb61017e1b98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jrlvn\" (UID: \"01c4b51d-24ff-4a74-ab75-cb61017e1b98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:19.146262 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.146155 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkb79\" (UniqueName: \"kubernetes.io/projected/01c4b51d-24ff-4a74-ab75-cb61017e1b98-kube-api-access-nkb79\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jrlvn\" (UID: \"01c4b51d-24ff-4a74-ab75-cb61017e1b98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:19.146488 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.146466 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01c4b51d-24ff-4a74-ab75-cb61017e1b98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jrlvn\" (UID: \"01c4b51d-24ff-4a74-ab75-cb61017e1b98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:19.164968 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.164905 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkb79\" (UniqueName: \"kubernetes.io/projected/01c4b51d-24ff-4a74-ab75-cb61017e1b98-kube-api-access-nkb79\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jrlvn\" (UID: \"01c4b51d-24ff-4a74-ab75-cb61017e1b98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:19.172723 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.172699 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn"] Jun 09 00:09:19.173060 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.173037 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:19.216830 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.216796 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp"] Jun 09 00:09:19.222185 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.222163 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:19.236648 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.236513 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp"] Jun 09 00:09:19.331259 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.331237 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn"] Jun 09 00:09:19.333819 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:09:19.333791 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c4b51d_24ff_4a74_ab75_cb61017e1b98.slice/crio-04d255e45c8fd523401a70c24283bdb4044d6dc5ee0cf9ea5dcea389ba38ab57 WatchSource:0}: Error finding container 04d255e45c8fd523401a70c24283bdb4044d6dc5ee0cf9ea5dcea389ba38ab57: Status 404 returned error can't find the container with id 04d255e45c8fd523401a70c24283bdb4044d6dc5ee0cf9ea5dcea389ba38ab57 Jun 09 00:09:19.348209 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.348185 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tvmdp\" (UID: \"b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:19.348319 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.348233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ddxx\" (UniqueName: \"kubernetes.io/projected/b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b-kube-api-access-2ddxx\") pod \"kuadrant-operator-controller-manager-55467d9f7-tvmdp\" (UID: \"b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:19.449231 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.449200 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tvmdp\" (UID: \"b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:19.449390 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.449257 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ddxx\" (UniqueName: \"kubernetes.io/projected/b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b-kube-api-access-2ddxx\") pod \"kuadrant-operator-controller-manager-55467d9f7-tvmdp\" (UID: \"b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:19.449885 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.449847 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tvmdp\" (UID: \"b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:19.458428 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.458405 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ddxx\" (UniqueName: \"kubernetes.io/projected/b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b-kube-api-access-2ddxx\") pod \"kuadrant-operator-controller-manager-55467d9f7-tvmdp\" (UID: \"b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:19.487716 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.487523 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp"] Jun 09 00:09:19.487878 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.487854 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:19.491236 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.491218 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp"] Jun 09 00:09:19.499405 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.499343 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn"] Jun 09 00:09:19.510760 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.510067 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn"] Jun 09 00:09:19.512633 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.512597 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg"] Jun 09 00:09:19.513140 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.513122 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c4b51d-24ff-4a74-ab75-cb61017e1b98" containerName="manager" Jun 09 00:09:19.513291 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.513273 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c4b51d-24ff-4a74-ab75-cb61017e1b98" containerName="manager" Jun 09 00:09:19.513428 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.513415 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="01c4b51d-24ff-4a74-ab75-cb61017e1b98" containerName="manager" Jun 09 00:09:19.518013 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.517992 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" Jun 09 00:09:19.520220 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.520198 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq"] Jun 09 00:09:19.520413 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.520388 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" podUID="cf75b093-b35c-4f66-a156-880220320453" containerName="manager" containerID="cri-o://3d5b6899975fc863463f07fc718c8a400b825871ca6ba08588af250a665d457d" gracePeriod=2 Jun 09 00:09:19.527129 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.527109 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg"] Jun 09 00:09:19.537374 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.536515 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq"] Jun 09 00:09:19.544929 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.544905 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf"] Jun 09 00:09:19.545451 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.545431 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf75b093-b35c-4f66-a156-880220320453" containerName="manager" Jun 09 00:09:19.545541 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.545453 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf75b093-b35c-4f66-a156-880220320453" containerName="manager" Jun 09 00:09:19.545599 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.545555 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf75b093-b35c-4f66-a156-880220320453" containerName="manager" Jun 09 00:09:19.549309 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.549043 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g"] Jun 09 00:09:19.549309 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.549198 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" containerName="manager" containerID="cri-o://6d57736a1dfa13638f6e1676572ab8b5dd677d869621fd84ff864b5f5951b8de" gracePeriod=2 Jun 09 00:09:19.549712 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.549691 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" Jun 09 00:09:19.551728 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.551679 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="cf75b093-b35c-4f66-a156-880220320453" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:19.561047 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.560423 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g"] Jun 09 00:09:19.562582 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.562559 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf"] Jun 09 00:09:19.562669 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.562617 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="cf75b093-b35c-4f66-a156-880220320453" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:19.564785 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.564755 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h8p7g\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:19.650943 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.650912 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51d5cb27-ba20-4bc6-ad8a-7438d24718c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-r2xhg\" (UID: \"51d5cb27-ba20-4bc6-ad8a-7438d24718c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" Jun 09 00:09:19.651082 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.650957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m62x\" (UniqueName: \"kubernetes.io/projected/51d5cb27-ba20-4bc6-ad8a-7438d24718c4-kube-api-access-8m62x\") pod \"kuadrant-operator-controller-manager-55467d9f7-r2xhg\" (UID: \"51d5cb27-ba20-4bc6-ad8a-7438d24718c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" Jun 09 00:09:19.651082 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.651056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/676d224b-1e7a-4b2b-acc9-22b9415e754a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wv5pf\" (UID: \"676d224b-1e7a-4b2b-acc9-22b9415e754a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" Jun 09 00:09:19.651201 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.651098 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcwnj\" (UniqueName: \"kubernetes.io/projected/676d224b-1e7a-4b2b-acc9-22b9415e754a-kube-api-access-vcwnj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wv5pf\" (UID: \"676d224b-1e7a-4b2b-acc9-22b9415e754a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" Jun 09 00:09:19.752406 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.752330 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/676d224b-1e7a-4b2b-acc9-22b9415e754a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wv5pf\" (UID: \"676d224b-1e7a-4b2b-acc9-22b9415e754a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" Jun 09 00:09:19.752544 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.752512 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcwnj\" (UniqueName: \"kubernetes.io/projected/676d224b-1e7a-4b2b-acc9-22b9415e754a-kube-api-access-vcwnj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wv5pf\" (UID: \"676d224b-1e7a-4b2b-acc9-22b9415e754a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" Jun 09 00:09:19.752612 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.752585 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51d5cb27-ba20-4bc6-ad8a-7438d24718c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-r2xhg\" (UID: \"51d5cb27-ba20-4bc6-ad8a-7438d24718c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" Jun 09 00:09:19.752677 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.752623 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m62x\" (UniqueName: \"kubernetes.io/projected/51d5cb27-ba20-4bc6-ad8a-7438d24718c4-kube-api-access-8m62x\") pod \"kuadrant-operator-controller-manager-55467d9f7-r2xhg\" (UID: \"51d5cb27-ba20-4bc6-ad8a-7438d24718c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" Jun 09 00:09:19.753199 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.752778 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/676d224b-1e7a-4b2b-acc9-22b9415e754a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wv5pf\" (UID: \"676d224b-1e7a-4b2b-acc9-22b9415e754a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" Jun 09 00:09:19.753199 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.753134 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51d5cb27-ba20-4bc6-ad8a-7438d24718c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-r2xhg\" (UID: \"51d5cb27-ba20-4bc6-ad8a-7438d24718c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" Jun 09 00:09:19.761141 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.760955 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m62x\" (UniqueName: \"kubernetes.io/projected/51d5cb27-ba20-4bc6-ad8a-7438d24718c4-kube-api-access-8m62x\") pod \"kuadrant-operator-controller-manager-55467d9f7-r2xhg\" (UID: \"51d5cb27-ba20-4bc6-ad8a-7438d24718c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" Jun 09 00:09:19.761290 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.761268 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcwnj\" (UniqueName: \"kubernetes.io/projected/676d224b-1e7a-4b2b-acc9-22b9415e754a-kube-api-access-vcwnj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wv5pf\" (UID: \"676d224b-1e7a-4b2b-acc9-22b9415e754a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" Jun 09 00:09:19.789794 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.789773 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:19.791983 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.791953 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="cf75b093-b35c-4f66-a156-880220320453" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:19.793792 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.793762 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h8p7g\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:19.802717 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.802696 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:19.804731 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.804703 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="cf75b093-b35c-4f66-a156-880220320453" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:19.806498 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.806472 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h8p7g\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:19.833725 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.833699 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" Jun 09 00:09:19.853838 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.853816 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf75b093-b35c-4f66-a156-880220320453-extensions-socket-volume\") pod \"cf75b093-b35c-4f66-a156-880220320453\" (UID: \"cf75b093-b35c-4f66-a156-880220320453\") " Jun 09 00:09:19.853940 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.853876 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qq5l\" (UniqueName: \"kubernetes.io/projected/cf75b093-b35c-4f66-a156-880220320453-kube-api-access-7qq5l\") pod \"cf75b093-b35c-4f66-a156-880220320453\" (UID: \"cf75b093-b35c-4f66-a156-880220320453\") " Jun 09 00:09:19.854235 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.854209 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf75b093-b35c-4f66-a156-880220320453-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cf75b093-b35c-4f66-a156-880220320453" (UID: "cf75b093-b35c-4f66-a156-880220320453"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:09:19.856722 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.856687 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf75b093-b35c-4f66-a156-880220320453-kube-api-access-7qq5l" (OuterVolumeSpecName: "kube-api-access-7qq5l") pod "cf75b093-b35c-4f66-a156-880220320453" (UID: "cf75b093-b35c-4f66-a156-880220320453"). InnerVolumeSpecName "kube-api-access-7qq5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:09:19.935062 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.934929 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" Jun 09 00:09:19.935207 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.935143 2573 generic.go:356] "Generic (PLEG): container finished" podID="cf75b093-b35c-4f66-a156-880220320453" containerID="3d5b6899975fc863463f07fc718c8a400b825871ca6ba08588af250a665d457d" exitCode=0 Jun 09 00:09:19.935282 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.935202 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:19.935282 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.935254 2573 scope.go:117] "RemoveContainer" containerID="3d5b6899975fc863463f07fc718c8a400b825871ca6ba08588af250a665d457d" Jun 09 00:09:19.938165 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.937972 2573 generic.go:356] "Generic (PLEG): container finished" podID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" containerID="6d57736a1dfa13638f6e1676572ab8b5dd677d869621fd84ff864b5f5951b8de" exitCode=0 Jun 09 00:09:19.938165 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.938020 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:19.938165 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.938137 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h8p7g\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:19.940329 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.940144 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="cf75b093-b35c-4f66-a156-880220320453" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:19.940329 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.940310 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" podUID="01c4b51d-24ff-4a74-ab75-cb61017e1b98" containerName="manager" containerID="cri-o://748f1d680d88ce905032392a9138c53963daad3a420aab0ab8a19abcc270c053" gracePeriod=10 Jun 09 00:09:19.942541 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.942426 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="cf75b093-b35c-4f66-a156-880220320453" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:19.944413 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.944384 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h8p7g\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:19.946341 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.946172 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="cf75b093-b35c-4f66-a156-880220320453" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:19.948033 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.947952 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h8p7g\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:19.949883 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.949768 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jrlvn\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="01c4b51d-24ff-4a74-ab75-cb61017e1b98" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:19.952268 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.952247 2573 scope.go:117] "RemoveContainer" containerID="3d5b6899975fc863463f07fc718c8a400b825871ca6ba08588af250a665d457d" Jun 09 00:09:19.952718 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.952692 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d5b6899975fc863463f07fc718c8a400b825871ca6ba08588af250a665d457d\": container with ID starting with 3d5b6899975fc863463f07fc718c8a400b825871ca6ba08588af250a665d457d not found: ID does not exist" containerID="3d5b6899975fc863463f07fc718c8a400b825871ca6ba08588af250a665d457d" Jun 09 00:09:19.952819 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.952730 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5b6899975fc863463f07fc718c8a400b825871ca6ba08588af250a665d457d"} err="failed to get container status \"3d5b6899975fc863463f07fc718c8a400b825871ca6ba08588af250a665d457d\": rpc error: code = NotFound desc = could not find container \"3d5b6899975fc863463f07fc718c8a400b825871ca6ba08588af250a665d457d\": container with ID starting with 3d5b6899975fc863463f07fc718c8a400b825871ca6ba08588af250a665d457d not found: ID does not exist" Jun 09 00:09:19.952819 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.952774 2573 scope.go:117] "RemoveContainer" containerID="6d57736a1dfa13638f6e1676572ab8b5dd677d869621fd84ff864b5f5951b8de" Jun 09 00:09:19.955294 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.955168 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="cf75b093-b35c-4f66-a156-880220320453" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:19.955294 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.955195 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw8v5\" (UniqueName: \"kubernetes.io/projected/b77fa3e6-2c29-436c-bb55-fcc3530de8a3-kube-api-access-bw8v5\") pod \"b77fa3e6-2c29-436c-bb55-fcc3530de8a3\" (UID: \"b77fa3e6-2c29-436c-bb55-fcc3530de8a3\") " Jun 09 00:09:19.955527 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.955421 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf75b093-b35c-4f66-a156-880220320453-extensions-socket-volume\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:09:19.955527 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.955441 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qq5l\" (UniqueName: \"kubernetes.io/projected/cf75b093-b35c-4f66-a156-880220320453-kube-api-access-7qq5l\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:09:19.957020 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.956993 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h8p7g\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:19.957579 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.957542 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b77fa3e6-2c29-436c-bb55-fcc3530de8a3-kube-api-access-bw8v5" (OuterVolumeSpecName: "kube-api-access-bw8v5") pod "b77fa3e6-2c29-436c-bb55-fcc3530de8a3" (UID: "b77fa3e6-2c29-436c-bb55-fcc3530de8a3"). InnerVolumeSpecName "kube-api-access-bw8v5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:09:19.958671 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:19.958648 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jrlvn\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="01c4b51d-24ff-4a74-ab75-cb61017e1b98" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:19.984136 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:19.984108 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg"] Jun 09 00:09:19.989606 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:09:19.989579 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d5cb27_ba20_4bc6_ad8a_7438d24718c4.slice/crio-44a898923a102940336aa65e740c45696554df2815bb08d3b611a6b435373d30 WatchSource:0}: Error finding container 44a898923a102940336aa65e740c45696554df2815bb08d3b611a6b435373d30: Status 404 returned error can't find the container with id 44a898923a102940336aa65e740c45696554df2815bb08d3b611a6b435373d30 Jun 09 00:09:20.053561 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.053529 2573 scope.go:117] "RemoveContainer" containerID="6d57736a1dfa13638f6e1676572ab8b5dd677d869621fd84ff864b5f5951b8de" Jun 09 00:09:20.054731 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:20.054687 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d57736a1dfa13638f6e1676572ab8b5dd677d869621fd84ff864b5f5951b8de\": container with ID starting with 6d57736a1dfa13638f6e1676572ab8b5dd677d869621fd84ff864b5f5951b8de not found: ID does not exist" containerID="6d57736a1dfa13638f6e1676572ab8b5dd677d869621fd84ff864b5f5951b8de" Jun 09 00:09:20.054947 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.054729 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d57736a1dfa13638f6e1676572ab8b5dd677d869621fd84ff864b5f5951b8de"} err="failed to get container status \"6d57736a1dfa13638f6e1676572ab8b5dd677d869621fd84ff864b5f5951b8de\": rpc error: code = NotFound desc = could not find container \"6d57736a1dfa13638f6e1676572ab8b5dd677d869621fd84ff864b5f5951b8de\": container with ID starting with 6d57736a1dfa13638f6e1676572ab8b5dd677d869621fd84ff864b5f5951b8de not found: ID does not exist" Jun 09 00:09:20.056455 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.056425 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw8v5\" (UniqueName: \"kubernetes.io/projected/b77fa3e6-2c29-436c-bb55-fcc3530de8a3-kube-api-access-bw8v5\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:09:20.085563 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.085540 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf"] Jun 09 00:09:20.089168 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:09:20.089137 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676d224b_1e7a_4b2b_acc9_22b9415e754a.slice/crio-666326e7a39861f6f02321385690636e6506203c1b7eca72160550a1020e7dc7 WatchSource:0}: Error finding container 666326e7a39861f6f02321385690636e6506203c1b7eca72160550a1020e7dc7: Status 404 returned error can't find the container with id 666326e7a39861f6f02321385690636e6506203c1b7eca72160550a1020e7dc7 Jun 09 00:09:20.216328 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.216301 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:20.218470 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:20.218444 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="cf75b093-b35c-4f66-a156-880220320453" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:20.220544 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:20.220516 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h8p7g\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:20.225158 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:20.222907 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jrlvn\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="01c4b51d-24ff-4a74-ab75-cb61017e1b98" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:20.243274 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.243239 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:20.250450 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:20.250414 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="cf75b093-b35c-4f66-a156-880220320453" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:20.252280 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:20.252252 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h8p7g\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:20.253963 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:20.253940 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jrlvn\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="01c4b51d-24ff-4a74-ab75-cb61017e1b98" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:20.350159 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.350070 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:20.358993 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.358964 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkb79\" (UniqueName: \"kubernetes.io/projected/01c4b51d-24ff-4a74-ab75-cb61017e1b98-kube-api-access-nkb79\") pod \"01c4b51d-24ff-4a74-ab75-cb61017e1b98\" (UID: \"01c4b51d-24ff-4a74-ab75-cb61017e1b98\") " Jun 09 00:09:20.359131 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.359048 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01c4b51d-24ff-4a74-ab75-cb61017e1b98-extensions-socket-volume\") pod \"01c4b51d-24ff-4a74-ab75-cb61017e1b98\" (UID: \"01c4b51d-24ff-4a74-ab75-cb61017e1b98\") " Jun 09 00:09:20.359344 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.359304 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c4b51d-24ff-4a74-ab75-cb61017e1b98-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "01c4b51d-24ff-4a74-ab75-cb61017e1b98" (UID: "01c4b51d-24ff-4a74-ab75-cb61017e1b98"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:09:20.361396 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.361371 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01c4b51d-24ff-4a74-ab75-cb61017e1b98-kube-api-access-nkb79" (OuterVolumeSpecName: "kube-api-access-nkb79") pod "01c4b51d-24ff-4a74-ab75-cb61017e1b98" (UID: "01c4b51d-24ff-4a74-ab75-cb61017e1b98"). InnerVolumeSpecName "kube-api-access-nkb79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:09:20.460663 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.460631 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkb79\" (UniqueName: \"kubernetes.io/projected/01c4b51d-24ff-4a74-ab75-cb61017e1b98-kube-api-access-nkb79\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:09:20.460663 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.460666 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01c4b51d-24ff-4a74-ab75-cb61017e1b98-extensions-socket-volume\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:09:20.531807 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:20.531731 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h8p7g\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h8p7g" Jun 09 00:09:20.534064 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:20.534026 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jrlvn\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="01c4b51d-24ff-4a74-ab75-cb61017e1b98" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:20.534592 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.534560 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01c4b51d-24ff-4a74-ab75-cb61017e1b98" path="/var/lib/kubelet/pods/01c4b51d-24ff-4a74-ab75-cb61017e1b98/volumes" Jun 09 00:09:20.535084 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.535065 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" path="/var/lib/kubelet/pods/b77fa3e6-2c29-436c-bb55-fcc3530de8a3/volumes" Jun 09 00:09:20.535514 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.535495 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf75b093-b35c-4f66-a156-880220320453" path="/var/lib/kubelet/pods/cf75b093-b35c-4f66-a156-880220320453/volumes" Jun 09 00:09:20.536330 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:20.536303 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lxnfq\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="cf75b093-b35c-4f66-a156-880220320453" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxnfq" Jun 09 00:09:20.947557 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.947518 2573 generic.go:356] "Generic (PLEG): container finished" podID="01c4b51d-24ff-4a74-ab75-cb61017e1b98" containerID="748f1d680d88ce905032392a9138c53963daad3a420aab0ab8a19abcc270c053" exitCode=2 Jun 09 00:09:20.947759 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.947582 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:20.947759 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.947646 2573 scope.go:117] "RemoveContainer" containerID="748f1d680d88ce905032392a9138c53963daad3a420aab0ab8a19abcc270c053" Jun 09 00:09:20.952117 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.952090 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" event={"ID":"676d224b-1e7a-4b2b-acc9-22b9415e754a","Type":"ContainerStarted","Data":"b9c431ffcc042560765514aa7d11153e723f583c375e95ea06aab774581ed818"} Jun 09 00:09:20.952245 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.952136 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" event={"ID":"676d224b-1e7a-4b2b-acc9-22b9415e754a","Type":"ContainerStarted","Data":"666326e7a39861f6f02321385690636e6506203c1b7eca72160550a1020e7dc7"} Jun 09 00:09:20.952576 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.952544 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" Jun 09 00:09:20.953352 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:20.953215 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jrlvn\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="01c4b51d-24ff-4a74-ab75-cb61017e1b98" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:20.954319 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.954296 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" event={"ID":"51d5cb27-ba20-4bc6-ad8a-7438d24718c4","Type":"ContainerStarted","Data":"89fce5d63eaa20eb9692dcc848c52efc1a8f55fc3271b9292aecaf1dfa79e3cd"} Jun 09 00:09:20.954395 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.954336 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" event={"ID":"51d5cb27-ba20-4bc6-ad8a-7438d24718c4","Type":"ContainerStarted","Data":"44a898923a102940336aa65e740c45696554df2815bb08d3b611a6b435373d30"} Jun 09 00:09:20.954455 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.954446 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" Jun 09 00:09:20.977591 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:20.977549 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" podStartSLOduration=1.9775369120000001 podStartE2EDuration="1.977536912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:09:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:09:20.977305083 +0000 UTC m=+610.935572691" watchObservedRunningTime="2026-06-09 00:09:20.977536912 +0000 UTC m=+610.935804494" Jun 09 00:09:20.979261 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:20.979230 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jrlvn\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="01c4b51d-24ff-4a74-ab75-cb61017e1b98" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:20.981028 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:20.980997 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jrlvn\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="01c4b51d-24ff-4a74-ab75-cb61017e1b98" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jrlvn" Jun 09 00:09:21.000302 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:21.000259 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" podStartSLOduration=2.000245845 podStartE2EDuration="2.000245845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:09:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:09:20.998182515 +0000 UTC m=+610.956450120" watchObservedRunningTime="2026-06-09 00:09:21.000245845 +0000 UTC m=+610.958513450" Jun 09 00:09:22.646190 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:22.646148 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:22.747436 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:22.747389 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:28.220028 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:28.219984 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:28.274076 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:28.274007 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:31.965069 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:31.965039 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" Jun 09 00:09:32.012227 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.012179 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf"] Jun 09 00:09:32.012479 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.012453 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" podUID="676d224b-1e7a-4b2b-acc9-22b9415e754a" containerName="manager" containerID="cri-o://b9c431ffcc042560765514aa7d11153e723f583c375e95ea06aab774581ed818" gracePeriod=10 Jun 09 00:09:32.014267 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.014234 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" Jun 09 00:09:32.399866 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.399832 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq"] Jun 09 00:09:32.400403 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.400260 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" containerName="manager" Jun 09 00:09:32.400403 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.400281 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" containerName="manager" Jun 09 00:09:32.400403 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.400378 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b77fa3e6-2c29-436c-bb55-fcc3530de8a3" containerName="manager" Jun 09 00:09:32.496837 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.496806 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq"] Jun 09 00:09:32.497005 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.496940 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq" Jun 09 00:09:32.677884 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.677799 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beede597-624d-4f05-b0f2-571dc2ba53db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2cnvq\" (UID: \"beede597-624d-4f05-b0f2-571dc2ba53db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq" Jun 09 00:09:32.677884 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.677879 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6fm4\" (UniqueName: \"kubernetes.io/projected/beede597-624d-4f05-b0f2-571dc2ba53db-kube-api-access-n6fm4\") pod \"kuadrant-operator-controller-manager-86878c769f-2cnvq\" (UID: \"beede597-624d-4f05-b0f2-571dc2ba53db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq" Jun 09 00:09:32.778993 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.778954 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beede597-624d-4f05-b0f2-571dc2ba53db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2cnvq\" (UID: \"beede597-624d-4f05-b0f2-571dc2ba53db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq" Jun 09 00:09:32.779206 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.779010 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6fm4\" (UniqueName: \"kubernetes.io/projected/beede597-624d-4f05-b0f2-571dc2ba53db-kube-api-access-n6fm4\") pod \"kuadrant-operator-controller-manager-86878c769f-2cnvq\" (UID: \"beede597-624d-4f05-b0f2-571dc2ba53db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq" Jun 09 00:09:32.779357 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.779334 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beede597-624d-4f05-b0f2-571dc2ba53db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2cnvq\" (UID: \"beede597-624d-4f05-b0f2-571dc2ba53db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq" Jun 09 00:09:32.787265 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.787240 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6fm4\" (UniqueName: \"kubernetes.io/projected/beede597-624d-4f05-b0f2-571dc2ba53db-kube-api-access-n6fm4\") pod \"kuadrant-operator-controller-manager-86878c769f-2cnvq\" (UID: \"beede597-624d-4f05-b0f2-571dc2ba53db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq" Jun 09 00:09:32.825894 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:32.825867 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq" Jun 09 00:09:33.321946 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:33.321901 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:33.422072 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:33.422029 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:34.684697 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:34.684496 2573 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-tvmdp_kuadrant-system_b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b_0(ea38277d8f0df88b96a35668d733a756e5bd8a5745de1b4f3ad206a4d5dc1d34): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-tvmdp to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 09 00:09:34.684697 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:34.684585 2573 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-tvmdp_kuadrant-system_b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b_0(ea38277d8f0df88b96a35668d733a756e5bd8a5745de1b4f3ad206a4d5dc1d34): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-tvmdp to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:34.691392 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:34.691117 2573 scope.go:117] "RemoveContainer" containerID="748f1d680d88ce905032392a9138c53963daad3a420aab0ab8a19abcc270c053" Jun 09 00:09:34.691524 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:34.691489 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"748f1d680d88ce905032392a9138c53963daad3a420aab0ab8a19abcc270c053\": container with ID starting with 748f1d680d88ce905032392a9138c53963daad3a420aab0ab8a19abcc270c053 not found: ID does not exist" containerID="748f1d680d88ce905032392a9138c53963daad3a420aab0ab8a19abcc270c053" Jun 09 00:09:34.691696 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:34.691664 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748f1d680d88ce905032392a9138c53963daad3a420aab0ab8a19abcc270c053"} err="failed to get container status \"748f1d680d88ce905032392a9138c53963daad3a420aab0ab8a19abcc270c053\": rpc error: code = NotFound desc = could not find container \"748f1d680d88ce905032392a9138c53963daad3a420aab0ab8a19abcc270c053\": container with ID starting with 748f1d680d88ce905032392a9138c53963daad3a420aab0ab8a19abcc270c053 not found: ID does not exist" Jun 09 00:09:34.849903 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:34.849881 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq"] Jun 09 00:09:34.852918 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:09:34.852895 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeede597_624d_4f05_b0f2_571dc2ba53db.slice/crio-8b52c18fe0f4364eb4d11bf1912dee427abb75579554ee250d4e55112367d93c WatchSource:0}: Error finding container 8b52c18fe0f4364eb4d11bf1912dee427abb75579554ee250d4e55112367d93c: Status 404 returned error can't find the container with id 8b52c18fe0f4364eb4d11bf1912dee427abb75579554ee250d4e55112367d93c Jun 09 00:09:34.868553 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:34.868535 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" Jun 09 00:09:35.001478 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.001449 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/676d224b-1e7a-4b2b-acc9-22b9415e754a-extensions-socket-volume\") pod \"676d224b-1e7a-4b2b-acc9-22b9415e754a\" (UID: \"676d224b-1e7a-4b2b-acc9-22b9415e754a\") " Jun 09 00:09:35.001619 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.001509 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcwnj\" (UniqueName: \"kubernetes.io/projected/676d224b-1e7a-4b2b-acc9-22b9415e754a-kube-api-access-vcwnj\") pod \"676d224b-1e7a-4b2b-acc9-22b9415e754a\" (UID: \"676d224b-1e7a-4b2b-acc9-22b9415e754a\") " Jun 09 00:09:35.001836 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.001813 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/676d224b-1e7a-4b2b-acc9-22b9415e754a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "676d224b-1e7a-4b2b-acc9-22b9415e754a" (UID: "676d224b-1e7a-4b2b-acc9-22b9415e754a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:09:35.003565 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.003544 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/676d224b-1e7a-4b2b-acc9-22b9415e754a-kube-api-access-vcwnj" (OuterVolumeSpecName: "kube-api-access-vcwnj") pod "676d224b-1e7a-4b2b-acc9-22b9415e754a" (UID: "676d224b-1e7a-4b2b-acc9-22b9415e754a"). InnerVolumeSpecName "kube-api-access-vcwnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:09:35.038005 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.037976 2573 generic.go:356] "Generic (PLEG): container finished" podID="676d224b-1e7a-4b2b-acc9-22b9415e754a" containerID="b9c431ffcc042560765514aa7d11153e723f583c375e95ea06aab774581ed818" exitCode=0 Jun 09 00:09:35.038120 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.038016 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" Jun 09 00:09:35.038120 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.038060 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" event={"ID":"676d224b-1e7a-4b2b-acc9-22b9415e754a","Type":"ContainerDied","Data":"b9c431ffcc042560765514aa7d11153e723f583c375e95ea06aab774581ed818"} Jun 09 00:09:35.038120 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.038116 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf" event={"ID":"676d224b-1e7a-4b2b-acc9-22b9415e754a","Type":"ContainerDied","Data":"666326e7a39861f6f02321385690636e6506203c1b7eca72160550a1020e7dc7"} Jun 09 00:09:35.038290 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.038137 2573 scope.go:117] "RemoveContainer" containerID="b9c431ffcc042560765514aa7d11153e723f583c375e95ea06aab774581ed818" Jun 09 00:09:35.040022 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.039995 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq" event={"ID":"beede597-624d-4f05-b0f2-571dc2ba53db","Type":"ContainerStarted","Data":"b71795c9dd2b2451c69b792ce4382077e861bf72658456af24121dd8deaffd12"} Jun 09 00:09:35.040227 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.040054 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq" Jun 09 00:09:35.040227 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.040081 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq" event={"ID":"beede597-624d-4f05-b0f2-571dc2ba53db","Type":"ContainerStarted","Data":"8b52c18fe0f4364eb4d11bf1912dee427abb75579554ee250d4e55112367d93c"} Jun 09 00:09:35.041698 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.041672 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k" event={"ID":"82b595b6-4056-44f1-8710-a4475a554612","Type":"ContainerStarted","Data":"3e777bfead8cbe2b346f4ab1434ccb8c6ec0171675a4d1ecdb0e1b3533b9afd1"} Jun 09 00:09:35.042692 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.042676 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:35.048033 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.047854 2573 scope.go:117] "RemoveContainer" containerID="b9c431ffcc042560765514aa7d11153e723f583c375e95ea06aab774581ed818" Jun 09 00:09:35.048192 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:35.048167 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9c431ffcc042560765514aa7d11153e723f583c375e95ea06aab774581ed818\": container with ID starting with b9c431ffcc042560765514aa7d11153e723f583c375e95ea06aab774581ed818 not found: ID does not exist" containerID="b9c431ffcc042560765514aa7d11153e723f583c375e95ea06aab774581ed818" Jun 09 00:09:35.048257 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.048204 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9c431ffcc042560765514aa7d11153e723f583c375e95ea06aab774581ed818"} err="failed to get container status \"b9c431ffcc042560765514aa7d11153e723f583c375e95ea06aab774581ed818\": rpc error: code = NotFound desc = could not find container \"b9c431ffcc042560765514aa7d11153e723f583c375e95ea06aab774581ed818\": container with ID starting with b9c431ffcc042560765514aa7d11153e723f583c375e95ea06aab774581ed818 not found: ID does not exist" Jun 09 00:09:35.057546 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.057507 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq" podStartSLOduration=3.057495609 podStartE2EDuration="3.057495609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:09:35.056344556 +0000 UTC m=+625.014612151" watchObservedRunningTime="2026-06-09 00:09:35.057495609 +0000 UTC m=+625.015763212" Jun 09 00:09:35.071214 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.071176 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5v54k" podStartSLOduration=1.415463149 podStartE2EDuration="27.071166063s" totalImagesPullingTime="25.655702914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:09:35.070309575 +0000 UTC m=+625.028577180" watchObservedRunningTime="2026-06-09 00:09:35.071166063 +0000 UTC m=+625.029433666" Jun 09 00:09:35.076105 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.076087 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:35.086116 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.086093 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf"] Jun 09 00:09:35.090977 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:35.090943 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-tvmdp\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:35.091571 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.091543 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv5pf"] Jun 09 00:09:35.093573 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:35.093545 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-tvmdp\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:35.103189 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.103132 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcwnj\" (UniqueName: \"kubernetes.io/projected/676d224b-1e7a-4b2b-acc9-22b9415e754a-kube-api-access-vcwnj\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:09:35.103189 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.103169 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/676d224b-1e7a-4b2b-acc9-22b9415e754a-extensions-socket-volume\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:09:35.204227 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.204158 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b-extensions-socket-volume\") pod \"b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b\" (UID: \"b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b\") " Jun 09 00:09:35.204360 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.204276 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ddxx\" (UniqueName: \"kubernetes.io/projected/b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b-kube-api-access-2ddxx\") pod \"b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b\" (UID: \"b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b\") " Jun 09 00:09:35.204414 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.204394 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b" (UID: "b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:09:35.204517 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.204500 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b-extensions-socket-volume\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:09:35.206407 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.206389 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b-kube-api-access-2ddxx" (OuterVolumeSpecName: "kube-api-access-2ddxx") pod "b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b" (UID: "b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b"). InnerVolumeSpecName "kube-api-access-2ddxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:09:35.305708 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:35.305678 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ddxx\" (UniqueName: \"kubernetes.io/projected/b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b-kube-api-access-2ddxx\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:09:36.047750 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:36.047722 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:36.050498 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:36.050472 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-tvmdp\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:36.055290 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:36.055263 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-tvmdp\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tvmdp" Jun 09 00:09:36.532108 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:36.532080 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="676d224b-1e7a-4b2b-acc9-22b9415e754a" path="/var/lib/kubelet/pods/676d224b-1e7a-4b2b-acc9-22b9415e754a/volumes" Jun 09 00:09:36.532415 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:36.532402 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b" path="/var/lib/kubelet/pods/b6bf8f06-7b92-4749-b0a5-dcb82ed9a93b/volumes" Jun 09 00:09:36.912928 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:36.912854 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:37.012705 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:37.012679 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:37.113025 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:37.112987 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:39.909202 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:39.909167 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:40.009369 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:40.009340 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:42.345110 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:42.345069 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:42.445086 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:42.445048 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:46.049814 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:46.049778 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2cnvq" Jun 09 00:09:46.095311 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:46.095281 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg"] Jun 09 00:09:46.095501 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:46.095480 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" podUID="51d5cb27-ba20-4bc6-ad8a-7438d24718c4" containerName="manager" containerID="cri-o://89fce5d63eaa20eb9692dcc848c52efc1a8f55fc3271b9292aecaf1dfa79e3cd" gracePeriod=10 Jun 09 00:09:46.343541 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:46.343519 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" Jun 09 00:09:46.401509 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:46.401481 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51d5cb27-ba20-4bc6-ad8a-7438d24718c4-extensions-socket-volume\") pod \"51d5cb27-ba20-4bc6-ad8a-7438d24718c4\" (UID: \"51d5cb27-ba20-4bc6-ad8a-7438d24718c4\") " Jun 09 00:09:46.401648 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:46.401574 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m62x\" (UniqueName: \"kubernetes.io/projected/51d5cb27-ba20-4bc6-ad8a-7438d24718c4-kube-api-access-8m62x\") pod \"51d5cb27-ba20-4bc6-ad8a-7438d24718c4\" (UID: \"51d5cb27-ba20-4bc6-ad8a-7438d24718c4\") " Jun 09 00:09:46.401869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:46.401843 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51d5cb27-ba20-4bc6-ad8a-7438d24718c4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "51d5cb27-ba20-4bc6-ad8a-7438d24718c4" (UID: "51d5cb27-ba20-4bc6-ad8a-7438d24718c4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:09:46.403607 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:46.403586 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51d5cb27-ba20-4bc6-ad8a-7438d24718c4-kube-api-access-8m62x" (OuterVolumeSpecName: "kube-api-access-8m62x") pod "51d5cb27-ba20-4bc6-ad8a-7438d24718c4" (UID: "51d5cb27-ba20-4bc6-ad8a-7438d24718c4"). InnerVolumeSpecName "kube-api-access-8m62x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:09:46.502913 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:46.502888 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m62x\" (UniqueName: \"kubernetes.io/projected/51d5cb27-ba20-4bc6-ad8a-7438d24718c4-kube-api-access-8m62x\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:09:46.502913 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:46.502911 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51d5cb27-ba20-4bc6-ad8a-7438d24718c4-extensions-socket-volume\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:09:47.102702 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:47.102667 2573 generic.go:356] "Generic (PLEG): container finished" podID="51d5cb27-ba20-4bc6-ad8a-7438d24718c4" containerID="89fce5d63eaa20eb9692dcc848c52efc1a8f55fc3271b9292aecaf1dfa79e3cd" exitCode=0 Jun 09 00:09:47.103165 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:47.102711 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" Jun 09 00:09:47.103165 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:47.102761 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" event={"ID":"51d5cb27-ba20-4bc6-ad8a-7438d24718c4","Type":"ContainerDied","Data":"89fce5d63eaa20eb9692dcc848c52efc1a8f55fc3271b9292aecaf1dfa79e3cd"} Jun 09 00:09:47.103165 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:47.102810 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg" event={"ID":"51d5cb27-ba20-4bc6-ad8a-7438d24718c4","Type":"ContainerDied","Data":"44a898923a102940336aa65e740c45696554df2815bb08d3b611a6b435373d30"} Jun 09 00:09:47.103165 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:47.102832 2573 scope.go:117] "RemoveContainer" containerID="89fce5d63eaa20eb9692dcc848c52efc1a8f55fc3271b9292aecaf1dfa79e3cd" Jun 09 00:09:47.111796 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:47.111766 2573 scope.go:117] "RemoveContainer" containerID="89fce5d63eaa20eb9692dcc848c52efc1a8f55fc3271b9292aecaf1dfa79e3cd" Jun 09 00:09:47.112023 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:09:47.112003 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89fce5d63eaa20eb9692dcc848c52efc1a8f55fc3271b9292aecaf1dfa79e3cd\": container with ID starting with 89fce5d63eaa20eb9692dcc848c52efc1a8f55fc3271b9292aecaf1dfa79e3cd not found: ID does not exist" containerID="89fce5d63eaa20eb9692dcc848c52efc1a8f55fc3271b9292aecaf1dfa79e3cd" Jun 09 00:09:47.112072 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:47.112031 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89fce5d63eaa20eb9692dcc848c52efc1a8f55fc3271b9292aecaf1dfa79e3cd"} err="failed to get container status \"89fce5d63eaa20eb9692dcc848c52efc1a8f55fc3271b9292aecaf1dfa79e3cd\": rpc error: code = NotFound desc = could not find container \"89fce5d63eaa20eb9692dcc848c52efc1a8f55fc3271b9292aecaf1dfa79e3cd\": container with ID starting with 89fce5d63eaa20eb9692dcc848c52efc1a8f55fc3271b9292aecaf1dfa79e3cd not found: ID does not exist" Jun 09 00:09:47.127138 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:47.127118 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg"] Jun 09 00:09:47.133606 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:47.133588 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r2xhg"] Jun 09 00:09:48.314300 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.314271 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp"] Jun 09 00:09:48.314704 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.314600 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d5cb27-ba20-4bc6-ad8a-7438d24718c4" containerName="manager" Jun 09 00:09:48.314704 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.314611 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d5cb27-ba20-4bc6-ad8a-7438d24718c4" containerName="manager" Jun 09 00:09:48.314704 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.314627 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="676d224b-1e7a-4b2b-acc9-22b9415e754a" containerName="manager" Jun 09 00:09:48.314704 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.314633 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="676d224b-1e7a-4b2b-acc9-22b9415e754a" containerName="manager" Jun 09 00:09:48.314704 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.314694 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="51d5cb27-ba20-4bc6-ad8a-7438d24718c4" containerName="manager" Jun 09 00:09:48.314704 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.314704 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="676d224b-1e7a-4b2b-acc9-22b9415e754a" containerName="manager" Jun 09 00:09:48.319187 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.319165 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.324994 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.324970 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sbmfn\"" Jun 09 00:09:48.325210 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.325188 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 00:09:48.333778 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.333731 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp"] Jun 09 00:09:48.335987 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.335960 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:48.418985 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.418960 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-credential-socket\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.419088 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.418989 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnqb9\" (UniqueName: \"kubernetes.io/projected/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-kube-api-access-nnqb9\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.419088 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.419022 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istio-token\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.419088 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.419039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.419190 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.419081 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.419190 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.419133 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-workload-certs\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.419190 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.419155 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istio-data\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.419285 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.419228 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istio-envoy\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.419285 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.419258 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-workload-socket\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.454289 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.454260 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:48.519803 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.519777 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istio-token\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.519909 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.519805 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.519909 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.519824 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.519909 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.519840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-workload-certs\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.519909 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.519858 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istio-data\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.520101 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.519920 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istio-envoy\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.520101 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.519952 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-workload-socket\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.520101 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.519983 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-credential-socket\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.520101 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.520008 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnqb9\" (UniqueName: \"kubernetes.io/projected/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-kube-api-access-nnqb9\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.520392 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.520348 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-workload-certs\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.520487 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.520402 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istio-data\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.520487 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.520438 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-workload-socket\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.520571 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.520493 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-credential-socket\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.520571 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.520559 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.522339 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.522321 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istio-envoy\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.522507 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.522490 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.527414 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.527386 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-istio-token\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.527414 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.527397 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnqb9\" (UniqueName: \"kubernetes.io/projected/f7656b5f-69ca-4ccd-a1bd-622def4d6fa6-kube-api-access-nnqb9\") pod \"maas-default-gateway-openshift-default-7bf8458756-7sxzp\" (UID: \"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.531448 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.531427 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51d5cb27-ba20-4bc6-ad8a-7438d24718c4" path="/var/lib/kubelet/pods/51d5cb27-ba20-4bc6-ad8a-7438d24718c4/volumes" Jun 09 00:09:48.630469 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.630404 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:48.791019 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.790932 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp"] Jun 09 00:09:48.793354 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:09:48.793325 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7656b5f_69ca_4ccd_a1bd_622def4d6fa6.slice/crio-9a561971aa20127154cc9fe8c35e84e7799b02e2ef6b8fb6b1c8225c1dd7ee6d WatchSource:0}: Error finding container 9a561971aa20127154cc9fe8c35e84e7799b02e2ef6b8fb6b1c8225c1dd7ee6d: Status 404 returned error can't find the container with id 9a561971aa20127154cc9fe8c35e84e7799b02e2ef6b8fb6b1c8225c1dd7ee6d Jun 09 00:09:48.795555 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.795522 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 00:09:48.795649 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.795620 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 00:09:48.795716 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:48.795669 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 00:09:49.114303 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:49.114269 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" event={"ID":"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6","Type":"ContainerStarted","Data":"28731384241ff905d02be57c0b005c2182c42b25eda2bde1f000051569a71c77"} Jun 09 00:09:49.114491 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:49.114320 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" event={"ID":"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6","Type":"ContainerStarted","Data":"9a561971aa20127154cc9fe8c35e84e7799b02e2ef6b8fb6b1c8225c1dd7ee6d"} Jun 09 00:09:49.139513 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:49.139464 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" podStartSLOduration=1.139449744 podStartE2EDuration="1.139449744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:09:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:09:49.138156671 +0000 UTC m=+639.096424276" watchObservedRunningTime="2026-06-09 00:09:49.139449744 +0000 UTC m=+639.097717382" Jun 09 00:09:49.630952 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:49.630919 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:49.635666 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:49.635641 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:50.119303 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:50.119273 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:50.120196 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:50.120175 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:09:52.002306 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:52.002271 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:57.317256 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:57.317219 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:09:57.430724 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:09:57.430683 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:00.319167 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:00.319129 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:00.419540 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:00.419503 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:02.759911 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:02.759869 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:02.806482 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:02.806453 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:05.940731 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:05.940702 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bnvs4"] Jun 09 00:10:05.942582 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:05.942554 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:06.025214 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.025182 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bnvs4"] Jun 09 00:10:06.025432 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.025267 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" Jun 09 00:10:06.027618 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.027577 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 00:10:06.042855 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.042825 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:06.053343 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.053320 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bnvs4"] Jun 09 00:10:06.142492 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.142456 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:06.169246 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.169214 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mk6x\" (UniqueName: \"kubernetes.io/projected/bd00b05b-d307-45fa-8234-519faa253365-kube-api-access-5mk6x\") pod \"limitador-limitador-64c94fd64f-bnvs4\" (UID: \"bd00b05b-d307-45fa-8234-519faa253365\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" Jun 09 00:10:06.169397 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.169294 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd00b05b-d307-45fa-8234-519faa253365-config-file\") pod \"limitador-limitador-64c94fd64f-bnvs4\" (UID: \"bd00b05b-d307-45fa-8234-519faa253365\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" Jun 09 00:10:06.270045 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.270015 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mk6x\" (UniqueName: \"kubernetes.io/projected/bd00b05b-d307-45fa-8234-519faa253365-kube-api-access-5mk6x\") pod \"limitador-limitador-64c94fd64f-bnvs4\" (UID: \"bd00b05b-d307-45fa-8234-519faa253365\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" Jun 09 00:10:06.270197 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.270095 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd00b05b-d307-45fa-8234-519faa253365-config-file\") pod \"limitador-limitador-64c94fd64f-bnvs4\" (UID: \"bd00b05b-d307-45fa-8234-519faa253365\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" Jun 09 00:10:06.270682 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.270665 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd00b05b-d307-45fa-8234-519faa253365-config-file\") pod \"limitador-limitador-64c94fd64f-bnvs4\" (UID: \"bd00b05b-d307-45fa-8234-519faa253365\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" Jun 09 00:10:06.281632 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.281599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mk6x\" (UniqueName: \"kubernetes.io/projected/bd00b05b-d307-45fa-8234-519faa253365-kube-api-access-5mk6x\") pod \"limitador-limitador-64c94fd64f-bnvs4\" (UID: \"bd00b05b-d307-45fa-8234-519faa253365\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" Jun 09 00:10:06.336685 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.336655 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" Jun 09 00:10:06.489817 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.489783 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bnvs4"] Jun 09 00:10:06.492721 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:10:06.492689 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd00b05b_d307_45fa_8234_519faa253365.slice/crio-38d4acdb1e5db088a915f381ab6bd2a0ffa269803c3a1b0bee69a7d1c4229016 WatchSource:0}: Error finding container 38d4acdb1e5db088a915f381ab6bd2a0ffa269803c3a1b0bee69a7d1c4229016: Status 404 returned error can't find the container with id 38d4acdb1e5db088a915f381ab6bd2a0ffa269803c3a1b0bee69a7d1c4229016 Jun 09 00:10:06.746852 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.746811 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:06.805990 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.805936 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:06.975893 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.975861 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-dslng"] Jun 09 00:10:06.980384 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.980368 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dslng" Jun 09 00:10:06.983114 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.983094 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ng7ch\"" Jun 09 00:10:06.986226 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:06.986207 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dslng"] Jun 09 00:10:07.078537 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:07.078464 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rdr6\" (UniqueName: \"kubernetes.io/projected/ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d-kube-api-access-4rdr6\") pod \"authorino-75d556bd77-dslng\" (UID: \"ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d\") " pod="kuadrant-system/authorino-75d556bd77-dslng" Jun 09 00:10:07.179579 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:07.179547 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rdr6\" (UniqueName: \"kubernetes.io/projected/ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d-kube-api-access-4rdr6\") pod \"authorino-75d556bd77-dslng\" (UID: \"ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d\") " pod="kuadrant-system/authorino-75d556bd77-dslng" Jun 09 00:10:07.187199 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:07.187172 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rdr6\" (UniqueName: \"kubernetes.io/projected/ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d-kube-api-access-4rdr6\") pod \"authorino-75d556bd77-dslng\" (UID: \"ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d\") " pod="kuadrant-system/authorino-75d556bd77-dslng" Jun 09 00:10:07.206317 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:07.206279 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" event={"ID":"bd00b05b-d307-45fa-8234-519faa253365","Type":"ContainerStarted","Data":"38d4acdb1e5db088a915f381ab6bd2a0ffa269803c3a1b0bee69a7d1c4229016"} Jun 09 00:10:07.290465 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:07.290436 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dslng" Jun 09 00:10:07.469308 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:07.469277 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dslng"] Jun 09 00:10:07.470567 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:10:07.470537 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff0ac2c3_f4b6_4a89_a93f_a75f5d1f407d.slice/crio-f27152b9cdcdec5a9a00a65b4f7b5e1428104a212798ea91e7fade0c2398d8f8 WatchSource:0}: Error finding container f27152b9cdcdec5a9a00a65b4f7b5e1428104a212798ea91e7fade0c2398d8f8: Status 404 returned error can't find the container with id f27152b9cdcdec5a9a00a65b4f7b5e1428104a212798ea91e7fade0c2398d8f8 Jun 09 00:10:08.213789 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:08.213604 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dslng" event={"ID":"ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d","Type":"ContainerStarted","Data":"f27152b9cdcdec5a9a00a65b4f7b5e1428104a212798ea91e7fade0c2398d8f8"} Jun 09 00:10:12.235924 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:12.235882 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" event={"ID":"bd00b05b-d307-45fa-8234-519faa253365","Type":"ContainerStarted","Data":"cab59412a9bf837ad0fcdfde7e1c4e12b7bb3785f1212f2311897ca15e6721de"} Jun 09 00:10:12.236370 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:12.236079 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" Jun 09 00:10:12.237354 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:12.237333 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dslng" event={"ID":"ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d","Type":"ContainerStarted","Data":"30bf75dff0feba15c731a1e485668290db9c96f927fb3ba778c2c9cab3afe276"} Jun 09 00:10:12.250240 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:12.250191 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" podStartSLOduration=2.477812915 podStartE2EDuration="7.250178566s" totalImagesPullingTime="4.772365651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:10:12.250031902 +0000 UTC m=+662.208299500" watchObservedRunningTime="2026-06-09 00:10:12.250178566 +0000 UTC m=+662.208446166" Jun 09 00:10:12.264032 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:12.263992 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-dslng" podStartSLOduration=2.464711945 podStartE2EDuration="6.263980884s" totalImagesPullingTime="3.799268939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:10:12.262185207 +0000 UTC m=+662.220452811" watchObservedRunningTime="2026-06-09 00:10:12.263980884 +0000 UTC m=+662.222248488" Jun 09 00:10:22.551940 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:22.551908 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bnvs4"] Jun 09 00:10:22.552427 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:22.552071 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" podUID="bd00b05b-d307-45fa-8234-519faa253365" containerName="limitador" containerID="cri-o://cab59412a9bf837ad0fcdfde7e1c4e12b7bb3785f1212f2311897ca15e6721de" gracePeriod=30 Jun 09 00:10:22.552843 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:22.552797 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" Jun 09 00:10:23.100746 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.100722 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" Jun 09 00:10:23.226779 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.226732 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd00b05b-d307-45fa-8234-519faa253365-config-file\") pod \"bd00b05b-d307-45fa-8234-519faa253365\" (UID: \"bd00b05b-d307-45fa-8234-519faa253365\") " Jun 09 00:10:23.226954 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.226837 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mk6x\" (UniqueName: \"kubernetes.io/projected/bd00b05b-d307-45fa-8234-519faa253365-kube-api-access-5mk6x\") pod \"bd00b05b-d307-45fa-8234-519faa253365\" (UID: \"bd00b05b-d307-45fa-8234-519faa253365\") " Jun 09 00:10:23.227118 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.227091 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd00b05b-d307-45fa-8234-519faa253365-config-file" (OuterVolumeSpecName: "config-file") pod "bd00b05b-d307-45fa-8234-519faa253365" (UID: "bd00b05b-d307-45fa-8234-519faa253365"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:10:23.229087 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.229069 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd00b05b-d307-45fa-8234-519faa253365-kube-api-access-5mk6x" (OuterVolumeSpecName: "kube-api-access-5mk6x") pod "bd00b05b-d307-45fa-8234-519faa253365" (UID: "bd00b05b-d307-45fa-8234-519faa253365"). InnerVolumeSpecName "kube-api-access-5mk6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:10:23.288485 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.288458 2573 generic.go:356] "Generic (PLEG): container finished" podID="bd00b05b-d307-45fa-8234-519faa253365" containerID="cab59412a9bf837ad0fcdfde7e1c4e12b7bb3785f1212f2311897ca15e6721de" exitCode=0 Jun 09 00:10:23.288597 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.288509 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" Jun 09 00:10:23.288597 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.288507 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" event={"ID":"bd00b05b-d307-45fa-8234-519faa253365","Type":"ContainerDied","Data":"cab59412a9bf837ad0fcdfde7e1c4e12b7bb3785f1212f2311897ca15e6721de"} Jun 09 00:10:23.288676 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.288615 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bnvs4" event={"ID":"bd00b05b-d307-45fa-8234-519faa253365","Type":"ContainerDied","Data":"38d4acdb1e5db088a915f381ab6bd2a0ffa269803c3a1b0bee69a7d1c4229016"} Jun 09 00:10:23.288676 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.288640 2573 scope.go:117] "RemoveContainer" containerID="cab59412a9bf837ad0fcdfde7e1c4e12b7bb3785f1212f2311897ca15e6721de" Jun 09 00:10:23.297611 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.297590 2573 scope.go:117] "RemoveContainer" containerID="cab59412a9bf837ad0fcdfde7e1c4e12b7bb3785f1212f2311897ca15e6721de" Jun 09 00:10:23.297888 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:10:23.297868 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cab59412a9bf837ad0fcdfde7e1c4e12b7bb3785f1212f2311897ca15e6721de\": container with ID starting with cab59412a9bf837ad0fcdfde7e1c4e12b7bb3785f1212f2311897ca15e6721de not found: ID does not exist" containerID="cab59412a9bf837ad0fcdfde7e1c4e12b7bb3785f1212f2311897ca15e6721de" Jun 09 00:10:23.297956 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.297899 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cab59412a9bf837ad0fcdfde7e1c4e12b7bb3785f1212f2311897ca15e6721de"} err="failed to get container status \"cab59412a9bf837ad0fcdfde7e1c4e12b7bb3785f1212f2311897ca15e6721de\": rpc error: code = NotFound desc = could not find container \"cab59412a9bf837ad0fcdfde7e1c4e12b7bb3785f1212f2311897ca15e6721de\": container with ID starting with cab59412a9bf837ad0fcdfde7e1c4e12b7bb3785f1212f2311897ca15e6721de not found: ID does not exist" Jun 09 00:10:23.308897 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.308876 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bnvs4"] Jun 09 00:10:23.314802 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.314782 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bnvs4"] Jun 09 00:10:23.328443 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.328420 2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd00b05b-d307-45fa-8234-519faa253365-config-file\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:10:23.328517 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.328444 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mk6x\" (UniqueName: \"kubernetes.io/projected/bd00b05b-d307-45fa-8234-519faa253365-kube-api-access-5mk6x\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:10:23.807302 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.807268 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:23.907439 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:23.907398 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:24.240857 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.240823 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv"] Jun 09 00:10:24.241179 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.241166 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd00b05b-d307-45fa-8234-519faa253365" containerName="limitador" Jun 09 00:10:24.241239 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.241181 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd00b05b-d307-45fa-8234-519faa253365" containerName="limitador" Jun 09 00:10:24.241274 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.241267 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd00b05b-d307-45fa-8234-519faa253365" containerName="limitador" Jun 09 00:10:24.243289 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.243266 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv" Jun 09 00:10:24.245729 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.245710 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 00:10:24.245857 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.245710 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 09 00:10:24.246669 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.246648 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 00:10:24.246820 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.246718 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-6j6hm\"" Jun 09 00:10:24.256707 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.256686 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv"] Jun 09 00:10:24.272542 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.272519 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:24.336245 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.336219 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/71f1d0fa-fe66-45e4-9c15-eab5a6b5bf01-data\") pod \"postgres-69fb4594cf-dz7xv\" (UID: \"71f1d0fa-fe66-45e4-9c15-eab5a6b5bf01\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv" Jun 09 00:10:24.336359 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.336254 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b86p\" (UniqueName: \"kubernetes.io/projected/71f1d0fa-fe66-45e4-9c15-eab5a6b5bf01-kube-api-access-7b86p\") pod \"postgres-69fb4594cf-dz7xv\" (UID: \"71f1d0fa-fe66-45e4-9c15-eab5a6b5bf01\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv" Jun 09 00:10:24.436966 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.436941 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/71f1d0fa-fe66-45e4-9c15-eab5a6b5bf01-data\") pod \"postgres-69fb4594cf-dz7xv\" (UID: \"71f1d0fa-fe66-45e4-9c15-eab5a6b5bf01\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv" Jun 09 00:10:24.437127 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.436976 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b86p\" (UniqueName: \"kubernetes.io/projected/71f1d0fa-fe66-45e4-9c15-eab5a6b5bf01-kube-api-access-7b86p\") pod \"postgres-69fb4594cf-dz7xv\" (UID: \"71f1d0fa-fe66-45e4-9c15-eab5a6b5bf01\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv" Jun 09 00:10:24.437346 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.437327 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/71f1d0fa-fe66-45e4-9c15-eab5a6b5bf01-data\") pod \"postgres-69fb4594cf-dz7xv\" (UID: \"71f1d0fa-fe66-45e4-9c15-eab5a6b5bf01\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv" Jun 09 00:10:24.444582 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.444559 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b86p\" (UniqueName: \"kubernetes.io/projected/71f1d0fa-fe66-45e4-9c15-eab5a6b5bf01-kube-api-access-7b86p\") pod \"postgres-69fb4594cf-dz7xv\" (UID: \"71f1d0fa-fe66-45e4-9c15-eab5a6b5bf01\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv" Jun 09 00:10:24.531906 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.531835 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd00b05b-d307-45fa-8234-519faa253365" path="/var/lib/kubelet/pods/bd00b05b-d307-45fa-8234-519faa253365/volumes" Jun 09 00:10:24.554278 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.554257 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv" Jun 09 00:10:24.683010 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:24.682985 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv"] Jun 09 00:10:24.685078 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:10:24.685048 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f1d0fa_fe66_45e4_9c15_eab5a6b5bf01.slice/crio-6f99477d46619752f92ac23afb8a9c12ed1cca5a82ba8244ef590edcecde1baf WatchSource:0}: Error finding container 6f99477d46619752f92ac23afb8a9c12ed1cca5a82ba8244ef590edcecde1baf: Status 404 returned error can't find the container with id 6f99477d46619752f92ac23afb8a9c12ed1cca5a82ba8244ef590edcecde1baf Jun 09 00:10:25.300337 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:25.300301 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv" event={"ID":"71f1d0fa-fe66-45e4-9c15-eab5a6b5bf01","Type":"ContainerStarted","Data":"6f99477d46619752f92ac23afb8a9c12ed1cca5a82ba8244ef590edcecde1baf"} Jun 09 00:10:29.322530 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:29.322499 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv" event={"ID":"71f1d0fa-fe66-45e4-9c15-eab5a6b5bf01","Type":"ContainerStarted","Data":"e1763934b991f1edbde5456334a241845c0f5992a9318c922722dc1b7788afa6"} Jun 09 00:10:29.322977 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:29.322575 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv" Jun 09 00:10:29.339783 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:29.339717 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv" podStartSLOduration=1.157265347 podStartE2EDuration="5.339703595s" totalImagesPullingTime="4.182438248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:10:29.337906087 +0000 UTC m=+679.296173682" watchObservedRunningTime="2026-06-09 00:10:29.339703595 +0000 UTC m=+679.297971195" Jun 09 00:10:35.361068 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:35.361034 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-dz7xv" Jun 09 00:10:35.662729 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:35.662616 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:35.762222 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:35.762185 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:35.918969 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:35.918882 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:44.038360 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:44.038324 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-h26q7"] Jun 09 00:10:44.050528 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:44.050503 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-h26q7" Jun 09 00:10:44.053036 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:44.053004 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-w949m\"" Jun 09 00:10:44.053173 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:44.053079 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 00:10:44.053235 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:44.053197 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 00:10:44.053235 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:44.053214 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-h26q7"] Jun 09 00:10:44.104127 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:44.104098 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84l44\" (UniqueName: \"kubernetes.io/projected/ee3c7fe4-f349-4895-953e-7c51088912be-kube-api-access-84l44\") pod \"keycloak-operator-d67dbbb48-h26q7\" (UID: \"ee3c7fe4-f349-4895-953e-7c51088912be\") " pod="keycloak-system/keycloak-operator-d67dbbb48-h26q7" Jun 09 00:10:44.204841 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:44.204814 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84l44\" (UniqueName: \"kubernetes.io/projected/ee3c7fe4-f349-4895-953e-7c51088912be-kube-api-access-84l44\") pod \"keycloak-operator-d67dbbb48-h26q7\" (UID: \"ee3c7fe4-f349-4895-953e-7c51088912be\") " pod="keycloak-system/keycloak-operator-d67dbbb48-h26q7" Jun 09 00:10:44.218348 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:44.218322 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84l44\" (UniqueName: \"kubernetes.io/projected/ee3c7fe4-f349-4895-953e-7c51088912be-kube-api-access-84l44\") pod \"keycloak-operator-d67dbbb48-h26q7\" (UID: \"ee3c7fe4-f349-4895-953e-7c51088912be\") " pod="keycloak-system/keycloak-operator-d67dbbb48-h26q7" Jun 09 00:10:44.361593 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:44.361522 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-h26q7" Jun 09 00:10:44.438888 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:44.438854 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:44.491353 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:44.491328 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-h26q7"] Jun 09 00:10:44.493973 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:10:44.493949 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3c7fe4_f349_4895_953e_7c51088912be.slice/crio-b7c06ae7adb822df4dab834e74b72f1adf3f52ecd10a58b0882211e9da37733f WatchSource:0}: Error finding container b7c06ae7adb822df4dab834e74b72f1adf3f52ecd10a58b0882211e9da37733f: Status 404 returned error can't find the container with id b7c06ae7adb822df4dab834e74b72f1adf3f52ecd10a58b0882211e9da37733f Jun 09 00:10:45.406856 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:45.406778 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-h26q7" event={"ID":"ee3c7fe4-f349-4895-953e-7c51088912be","Type":"ContainerStarted","Data":"b7c06ae7adb822df4dab834e74b72f1adf3f52ecd10a58b0882211e9da37733f"} Jun 09 00:10:51.441515 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:51.441474 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-h26q7" event={"ID":"ee3c7fe4-f349-4895-953e-7c51088912be","Type":"ContainerStarted","Data":"e9e9b44021d504b17bba92215b89a3864a74d8940b10cc54f8f5b1fdd6cf17c5"} Jun 09 00:10:51.457484 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:51.457443 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-h26q7" podStartSLOduration=1.270334883 podStartE2EDuration="7.457429381s" totalImagesPullingTime="6.187094498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:10:51.456322624 +0000 UTC m=+701.414590227" watchObservedRunningTime="2026-06-09 00:10:51.457429381 +0000 UTC m=+701.415696985" Jun 09 00:10:59.234029 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:59.233991 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:10:59.333729 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:10:59.333690 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:11:03.753349 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:03.753307 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:11:33.732514 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:33.732472 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:11:34.082946 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:34.082861 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:11:36.042547 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.042517 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dslng"] Jun 09 00:11:36.043045 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.042701 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-dslng" podUID="ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d" containerName="authorino" containerID="cri-o://30bf75dff0feba15c731a1e485668290db9c96f927fb3ba778c2c9cab3afe276" gracePeriod=30 Jun 09 00:11:36.307223 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.307157 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dslng" Jun 09 00:11:36.456253 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.456221 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rdr6\" (UniqueName: \"kubernetes.io/projected/ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d-kube-api-access-4rdr6\") pod \"ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d\" (UID: \"ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d\") " Jun 09 00:11:36.458546 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.458519 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d-kube-api-access-4rdr6" (OuterVolumeSpecName: "kube-api-access-4rdr6") pod "ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d" (UID: "ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d"). InnerVolumeSpecName "kube-api-access-4rdr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:11:36.557118 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.557091 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rdr6\" (UniqueName: \"kubernetes.io/projected/ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d-kube-api-access-4rdr6\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\"" Jun 09 00:11:36.653140 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.653053 2573 generic.go:356] "Generic (PLEG): container finished" podID="ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d" containerID="30bf75dff0feba15c731a1e485668290db9c96f927fb3ba778c2c9cab3afe276" exitCode=0 Jun 09 00:11:36.653140 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.653107 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dslng" Jun 09 00:11:36.653305 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.653143 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dslng" event={"ID":"ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d","Type":"ContainerDied","Data":"30bf75dff0feba15c731a1e485668290db9c96f927fb3ba778c2c9cab3afe276"} Jun 09 00:11:36.653305 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.653188 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dslng" event={"ID":"ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d","Type":"ContainerDied","Data":"f27152b9cdcdec5a9a00a65b4f7b5e1428104a212798ea91e7fade0c2398d8f8"} Jun 09 00:11:36.653305 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.653205 2573 scope.go:117] "RemoveContainer" containerID="30bf75dff0feba15c731a1e485668290db9c96f927fb3ba778c2c9cab3afe276" Jun 09 00:11:36.662122 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.662104 2573 scope.go:117] "RemoveContainer" containerID="30bf75dff0feba15c731a1e485668290db9c96f927fb3ba778c2c9cab3afe276" Jun 09 00:11:36.662378 ip-10-0-128-73 kubenswrapper[2573]: E0609 00:11:36.662359 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30bf75dff0feba15c731a1e485668290db9c96f927fb3ba778c2c9cab3afe276\": container with ID starting with 30bf75dff0feba15c731a1e485668290db9c96f927fb3ba778c2c9cab3afe276 not found: ID does not exist" containerID="30bf75dff0feba15c731a1e485668290db9c96f927fb3ba778c2c9cab3afe276" Jun 09 00:11:36.662419 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.662385 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30bf75dff0feba15c731a1e485668290db9c96f927fb3ba778c2c9cab3afe276"} err="failed to get container status \"30bf75dff0feba15c731a1e485668290db9c96f927fb3ba778c2c9cab3afe276\": rpc error: code = NotFound desc = could not find container \"30bf75dff0feba15c731a1e485668290db9c96f927fb3ba778c2c9cab3afe276\": container with ID starting with 30bf75dff0feba15c731a1e485668290db9c96f927fb3ba778c2c9cab3afe276 not found: ID does not exist" Jun 09 00:11:36.682410 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.682386 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dslng"] Jun 09 00:11:36.686533 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:36.686511 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dslng"] Jun 09 00:11:38.531751 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:38.531716 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d" path="/var/lib/kubelet/pods/ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d/volumes" Jun 09 00:11:39.549173 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:39.549136 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:11:39.645764 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:39.645712 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:11:39.696495 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:39.696458 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:11:42.854495 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:42.854451 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:11:42.951728 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:11:42.951687 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:12:11.987186 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:11.987151 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:12:12.490444 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:12.490413 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:12:12.570557 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:12.570524 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:12:12.591378 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:12.591348 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-2pf8p"] Jun 09 00:12:12.591799 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:12.591783 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d" containerName="authorino" Jun 09 00:12:12.591898 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:12.591802 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d" containerName="authorino" Jun 09 00:12:12.591953 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:12.591911 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff0ac2c3-f4b6-4a89-a93f-a75f5d1f407d" containerName="authorino" Jun 09 00:12:12.595941 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:12.595917 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-2pf8p" Jun 09 00:12:12.598570 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:12.598547 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 00:12:12.598693 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:12.598639 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9wg28\"" Jun 09 00:12:12.603702 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:12.603679 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-2pf8p"] Jun 09 00:12:12.666223 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:12.666193 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djxks\" (UniqueName: \"kubernetes.io/projected/244a8f22-feb7-4d8c-bedc-230c48eba103-kube-api-access-djxks\") pod \"payload-pre-processing-67d7689b65-2pf8p\" (UID: \"244a8f22-feb7-4d8c-bedc-230c48eba103\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-2pf8p" Jun 09 00:12:12.767277 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:12.767208 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djxks\" (UniqueName: \"kubernetes.io/projected/244a8f22-feb7-4d8c-bedc-230c48eba103-kube-api-access-djxks\") pod \"payload-pre-processing-67d7689b65-2pf8p\" (UID: \"244a8f22-feb7-4d8c-bedc-230c48eba103\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-2pf8p" Jun 09 00:12:12.775161 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:12.775125 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djxks\" (UniqueName: \"kubernetes.io/projected/244a8f22-feb7-4d8c-bedc-230c48eba103-kube-api-access-djxks\") pod \"payload-pre-processing-67d7689b65-2pf8p\" (UID: \"244a8f22-feb7-4d8c-bedc-230c48eba103\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-2pf8p" Jun 09 00:12:12.907808 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:12.907776 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-2pf8p" Jun 09 00:12:13.038891 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:13.038865 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-2pf8p"] Jun 09 00:12:13.041301 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:12:13.041272 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod244a8f22_feb7_4d8c_bedc_230c48eba103.slice/crio-c4d54474362842ada9cf1371cbac416bc1968e36926eac746fda51ac25e14d21 WatchSource:0}: Error finding container c4d54474362842ada9cf1371cbac416bc1968e36926eac746fda51ac25e14d21: Status 404 returned error can't find the container with id c4d54474362842ada9cf1371cbac416bc1968e36926eac746fda51ac25e14d21 Jun 09 00:12:13.043513 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:13.043496 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:12:13.825509 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:13.825475 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-2pf8p" event={"ID":"244a8f22-feb7-4d8c-bedc-230c48eba103","Type":"ContainerStarted","Data":"c4d54474362842ada9cf1371cbac416bc1968e36926eac746fda51ac25e14d21"} Jun 09 00:12:16.843149 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:16.843109 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-2pf8p" event={"ID":"244a8f22-feb7-4d8c-bedc-230c48eba103","Type":"ContainerStarted","Data":"349ca162c133a63116697194cf1dc483245710c6810ed011168b89c589d34f81"} Jun 09 00:12:16.843615 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:16.843171 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-2pf8p" Jun 09 00:12:16.858014 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:16.857965 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-2pf8p" podStartSLOduration=1.958686095 podStartE2EDuration="4.857945727s" totalImagesPullingTime="2.899259632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:12:16.857097963 +0000 UTC m=+786.815365568" watchObservedRunningTime="2026-06-09 00:12:16.857945727 +0000 UTC m=+786.816213331" Jun 09 00:12:20.227370 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:20.227332 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-7bf8458756-7sxzp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": read tcp 10.132.0.2:37288->10.132.0.39:15021: read: connection reset by peer" start-of-body= Jun 09 00:12:20.227811 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:20.227415 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" podUID="f7656b5f-69ca-4ccd-a1bd-622def4d6fa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": read tcp 10.132.0.2:37288->10.132.0.39:15021: read: connection reset by peer" Jun 09 00:12:20.864834 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:20.864801 2573 generic.go:356] "Generic (PLEG): container finished" podID="f7656b5f-69ca-4ccd-a1bd-622def4d6fa6" containerID="28731384241ff905d02be57c0b005c2182c42b25eda2bde1f000051569a71c77" exitCode=0 Jun 09 00:12:20.864999 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:20.864875 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" event={"ID":"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6","Type":"ContainerDied","Data":"28731384241ff905d02be57c0b005c2182c42b25eda2bde1f000051569a71c77"} Jun 09 00:12:20.865270 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:20.865255 2573 scope.go:117] "RemoveContainer" containerID="28731384241ff905d02be57c0b005c2182c42b25eda2bde1f000051569a71c77" Jun 09 00:12:20.866356 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:20.866324 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 00:12:20.866432 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:20.866414 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 00:12:20.866480 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:20.866465 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 00:12:21.872361 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:21.872281 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" event={"ID":"f7656b5f-69ca-4ccd-a1bd-622def4d6fa6","Type":"ContainerStarted","Data":"2c940efe91c51409ee3c7d651f284fbd4041ad5674976ad62d2e7ed0df67772b"} Jun 09 00:12:22.631345 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:22.631310 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:12:22.631565 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:22.631543 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-7bf8458756-7sxzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jun 09 00:12:22.631613 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:22.631592 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" podUID="f7656b5f-69ca-4ccd-a1bd-622def4d6fa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jun 09 00:12:23.631272 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:23.631236 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-7bf8458756-7sxzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jun 09 00:12:23.631684 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:23.631301 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" podUID="f7656b5f-69ca-4ccd-a1bd-622def4d6fa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jun 09 00:12:24.631688 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:24.631655 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-7bf8458756-7sxzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jun 09 00:12:24.632089 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:24.631710 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" podUID="f7656b5f-69ca-4ccd-a1bd-622def4d6fa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jun 09 00:12:25.633942 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:25.633914 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:12:25.634386 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:25.634188 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:12:25.635010 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:25.634991 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7bf8458756-7sxzp" Jun 09 00:12:27.850661 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:12:27.850626 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-2pf8p" Jun 09 00:13:02.950572 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:02.950535 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:13:03.053888 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:03.053857 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:13:06.475516 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:06.475478 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:13:09.124277 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:09.124234 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:13:09.225298 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:09.225265 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:13:12.735515 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:12.735483 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:13:12.789274 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:12.789240 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:13:15.235550 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.235517 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd"] Jun 09 00:13:15.239572 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.239547 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.244274 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.244253 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f7nfn\"" Jun 09 00:13:15.244525 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.244509 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 00:13:15.245358 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.245338 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 00:13:15.245700 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.245682 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 09 00:13:15.252822 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.252802 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd"] Jun 09 00:13:15.274445 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.274411 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:13:15.341850 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.341825 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d13560b3-c529-4bf4-ab2f-b0516fd782dc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.341956 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.341862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d13560b3-c529-4bf4-ab2f-b0516fd782dc-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.341956 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.341880 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v82w6\" (UniqueName: \"kubernetes.io/projected/d13560b3-c529-4bf4-ab2f-b0516fd782dc-kube-api-access-v82w6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.341956 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.341939 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d13560b3-c529-4bf4-ab2f-b0516fd782dc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.342066 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.341961 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d13560b3-c529-4bf4-ab2f-b0516fd782dc-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.342066 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.341991 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d13560b3-c529-4bf4-ab2f-b0516fd782dc-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.443045 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.443010 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d13560b3-c529-4bf4-ab2f-b0516fd782dc-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.443045 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.443047 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v82w6\" (UniqueName: \"kubernetes.io/projected/d13560b3-c529-4bf4-ab2f-b0516fd782dc-kube-api-access-v82w6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.443236 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.443085 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d13560b3-c529-4bf4-ab2f-b0516fd782dc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.443236 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.443129 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d13560b3-c529-4bf4-ab2f-b0516fd782dc-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.443236 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.443166 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d13560b3-c529-4bf4-ab2f-b0516fd782dc-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.443382 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.443279 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d13560b3-c529-4bf4-ab2f-b0516fd782dc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.443692 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.443664 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d13560b3-c529-4bf4-ab2f-b0516fd782dc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.443692 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.443682 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d13560b3-c529-4bf4-ab2f-b0516fd782dc-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.444042 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.443851 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d13560b3-c529-4bf4-ab2f-b0516fd782dc-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.445504 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.445480 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d13560b3-c529-4bf4-ab2f-b0516fd782dc-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.445618 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.445601 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d13560b3-c529-4bf4-ab2f-b0516fd782dc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.450779 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.450758 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v82w6\" (UniqueName: \"kubernetes.io/projected/d13560b3-c529-4bf4-ab2f-b0516fd782dc-kube-api-access-v82w6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd\" (UID: \"d13560b3-c529-4bf4-ab2f-b0516fd782dc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.551256 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.551188 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:15.687047 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:15.687024 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd"] Jun 09 00:13:15.689022 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:13:15.688982 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13560b3_c529_4bf4_ab2f_b0516fd782dc.slice/crio-5609a16bb6b565695aeb04a6107622f2d65f09ceb195d8485c983ba9c2246cfd WatchSource:0}: Error finding container 5609a16bb6b565695aeb04a6107622f2d65f09ceb195d8485c983ba9c2246cfd: Status 404 returned error can't find the container with id 5609a16bb6b565695aeb04a6107622f2d65f09ceb195d8485c983ba9c2246cfd Jun 09 00:13:16.120809 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:16.120767 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" event={"ID":"d13560b3-c529-4bf4-ab2f-b0516fd782dc","Type":"ContainerStarted","Data":"5609a16bb6b565695aeb04a6107622f2d65f09ceb195d8485c983ba9c2246cfd"} Jun 09 00:13:20.146457 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:20.146427 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" event={"ID":"d13560b3-c529-4bf4-ab2f-b0516fd782dc","Type":"ContainerStarted","Data":"45c030c0e64bcc9f9c8368020a5cf465f3455e0c5e78fb12f76a06b5158cd613"} Jun 09 00:13:22.158451 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:22.158412 2573 generic.go:356] "Generic (PLEG): container finished" podID="d13560b3-c529-4bf4-ab2f-b0516fd782dc" containerID="45c030c0e64bcc9f9c8368020a5cf465f3455e0c5e78fb12f76a06b5158cd613" exitCode=0 Jun 09 00:13:22.158902 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:22.158484 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" event={"ID":"d13560b3-c529-4bf4-ab2f-b0516fd782dc","Type":"ContainerDied","Data":"45c030c0e64bcc9f9c8368020a5cf465f3455e0c5e78fb12f76a06b5158cd613"} Jun 09 00:13:24.172627 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:24.172594 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" event={"ID":"d13560b3-c529-4bf4-ab2f-b0516fd782dc","Type":"ContainerStarted","Data":"95f02ad1a00255a7dd937801ede543b6a58481165cd154eab990e3fa46468d87"} Jun 09 00:13:24.192869 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:24.192817 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" podStartSLOduration=2.427204853 podStartE2EDuration="9.192803484s" totalImagesPullingTime="5.524979363s" totalInitContainerRuntime="1.240619268s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:13:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:13:24.191206087 +0000 UTC m=+854.149473688" watchObservedRunningTime="2026-06-09 00:13:24.192803484 +0000 UTC m=+854.151071088" Jun 09 00:13:25.551929 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:25.551896 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:25.552337 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:25.551961 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:25.564596 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:25.564573 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:26.057931 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:26.057892 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:13:26.195501 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:26.195476 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd" Jun 09 00:13:33.841782 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:33.841734 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:13:41.342194 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.342160 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d"] Jun 09 00:13:41.362282 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.362247 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d"] Jun 09 00:13:41.362426 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.362397 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.366694 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.366673 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 00:13:41.381813 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.381788 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:13:41.479795 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.479769 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6f15d82-5bee-45c9-9a6b-dcfb91259033-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.479927 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.479808 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6f15d82-5bee-45c9-9a6b-dcfb91259033-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.479927 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.479862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k99mh\" (UniqueName: \"kubernetes.io/projected/d6f15d82-5bee-45c9-9a6b-dcfb91259033-kube-api-access-k99mh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.479927 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.479911 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d6f15d82-5bee-45c9-9a6b-dcfb91259033-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.480037 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.479938 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6f15d82-5bee-45c9-9a6b-dcfb91259033-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.480037 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.479962 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6f15d82-5bee-45c9-9a6b-dcfb91259033-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.581093 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.581064 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6f15d82-5bee-45c9-9a6b-dcfb91259033-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.581266 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.581108 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k99mh\" (UniqueName: \"kubernetes.io/projected/d6f15d82-5bee-45c9-9a6b-dcfb91259033-kube-api-access-k99mh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.581266 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.581155 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d6f15d82-5bee-45c9-9a6b-dcfb91259033-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.581266 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.581179 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6f15d82-5bee-45c9-9a6b-dcfb91259033-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.581266 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.581201 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6f15d82-5bee-45c9-9a6b-dcfb91259033-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.581480 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.581274 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6f15d82-5bee-45c9-9a6b-dcfb91259033-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.581621 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.581600 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d6f15d82-5bee-45c9-9a6b-dcfb91259033-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.581695 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.581643 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6f15d82-5bee-45c9-9a6b-dcfb91259033-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.581695 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.581682 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6f15d82-5bee-45c9-9a6b-dcfb91259033-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.583529 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.583512 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6f15d82-5bee-45c9-9a6b-dcfb91259033-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.583810 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.583791 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6f15d82-5bee-45c9-9a6b-dcfb91259033-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.588633 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.588607 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k99mh\" (UniqueName: \"kubernetes.io/projected/d6f15d82-5bee-45c9-9a6b-dcfb91259033-kube-api-access-k99mh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d\" (UID: \"d6f15d82-5bee-45c9-9a6b-dcfb91259033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.673362 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.673292 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:41.815517 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:41.815449 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d"] Jun 09 00:13:41.817973 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:13:41.817948 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f15d82_5bee_45c9_9a6b_dcfb91259033.slice/crio-6535dd0546cebe8a1de8fd137bdc6989cd4202b7cb7a96f34b735c645981dd87 WatchSource:0}: Error finding container 6535dd0546cebe8a1de8fd137bdc6989cd4202b7cb7a96f34b735c645981dd87: Status 404 returned error can't find the container with id 6535dd0546cebe8a1de8fd137bdc6989cd4202b7cb7a96f34b735c645981dd87 Jun 09 00:13:42.261648 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:42.261604 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" event={"ID":"d6f15d82-5bee-45c9-9a6b-dcfb91259033","Type":"ContainerStarted","Data":"916a7341aa8bf18cb159c0abe8131eb45b0589d096ee635d51b363847c19e4fe"} Jun 09 00:13:42.261863 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:42.261672 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" event={"ID":"d6f15d82-5bee-45c9-9a6b-dcfb91259033","Type":"ContainerStarted","Data":"6535dd0546cebe8a1de8fd137bdc6989cd4202b7cb7a96f34b735c645981dd87"} Jun 09 00:13:43.267409 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:43.267371 2573 generic.go:356] "Generic (PLEG): container finished" podID="d6f15d82-5bee-45c9-9a6b-dcfb91259033" containerID="916a7341aa8bf18cb159c0abe8131eb45b0589d096ee635d51b363847c19e4fe" exitCode=0 Jun 09 00:13:43.267700 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:43.267435 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" event={"ID":"d6f15d82-5bee-45c9-9a6b-dcfb91259033","Type":"ContainerDied","Data":"916a7341aa8bf18cb159c0abe8131eb45b0589d096ee635d51b363847c19e4fe"} Jun 09 00:13:44.277020 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:44.276987 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" event={"ID":"d6f15d82-5bee-45c9-9a6b-dcfb91259033","Type":"ContainerStarted","Data":"9d04bb00c49bc5b7afa5392211842b2f22b9a41ebbdd88424d908b0b073ffccf"} Jun 09 00:13:44.293015 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:44.292953 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" podStartSLOduration=1.765469025 podStartE2EDuration="3.292938035s" totalImagesPullingTime="192.269168ms" totalInitContainerRuntime="1.335199842s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:13:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:13:44.292378811 +0000 UTC m=+874.250646415" watchObservedRunningTime="2026-06-09 00:13:44.292938035 +0000 UTC m=+874.251205630" Jun 09 00:13:49.733143 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.733108 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc"] Jun 09 00:13:49.738159 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.738134 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.740526 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.740505 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 00:13:49.746673 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.746654 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc"] Jun 09 00:13:49.760555 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.760526 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:13:49.851660 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.851635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfdgx\" (UniqueName: \"kubernetes.io/projected/4480afeb-7d0f-46d0-8323-c9fd431e66b8-kube-api-access-bfdgx\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.851809 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.851673 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4480afeb-7d0f-46d0-8323-c9fd431e66b8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.851809 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.851711 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4480afeb-7d0f-46d0-8323-c9fd431e66b8-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.851893 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.851848 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4480afeb-7d0f-46d0-8323-c9fd431e66b8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.851933 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.851906 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4480afeb-7d0f-46d0-8323-c9fd431e66b8-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.851970 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.851929 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4480afeb-7d0f-46d0-8323-c9fd431e66b8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.953296 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.953260 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4480afeb-7d0f-46d0-8323-c9fd431e66b8-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.953440 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.953305 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4480afeb-7d0f-46d0-8323-c9fd431e66b8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.953440 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.953346 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfdgx\" (UniqueName: \"kubernetes.io/projected/4480afeb-7d0f-46d0-8323-c9fd431e66b8-kube-api-access-bfdgx\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.953440 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.953394 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4480afeb-7d0f-46d0-8323-c9fd431e66b8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.953597 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.953444 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4480afeb-7d0f-46d0-8323-c9fd431e66b8-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.953597 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.953511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4480afeb-7d0f-46d0-8323-c9fd431e66b8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.953855 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.953833 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4480afeb-7d0f-46d0-8323-c9fd431e66b8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.953961 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.953871 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4480afeb-7d0f-46d0-8323-c9fd431e66b8-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.954005 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.953969 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4480afeb-7d0f-46d0-8323-c9fd431e66b8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.955984 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.955965 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4480afeb-7d0f-46d0-8323-c9fd431e66b8-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.956365 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.956345 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4480afeb-7d0f-46d0-8323-c9fd431e66b8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:49.960250 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:49.960230 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfdgx\" (UniqueName: \"kubernetes.io/projected/4480afeb-7d0f-46d0-8323-c9fd431e66b8-kube-api-access-bfdgx\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc\" (UID: \"4480afeb-7d0f-46d0-8323-c9fd431e66b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:50.076584 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:50.076507 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:13:50.212449 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:50.212421 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc"] Jun 09 00:13:50.214892 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:13:50.214854 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4480afeb_7d0f_46d0_8323_c9fd431e66b8.slice/crio-d6c890e8bbb1cf1a27a7062ed11396f731047527df2d1188eeddba119e3c4024 WatchSource:0}: Error finding container d6c890e8bbb1cf1a27a7062ed11396f731047527df2d1188eeddba119e3c4024: Status 404 returned error can't find the container with id d6c890e8bbb1cf1a27a7062ed11396f731047527df2d1188eeddba119e3c4024 Jun 09 00:13:50.311613 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:50.311569 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" event={"ID":"4480afeb-7d0f-46d0-8323-c9fd431e66b8","Type":"ContainerStarted","Data":"3ed48a918676cf66cfc332906f15aa6e124db2a325295dc66714947d353b5c04"} Jun 09 00:13:50.311613 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:50.311620 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" event={"ID":"4480afeb-7d0f-46d0-8323-c9fd431e66b8","Type":"ContainerStarted","Data":"d6c890e8bbb1cf1a27a7062ed11396f731047527df2d1188eeddba119e3c4024"} Jun 09 00:13:51.673958 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:51.673916 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:51.674341 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:51.674002 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:51.688137 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:51.688111 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:52.332156 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:52.332131 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d" Jun 09 00:13:54.337371 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:54.337336 2573 generic.go:356] "Generic (PLEG): container finished" podID="4480afeb-7d0f-46d0-8323-c9fd431e66b8" containerID="3ed48a918676cf66cfc332906f15aa6e124db2a325295dc66714947d353b5c04" exitCode=0 Jun 09 00:13:54.337787 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:54.337380 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" event={"ID":"4480afeb-7d0f-46d0-8323-c9fd431e66b8","Type":"ContainerDied","Data":"3ed48a918676cf66cfc332906f15aa6e124db2a325295dc66714947d353b5c04"} Jun 09 00:13:55.347255 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:55.347212 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" event={"ID":"4480afeb-7d0f-46d0-8323-c9fd431e66b8","Type":"ContainerStarted","Data":"07c2bdaea57923dac84f9e1d9593a9674406d72870a92f6dd1a1136cf0ec9c52"} Jun 09 00:13:55.366580 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:13:55.366532 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" podStartSLOduration=2.764717294 podStartE2EDuration="6.366519535s" totalImagesPullingTime="193.147775ms" totalInitContainerRuntime="3.408654466s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:13:55.364139759 +0000 UTC m=+885.322407386" watchObservedRunningTime="2026-06-09 00:13:55.366519535 +0000 UTC m=+885.324787140" Jun 09 00:14:00.076980 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:14:00.076945 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:14:00.077384 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:14:00.077003 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:14:00.090001 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:14:00.089978 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:14:00.380783 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:14:00.380689 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc" Jun 09 00:14:00.763850 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:14:00.763814 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:14:10.547564 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:14:10.547529 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/2.log" Jun 09 00:14:10.548060 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:14:10.547759 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/2.log" Jun 09 00:14:10.552294 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:14:10.552272 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-twgfd_219c3767-e998-4f79-a227-45681847cac2/ovn-acl-logging/0.log" Jun 09 00:14:10.552482 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:14:10.552470 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-twgfd_219c3767-e998-4f79-a227-45681847cac2/ovn-acl-logging/0.log" Jun 09 00:14:35.668013 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:14:35.667977 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:14:36.680714 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:14:36.680679 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:14:36.785197 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:14:36.785161 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:14:36.882167 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:14:36.882141 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:15:04.859308 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:15:04.859270 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:16:05.130016 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:16:05.129919 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:16:06.636592 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:16:06.636554 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:16:35.258615 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:16:35.258574 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:01.624642 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:01.624537 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:01.725413 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:01.725376 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:01.829604 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:01.829575 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:02.354299 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:02.354263 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:02.457363 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:02.457329 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:03.653634 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:03.653594 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:25.575466 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:25.575421 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:31.342964 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:31.342930 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:31.450842 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:31.450802 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:31.543401 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:31.543368 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:31.703400 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:31.703323 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:31.806488 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:31.806447 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:48.215180 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:48.215143 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:48.322001 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:48.321960 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:48.428016 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:48.427982 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:54.006193 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:54.006160 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:17:54.060109 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:17:54.060078 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:18:02.147190 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:02.147139 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:18:02.245623 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:02.245584 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:18:02.345789 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:02.345721 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:18:02.450814 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:02.445286 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:18:17.601857 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:17.601819 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:18:18.869023 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:18.868987 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:18:19.000144 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:19.000107 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:18:19.096697 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:19.096663 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:18:24.784124 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:24.784043 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:18:24.885080 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:24.885027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:18:37.841813 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:37.841775 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-679cf9c744-dxmlt_bb2954fb-cf17-4c5a-8be8-8881f526c23a/nginx/0.log" Jun 09 00:18:38.197006 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:38.196923 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-p8bjg_f8fa6092-7a47-4eab-883a-6d99c4fab20f/manager/0.log" Jun 09 00:18:38.906420 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:38.906394 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569d667bc9-gzvhz_3c6f1abf-b12e-433e-9e8c-63ed84c992b1/copy-manifests/0.log" Jun 09 00:18:38.924889 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:38.924863 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569d667bc9-gzvhz_3c6f1abf-b12e-433e-9e8c-63ed84c992b1/manager/0.log" Jun 09 00:18:40.551687 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:40.551660 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5v54k_82b595b6-4056-44f1-8710-a4475a554612/kuadrant-console-plugin/0.log" Jun 09 00:18:40.672802 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:40.672762 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jgvmv_d6ca2ed7-e83c-422a-bbab-51f35745de69/registry-server/0.log" Jun 09 00:18:40.791481 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:40.791447 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2cnvq_beede597-624d-4f05-b0f2-571dc2ba53db/manager/0.log" Jun 09 00:18:41.844900 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:41.844872 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7bf8458756-7sxzp_f7656b5f-69ca-4ccd-a1bd-622def4d6fa6/istio-proxy/1.log" Jun 09 00:18:41.968010 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:41.967978 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-2pf8p_244a8f22-feb7-4d8c-bedc-230c48eba103/payload-pre-processing/0.log" Jun 09 00:18:42.185572 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:42.185485 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5698bdd995-q7cpq_3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e/router/0.log" Jun 09 00:18:42.519176 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:42.519143 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd_d13560b3-c529-4bf4-ab2f-b0516fd782dc/main/0.log" Jun 09 00:18:42.525946 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:42.525923 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-5wfpd_d13560b3-c529-4bf4-ab2f-b0516fd782dc/storage-initializer/0.log" Jun 09 00:18:42.866622 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:42.866528 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d_d6f15d82-5bee-45c9-9a6b-dcfb91259033/storage-initializer/0.log" Jun 09 00:18:42.873686 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:42.873663 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2h79d_d6f15d82-5bee-45c9-9a6b-dcfb91259033/main/0.log" Jun 09 00:18:42.979052 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:42.979025 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc_4480afeb-7d0f-46d0-8323-c9fd431e66b8/storage-initializer/0.log" Jun 09 00:18:42.986874 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:42.986850 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-x8vgc_4480afeb-7d0f-46d0-8323-c9fd431e66b8/main/0.log" Jun 09 00:18:47.512434 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:47.512396 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:18:47.565930 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:47.565896 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" limit=1024 Jun 09 00:18:50.347330 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:50.347299 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nr9c8_36d64b55-58c7-4005-859a-0a895a3a1971/global-pull-secret-syncer/0.log" Jun 09 00:18:50.399509 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:50.399476 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d2xbc_11c3f5bf-538b-4ca6-8d53-e3562fa2e54e/konnectivity-agent/0.log" Jun 09 00:18:50.482582 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:50.482554 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-73.ec2.internal_58267d6e6471fb16c1b68a4f6cfaa490/haproxy/0.log" Jun 09 00:18:55.443989 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:55.443958 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5v54k_82b595b6-4056-44f1-8710-a4475a554612/kuadrant-console-plugin/0.log" Jun 09 00:18:55.488393 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:55.488366 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jgvmv_d6ca2ed7-e83c-422a-bbab-51f35745de69/registry-server/0.log" Jun 09 00:18:55.557843 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:55.557803 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2cnvq_beede597-624d-4f05-b0f2-571dc2ba53db/manager/0.log" Jun 09 00:18:57.563790 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:57.563688 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-l6vjd_e8916f13-b757-4cec-a113-2d911ab93e82/monitoring-plugin/0.log" Jun 09 00:18:57.781120 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:57.781089 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r54vt_0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3/node-exporter/0.log" Jun 09 00:18:57.800526 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:57.800506 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r54vt_0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3/kube-rbac-proxy/0.log" Jun 09 00:18:57.825995 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:57.825941 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r54vt_0bab9443-ae84-4ee1-8aaa-f87b43c5dbd3/init-textfile/0.log" Jun 09 00:18:57.863205 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:57.863185 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jjvt7_82390fe9-ff3f-4e43-83a7-fd4177de8788/kube-rbac-proxy-main/0.log" Jun 09 00:18:57.880692 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:57.880674 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jjvt7_82390fe9-ff3f-4e43-83a7-fd4177de8788/kube-rbac-proxy-self/0.log" Jun 09 00:18:57.902965 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:57.902941 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jjvt7_82390fe9-ff3f-4e43-83a7-fd4177de8788/openshift-state-metrics/0.log" Jun 09 00:18:57.948333 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:57.948313 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0693718-9f76-490c-95e9-0f6e44a242db/prometheus/0.log" Jun 09 00:18:57.979008 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:57.978985 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0693718-9f76-490c-95e9-0f6e44a242db/config-reloader/0.log" Jun 09 00:18:58.001234 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:58.001213 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0693718-9f76-490c-95e9-0f6e44a242db/thanos-sidecar/0.log" Jun 09 00:18:58.023351 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:58.023324 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0693718-9f76-490c-95e9-0f6e44a242db/kube-rbac-proxy-web/0.log" Jun 09 00:18:58.053642 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:58.053621 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0693718-9f76-490c-95e9-0f6e44a242db/kube-rbac-proxy/0.log" Jun 09 00:18:58.073437 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:58.073419 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0693718-9f76-490c-95e9-0f6e44a242db/kube-rbac-proxy-thanos/0.log" Jun 09 00:18:58.093143 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:58.093082 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0693718-9f76-490c-95e9-0f6e44a242db/init-config-reloader/0.log" Jun 09 00:18:58.122969 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:58.122946 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-d7t5k_66de382a-aa45-45c4-b3cc-b3c6a9f60d86/prometheus-operator/0.log" Jun 09 00:18:58.138849 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:58.138830 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-d7t5k_66de382a-aa45-45c4-b3cc-b3c6a9f60d86/kube-rbac-proxy/0.log" Jun 09 00:18:58.193019 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:18:58.192979 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-gwtfg_d4f1e2f4-1a8c-4b6d-93ee-2723a860800b/prometheus-operator-admission-webhook/0.log" Jun 09 00:19:00.428758 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:00.428719 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/2.log" Jun 09 00:19:00.437200 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:00.437169 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/3.log" Jun 09 00:19:00.997359 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:00.997324 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-jf6pl_0fb0b7bc-1c28-4aa6-868c-ac54c7ec608a/download-server/0.log" Jun 09 00:19:01.545020 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.544987 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9"] Jun 09 00:19:01.548476 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.548455 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.550843 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.550822 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b7dvg\"/\"kube-root-ca.crt\"" Jun 09 00:19:01.550948 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.550822 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b7dvg\"/\"openshift-service-ca.crt\"" Jun 09 00:19:01.551577 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.551563 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b7dvg\"/\"default-dockercfg-gj2w4\"" Jun 09 00:19:01.558490 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.558467 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9"] Jun 09 00:19:01.675517 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.675482 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-proc\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.675670 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.675551 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-sys\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.675670 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.675610 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lklrx\" (UniqueName: \"kubernetes.io/projected/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-kube-api-access-lklrx\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.675670 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.675663 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-podres\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.675814 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.675688 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-lib-modules\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.730588 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.730563 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-92qnq_f7566520-eef1-4e98-8240-1d5561056a0f/volume-data-source-validator/0.log" Jun 09 00:19:01.776542 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.776520 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-sys\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.776701 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.776560 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lklrx\" (UniqueName: \"kubernetes.io/projected/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-kube-api-access-lklrx\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.776701 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.776589 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-podres\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.776701 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.776606 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-lib-modules\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.776701 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.776635 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-proc\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.776701 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.776636 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-sys\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.777018 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.776776 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-proc\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.777018 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.776793 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-lib-modules\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.777018 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.776825 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-podres\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.783795 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.783770 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lklrx\" (UniqueName: \"kubernetes.io/projected/5fd90011-ac99-4efd-ae09-4beaa3df5d6e-kube-api-access-lklrx\") pod \"perf-node-gather-daemonset-6g6n9\" (UID: \"5fd90011-ac99-4efd-ae09-4beaa3df5d6e\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.860023 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.859939 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:01.991904 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:01.991881 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9"] Jun 09 00:19:01.994135 ip-10-0-128-73 kubenswrapper[2573]: W0609 00:19:01.994108 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5fd90011_ac99_4efd_ae09_4beaa3df5d6e.slice/crio-a11617226d4e23604a339293b939aea39419e48aa5f911cba807e9a8808eb7d2 WatchSource:0}: Error finding container a11617226d4e23604a339293b939aea39419e48aa5f911cba807e9a8808eb7d2: Status 404 returned error can't find the container with id a11617226d4e23604a339293b939aea39419e48aa5f911cba807e9a8808eb7d2 Jun 09 00:19:02.870819 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:02.870780 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" event={"ID":"5fd90011-ac99-4efd-ae09-4beaa3df5d6e","Type":"ContainerStarted","Data":"8cb9425df24c2a494460cba99ae264ca9c7c94e139f7e3a8f268b95260940faf"} Jun 09 00:19:02.871240 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:02.870838 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" event={"ID":"5fd90011-ac99-4efd-ae09-4beaa3df5d6e","Type":"ContainerStarted","Data":"a11617226d4e23604a339293b939aea39419e48aa5f911cba807e9a8808eb7d2"} Jun 09 00:19:02.871240 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:02.870974 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:02.879132 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:02.879113 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4ch68_7ab4dd6e-79b1-4298-b7a8-d77b6f985b82/dns/0.log" Jun 09 00:19:02.900189 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:02.900158 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4ch68_7ab4dd6e-79b1-4298-b7a8-d77b6f985b82/kube-rbac-proxy/0.log" Jun 09 00:19:03.017197 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:03.017162 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r4ksj_3a35b02f-c44e-4acc-b9d1-233b8d5b9d4e/dns-node-resolver/0.log" Jun 09 00:19:03.606555 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:03.606527 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6cn9v_3de9a184-ebf5-487a-b4c9-0f657559543b/node-ca/0.log" Jun 09 00:19:04.688903 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:04.688868 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7bf8458756-7sxzp_f7656b5f-69ca-4ccd-a1bd-622def4d6fa6/istio-proxy/0.log" Jun 09 00:19:04.705465 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:04.705433 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7bf8458756-7sxzp_f7656b5f-69ca-4ccd-a1bd-622def4d6fa6/istio-proxy/1.log" Jun 09 00:19:04.739672 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:04.739649 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-2pf8p_244a8f22-feb7-4d8c-bedc-230c48eba103/payload-pre-processing/0.log" Jun 09 00:19:04.780950 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:04.780918 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5698bdd995-q7cpq_3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e/router/0.log" Jun 09 00:19:05.448193 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:05.448158 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qjl4k_2eac10de-440f-4fb9-83f1-b8f24050fd42/serve-healthcheck-canary/0.log" Jun 09 00:19:05.924717 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:05.924687 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-h26mm_97475d09-d6f9-4643-888f-2b941dcebba9/insights-operator/0.log" Jun 09 00:19:05.928109 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:05.928086 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-h26mm_97475d09-d6f9-4643-888f-2b941dcebba9/insights-operator/1.log" Jun 09 00:19:06.016497 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:06.016472 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nkszf_5893e69d-fed6-47d6-875e-02698ce882c5/kube-rbac-proxy/0.log" Jun 09 00:19:06.035165 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:06.035138 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nkszf_5893e69d-fed6-47d6-875e-02698ce882c5/exporter/0.log" Jun 09 00:19:06.055467 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:06.055446 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nkszf_5893e69d-fed6-47d6-875e-02698ce882c5/extractor/0.log" Jun 09 00:19:08.313370 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:08.313337 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-679cf9c744-dxmlt_bb2954fb-cf17-4c5a-8be8-8881f526c23a/nginx/0.log" Jun 09 00:19:08.423963 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:08.423927 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-p8bjg_f8fa6092-7a47-4eab-883a-6d99c4fab20f/manager/0.log" Jun 09 00:19:08.711435 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:08.711357 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569d667bc9-gzvhz_3c6f1abf-b12e-433e-9e8c-63ed84c992b1/manager/0.log" Jun 09 00:19:08.734812 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:08.734784 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569d667bc9-gzvhz_3c6f1abf-b12e-433e-9e8c-63ed84c992b1/copy-manifests/0.log" Jun 09 00:19:08.884828 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:08.884799 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" Jun 09 00:19:08.900836 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:08.900792 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-6g6n9" podStartSLOduration=7.900778009 podStartE2EDuration="7.900778009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:19:02.884381372 +0000 UTC m=+1192.842648988" watchObservedRunningTime="2026-06-09 00:19:08.900778009 +0000 UTC m=+1198.859045640" Jun 09 00:19:10.243832 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:10.243799 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f4484c748-6pb7x_425588f3-c856-4316-a776-7bf0cd239558/manager/0.log" Jun 09 00:19:10.579492 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:10.579463 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/2.log" Jun 09 00:19:10.579867 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:10.579847 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hrzw9_23e2ea38-cbb7-4a18-a6f3-858f73866c55/console-operator/2.log" Jun 09 00:19:10.584045 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:10.583991 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-twgfd_219c3767-e998-4f79-a227-45681847cac2/ovn-acl-logging/0.log" Jun 09 00:19:10.584134 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:10.584030 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-twgfd_219c3767-e998-4f79-a227-45681847cac2/ovn-acl-logging/0.log" Jun 09 00:19:15.224712 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:15.224676 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7bf8458756-7sxzp_f7656b5f-69ca-4ccd-a1bd-622def4d6fa6/istio-proxy/0.log" Jun 09 00:19:15.240778 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:15.240754 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7bf8458756-7sxzp_f7656b5f-69ca-4ccd-a1bd-622def4d6fa6/istio-proxy/1.log" Jun 09 00:19:15.266624 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:15.266601 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-2pf8p_244a8f22-feb7-4d8c-bedc-230c48eba103/payload-pre-processing/0.log" Jun 09 00:19:15.295727 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:15.295704 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5698bdd995-q7cpq_3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e/router/0.log" Jun 09 00:19:16.039225 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:16.039190 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-g89kg_ed9bb569-7c77-4fe2-91e6-271914697329/kube-storage-version-migrator-operator/1.log" Jun 09 00:19:16.041003 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:16.040977 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-g89kg_ed9bb569-7c77-4fe2-91e6-271914697329/kube-storage-version-migrator-operator/0.log" Jun 09 00:19:16.448406 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:16.448322 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7bf8458756-7sxzp_f7656b5f-69ca-4ccd-a1bd-622def4d6fa6/istio-proxy/0.log" Jun 09 00:19:16.463911 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:16.463889 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7bf8458756-7sxzp_f7656b5f-69ca-4ccd-a1bd-622def4d6fa6/istio-proxy/1.log" Jun 09 00:19:16.491358 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:16.491336 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-2pf8p_244a8f22-feb7-4d8c-bedc-230c48eba103/payload-pre-processing/0.log" Jun 09 00:19:16.521862 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:16.521842 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5698bdd995-q7cpq_3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e/router/0.log" Jun 09 00:19:17.135986 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:17.135966 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9sncw_675ca9df-c1ee-4798-9dbd-7bfe881cf901/kube-multus/0.log" Jun 09 00:19:17.161531 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:17.161506 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8l77g_26cea4d5-7028-4cf2-99b2-b8241284895e/kube-multus-additional-cni-plugins/0.log" Jun 09 00:19:17.183920 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:17.183894 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8l77g_26cea4d5-7028-4cf2-99b2-b8241284895e/egress-router-binary-copy/0.log" Jun 09 00:19:17.205469 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:17.205449 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8l77g_26cea4d5-7028-4cf2-99b2-b8241284895e/cni-plugins/0.log" Jun 09 00:19:17.224815 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:17.224796 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8l77g_26cea4d5-7028-4cf2-99b2-b8241284895e/bond-cni-plugin/0.log" Jun 09 00:19:17.245300 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:17.245282 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8l77g_26cea4d5-7028-4cf2-99b2-b8241284895e/routeoverride-cni/0.log" Jun 09 00:19:17.267215 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:17.267191 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8l77g_26cea4d5-7028-4cf2-99b2-b8241284895e/whereabouts-cni-bincopy/0.log" Jun 09 00:19:17.291713 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:17.291688 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8l77g_26cea4d5-7028-4cf2-99b2-b8241284895e/whereabouts-cni/0.log" Jun 09 00:19:17.736384 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:17.736348 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tcxq6_314dabf5-096d-442a-9db1-83512bf87f66/network-metrics-daemon/0.log" Jun 09 00:19:17.753273 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:17.753247 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tcxq6_314dabf5-096d-442a-9db1-83512bf87f66/kube-rbac-proxy/0.log" Jun 09 00:19:18.095143 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:18.095051 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7bf8458756-7sxzp_f7656b5f-69ca-4ccd-a1bd-622def4d6fa6/istio-proxy/0.log" Jun 09 00:19:18.111612 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:18.111585 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7bf8458756-7sxzp_f7656b5f-69ca-4ccd-a1bd-622def4d6fa6/istio-proxy/1.log" Jun 09 00:19:18.135404 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:18.135382 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-2pf8p_244a8f22-feb7-4d8c-bedc-230c48eba103/payload-pre-processing/0.log" Jun 09 00:19:18.159429 ip-10-0-128-73 kubenswrapper[2573]: I0609 00:19:18.159404 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5698bdd995-q7cpq_3429dbd5-d4a7-4e7c-87dc-4b41e453ba5e/router/0.log"