Jul 09 16:50:29.481573 ip-10-0-132-57 systemd[1]: Starting Kubernetes Kubelet... Jul 09 16:50:30.265041 ip-10-0-132-57 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:50:30.265041 ip-10-0-132-57 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 16:50:30.265041 ip-10-0-132-57 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:50:30.265041 ip-10-0-132-57 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 16:50:30.265041 ip-10-0-132-57 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:50:30.265041 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.942554 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 16:50:30.265041 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948723 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:50:30.265041 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948739 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:50:30.265041 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948742 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:50:30.265041 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948747 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:50:30.265041 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948750 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:50:30.265041 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948752 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:50:30.265041 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948755 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:50:30.265041 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948758 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948760 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948763 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948765 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948768 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948770 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948773 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948776 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948779 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948781 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948784 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948786 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948789 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948792 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948794 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948797 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948799 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948801 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948806 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:50:30.276745 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948811 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:50:30.020456 ip-10-0-132-57 systemd[1]: Started Kubernetes Kubelet. Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948814 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948817 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948820 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948823 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948826 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948829 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948831 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948834 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948836 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948839 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948842 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948845 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948847 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948850 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948852 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948854 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948857 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948861 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:50:30.279172 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948865 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948867 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948870 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948872 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948875 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948879 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948882 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948884 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948887 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948889 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948892 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948894 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948898 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948900 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948903 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948906 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948933 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948937 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948940 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948943 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:50:30.281846 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948946 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948950 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948954 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948956 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948959 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948962 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948966 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948970 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948973 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948976 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948979 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948982 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948985 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948988 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948990 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948993 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948995 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.948998 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949002 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949004 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:50:30.283170 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949007 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949009 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949012 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949014 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949017 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949019 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949022 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949025 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949028 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949030 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949034 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949036 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949039 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.949042 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951681 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951690 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951694 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951697 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951700 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951703 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:50:30.284126 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951707 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951710 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951712 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951715 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951718 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951721 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951724 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951726 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951729 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951731 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951734 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951738 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951740 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951744 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951746 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951749 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951751 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951754 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951758 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951760 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:50:30.284945 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951763 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951765 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951768 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951770 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951773 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951775 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951778 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951780 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951784 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951786 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951789 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951791 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951794 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951796 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951799 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951801 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951804 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951806 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951809 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951812 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:50:30.285608 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951815 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951818 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951820 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951823 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951826 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951829 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951831 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951834 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951837 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951841 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951846 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951849 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951852 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951856 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951859 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951861 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951866 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951868 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951872 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:50:30.286236 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951875 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951879 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951882 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951884 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951887 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951890 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951893 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951896 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951899 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951902 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951905 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951908 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951911 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951914 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951916 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951919 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951922 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951924 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951928 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951931 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:50:30.286888 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951933 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951936 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951938 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951940 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951943 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951945 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951949 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951952 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951954 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951957 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951959 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951961 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951964 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.951966 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952434 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952440 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952444 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952447 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952449 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:50:30.287591 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952453 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952456 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952459 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952462 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952465 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952468 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952471 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952474 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952477 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952479 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952482 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952487 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952489 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952492 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952494 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952497 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952500 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952502 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952505 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952510 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:50:30.288184 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952512 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952515 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952517 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952520 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952523 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952525 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952529 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952533 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952537 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952539 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952542 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952545 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952547 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952550 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952552 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952555 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952557 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952560 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952562 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:50:30.288902 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952564 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952567 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952570 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952572 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952576 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952583 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952586 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952589 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952591 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952594 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952596 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952599 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952603 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952605 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952608 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952610 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952613 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952615 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952618 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:50:30.289525 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952620 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952622 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952625 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952628 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952630 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952632 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952636 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952638 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952641 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952643 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952646 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952648 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952651 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952653 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952656 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952659 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952661 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952665 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952668 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952670 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:50:30.290084 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952675 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952677 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952680 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952683 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952685 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952689 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952691 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952694 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952697 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952699 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952702 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952704 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952707 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952709 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952713 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.952717 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952787 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952794 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952800 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952805 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952809 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 16:50:30.290695 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952812 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952816 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952821 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952824 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952827 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952830 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952834 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952837 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952844 2554 flags.go:64] FLAG: --cgroup-root="" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952847 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952850 2554 flags.go:64] FLAG: --client-ca-file="" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952854 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952857 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952862 2554 flags.go:64] FLAG: --cluster-domain="" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952865 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952868 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952872 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952875 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952879 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952882 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952885 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952888 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952891 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952894 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 16:50:30.291396 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952897 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952900 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952903 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952907 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952910 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952913 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952916 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952919 2554 flags.go:64] FLAG: --enable-server="true" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952922 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952926 2554 flags.go:64] FLAG: --event-burst="100" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952929 2554 flags.go:64] FLAG: --event-qps="50" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952932 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952935 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952938 2554 flags.go:64] FLAG: --eviction-hard="" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952942 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952945 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952949 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952952 2554 flags.go:64] FLAG: --eviction-soft="" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952955 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952958 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952961 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952965 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952968 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952971 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952975 2554 flags.go:64] FLAG: --feature-gates="" Jul 09 16:50:30.292077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952980 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952983 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952986 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952989 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952992 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952995 2554 flags.go:64] FLAG: --help="false" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.952997 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953000 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953003 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953006 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953009 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953013 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953016 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953018 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953021 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953024 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953026 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953030 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953033 2554 flags.go:64] FLAG: --kube-reserved="" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953036 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953038 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953041 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953044 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953048 2554 flags.go:64] FLAG: --lock-file="" Jul 09 16:50:30.292883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953051 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953053 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953056 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953062 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953065 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953068 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953071 2554 flags.go:64] FLAG: --logging-format="text" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953075 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953078 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953081 2554 flags.go:64] FLAG: --manifest-url="" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953083 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953088 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953091 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953095 2554 flags.go:64] FLAG: --max-pods="110" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953098 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953101 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953103 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953106 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953109 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953112 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953115 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953127 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953129 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953132 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 16:50:30.293567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953135 2554 flags.go:64] FLAG: --pod-cidr="" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953139 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953144 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953146 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953150 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953152 2554 flags.go:64] FLAG: --port="10250" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953155 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953158 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d0cc986d7e7d4b4c" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953163 2554 flags.go:64] FLAG: --qos-reserved="" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953166 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953169 2554 flags.go:64] FLAG: --register-node="true" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953172 2554 flags.go:64] FLAG: --register-with-taints="" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953175 2554 flags.go:64] FLAG: --registry-burst="10" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953179 2554 flags.go:64] FLAG: --registry-qps="5" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953181 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953185 2554 flags.go:64] FLAG: --reserved-memory="" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953189 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953192 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953195 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953197 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953200 2554 flags.go:64] FLAG: --runonce="false" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953203 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953206 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953209 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953212 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 16:50:30.294720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953214 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953217 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953220 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953223 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953226 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953229 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953232 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953234 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953237 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953240 2554 flags.go:64] FLAG: --system-cgroups="" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953243 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953248 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953250 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953253 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953278 2554 flags.go:64] FLAG: --tls-min-version="" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953283 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953286 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953289 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953291 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953294 2554 flags.go:64] FLAG: --v="2" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953298 2554 flags.go:64] FLAG: --version="false" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953303 2554 flags.go:64] FLAG: --vmodule="" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953308 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.953311 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953422 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:50:30.295827 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953425 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953428 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953431 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953434 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953437 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953439 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953442 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953444 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953447 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953450 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953452 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953455 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953457 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953460 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953462 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953465 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953467 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953470 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953472 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953475 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:50:30.420687 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953477 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953481 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953486 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953489 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953492 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953496 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953499 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953502 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953505 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953510 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953513 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953515 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953518 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953520 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953523 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953525 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953528 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953531 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953533 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:50:30.421394 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953536 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953538 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953540 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953543 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953546 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953548 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953551 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953553 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953556 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953558 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953560 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953563 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953565 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953568 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953570 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953574 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953576 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953579 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953581 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953584 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:50:30.421953 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953586 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953589 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953592 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953595 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953598 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953601 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953603 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953606 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953609 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953611 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953614 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953616 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953619 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953621 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953624 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953626 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953629 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953632 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953634 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:50:30.422523 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953637 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953641 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953644 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953647 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953650 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953653 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953656 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953658 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953662 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953664 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953667 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953669 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953672 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953674 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953677 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953681 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953683 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953686 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953688 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:50:30.423122 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.953691 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.954391 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.962337 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.962354 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.962369 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.962375 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962437 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962444 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962447 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962450 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962453 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962456 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962459 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962462 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962464 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:50:30.423679 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962467 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962469 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962472 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962476 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962480 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962483 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962486 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962488 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962491 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962494 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962497 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962499 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962502 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962505 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962508 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962511 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962516 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962519 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962522 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:50:30.424092 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962525 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962533 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962536 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962539 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962542 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962544 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962547 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962549 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962552 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962555 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962558 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962560 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962563 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962566 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962569 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962571 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962574 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962577 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962580 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962582 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:50:30.424632 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962585 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962587 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962590 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962593 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962595 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962598 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962600 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962603 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962605 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962610 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962612 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962615 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962618 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962620 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962629 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962631 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962634 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962637 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962640 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:50:30.425153 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962644 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962647 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962650 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962653 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962655 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962658 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962660 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962663 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962665 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962668 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962670 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962673 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962676 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962678 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962681 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962684 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962686 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962689 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962691 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962694 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:50:30.425699 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962697 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:50:30.426223 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962699 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:50:30.426223 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962703 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:50:30.426223 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962706 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:50:30.426223 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962709 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:50:30.426223 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962711 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:50:30.426223 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962714 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:50:30.426223 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962716 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:50:30.426223 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962726 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:50:30.426223 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962729 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:50:30.426223 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962734 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:50:30.426223 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962738 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:50:30.426223 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.962743 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:50:30.426223 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962884 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:50:30.426223 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962890 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962893 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962896 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962899 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962901 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962904 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962907 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962910 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962913 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962916 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962919 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962921 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962924 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962926 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962929 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962933 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962936 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962939 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962942 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:50:30.426651 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962945 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962947 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962951 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962954 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962956 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962959 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962961 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962964 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962972 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962977 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962979 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962982 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962985 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962987 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962991 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962993 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962996 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.962999 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963002 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:50:30.427160 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963004 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963007 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963009 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963012 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963015 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963017 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963020 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963023 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963025 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963028 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963031 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963034 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963038 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963042 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963045 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963049 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963052 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963055 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963074 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:50:30.427702 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963078 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963080 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963083 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963095 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963098 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963101 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963103 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963106 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963108 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963111 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963113 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963116 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963118 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963121 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963123 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963126 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963129 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963132 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963134 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963137 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963139 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:50:30.428194 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963142 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963144 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963147 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963149 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963152 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963154 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963156 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963160 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963163 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963165 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963168 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963170 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963173 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963176 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963180 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963188 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963191 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963193 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963195 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:50:30.428792 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:29.963198 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:50:30.429292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.963203 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:50:30.429292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.963363 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 16:50:30.429292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.966802 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 16:50:30.429292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.968811 2554 server.go:1019] "Starting client certificate rotation" Jul 09 16:50:30.429292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.968916 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 16:50:30.429292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.968952 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 16:50:30.429292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.972570 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 16:50:30.429292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.977382 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 16:50:30.429292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.983582 2554 log.go:25] "Validated CRI v1 runtime API" Jul 09 16:50:30.429292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.986075 2554 log.go:25] "Validated CRI v1 image API" Jul 09 16:50:30.429292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.986934 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 16:50:30.429292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.990459 2554 fs.go:135] Filesystem UUIDs: map[209726f3-a668-431f-a4c6-d1a7f557c875:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 df61eaa8-8759-48b9-8907-8457e04a4c18:/dev/nvme0n1p3] Jul 09 16:50:30.429660 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.990475 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 16:50:30.429726 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.995535 2554 manager.go:216] Machine: {Timestamp:2026-07-09 16:50:29.994121514 +0000 UTC m=+0.385005881 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100695 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24dd1a9e7c927eb7115075391b082f SystemUUID:ec24dd1a-9e7c-927e-b711-5075391b082f BootID:39fd840b-a6a2-4939-9ee9-f40eca5a1d3e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b8:de:cb:57:1b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b8:de:cb:57:1b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:d6:e2:fe:3f:19 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 16:50:30.429726 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.995673 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 16:50:30.429726 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.995816 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 16:50:30.429726 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.998201 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 16:50:30.429726 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.999573 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 16:50:30.429726 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:29.999992 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 16:50:30.429726 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.001484 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.001495 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.001502 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.002310 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.004230 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.008974 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.009110 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.009139 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.009151 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.009167 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.009176 2554 kubelet.go:398] "Adding apiserver pod source" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.009184 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.009601 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.009626 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.012009 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.014400 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.014428 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.014605 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.014617 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.014623 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.014629 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.014638 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.014648 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.015376 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.015383 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.015390 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.015395 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.015411 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.015420 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.016412 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.016419 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.019655 2554 server.go:1268] "Started kubelet" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.019763 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.019803 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.019874 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.024857 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.025194 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.025202 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.026807 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 16:50:30.430001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.027717 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.030201 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.031535 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-57.ec2.internal.18c0ad25bc154b2b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-57.ec2.internal,UID:ip-10-0-132-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-57.ec2.internal,},FirstTimestamp:2026-07-09 16:50:30.019623723 +0000 UTC m=+0.410508091,LastTimestamp:2026-07-09 16:50:30.019623723 +0000 UTC m=+0.410508091,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-57.ec2.internal,}" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.034486 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.034503 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.034571 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-57.ec2.internal\" not found" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.035279 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.035283 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.035303 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.035413 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.035424 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.035578 2554 factory.go:55] Registering systemd factory Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.035593 2554 factory.go:223] Registration of the systemd container factory successfully Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.036121 2554 factory.go:153] Registering CRI-O factory Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.036135 2554 factory.go:223] Registration of the crio container factory successfully Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.036188 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.036208 2554 factory.go:103] Registering Raw factory Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.036221 2554 manager.go:1196] Started watching for new ooms in manager Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.036664 2554 manager.go:349] Starting recovery of all containers Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.036750 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.036785 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.045539 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c697v" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.047755 2554 manager.go:354] Recovery completed Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.052189 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.052418 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c697v" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.054245 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.054286 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.054297 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.054778 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.054788 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.054791 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:50:30.432850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.054802 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.055966 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.055994 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.056009 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.055971 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-57.ec2.internal.18c0ad25be25f21b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-57.ec2.internal,UID:ip-10-0-132-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-57.ec2.internal,},FirstTimestamp:2026-07-09 16:50:30.054269467 +0000 UTC m=+0.445153835,LastTimestamp:2026-07-09 16:50:30.054269467 +0000 UTC m=+0.445153835,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-57.ec2.internal,}" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.057195 2554 policy_none.go:49] "None policy: Start" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.057210 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.057221 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.059361 2554 policy_none.go:47] "Start" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.124884 2554 manager.go:337] "Starting Device Plugin manager" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.125038 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.125047 2554 server.go:87] "Starting device plugin registration server" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.125320 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.125335 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.125431 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.125507 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.125516 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.126077 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.126119 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-57.ec2.internal\" not found" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.183766 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.184981 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.185018 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.185039 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.185074 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.187906 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.225668 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.226538 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.226566 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.226582 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.226609 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.237764 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.237781 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-57.ec2.internal\": node \"ip-10-0-132-57.ec2.internal\" not found" Jul 09 16:50:30.617788 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.262512 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-57.ec2.internal\" not found" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.285573 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-57.ec2.internal"] Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.285657 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.287409 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.287439 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.287452 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.289707 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.289807 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.289846 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.291478 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.291488 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.291501 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.291506 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.291512 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.291515 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.293721 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.293750 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.294545 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.294570 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.294579 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.318831 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-57.ec2.internal\" not found" node="ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.329027 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-57.ec2.internal\" not found" node="ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.337253 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/087471a9f59f7c1e03f22c0bf78eab5d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-57.ec2.internal\" (UID: \"087471a9f59f7c1e03f22c0bf78eab5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.337297 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ecd34fa0511bd800d4ea4b978db4cd47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal\" (UID: \"ecd34fa0511bd800d4ea4b978db4cd47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.337315 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecd34fa0511bd800d4ea4b978db4cd47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal\" (UID: \"ecd34fa0511bd800d4ea4b978db4cd47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.624201 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.362773 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-57.ec2.internal\" not found" Jul 09 16:50:30.624935 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.438367 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/087471a9f59f7c1e03f22c0bf78eab5d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-57.ec2.internal\" (UID: \"087471a9f59f7c1e03f22c0bf78eab5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.624935 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.438394 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ecd34fa0511bd800d4ea4b978db4cd47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal\" (UID: \"ecd34fa0511bd800d4ea4b978db4cd47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.624935 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.438413 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecd34fa0511bd800d4ea4b978db4cd47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal\" (UID: \"ecd34fa0511bd800d4ea4b978db4cd47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.624935 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.438453 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecd34fa0511bd800d4ea4b978db4cd47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal\" (UID: \"ecd34fa0511bd800d4ea4b978db4cd47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.624935 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.438465 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/087471a9f59f7c1e03f22c0bf78eab5d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-57.ec2.internal\" (UID: \"087471a9f59f7c1e03f22c0bf78eab5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.624935 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.438494 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ecd34fa0511bd800d4ea4b978db4cd47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal\" (UID: \"ecd34fa0511bd800d4ea4b978db4cd47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal" Jul 09 16:50:30.624935 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.463465 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-57.ec2.internal\" not found" Jul 09 16:50:30.624935 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:30.564213 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-57.ec2.internal\" not found" Jul 09 16:50:30.624935 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.621376 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal" Jul 09 16:50:32.111492 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:30.631814 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-57.ec2.internal" Jul 09 16:50:32.111492 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:32.012880 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-57.ec2.internal\" not found" Jul 09 16:50:32.114505 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:32.113467 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-57.ec2.internal\" not found" Jul 09 16:50:32.299394 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:32.195161 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:50:32.299394 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:32.213993 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-57.ec2.internal\" not found" Jul 09 16:50:32.464347 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:32.314522 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-57.ec2.internal\" not found" Jul 09 16:50:32.464347 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:32.315614 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 16:50:32.464347 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:32.315751 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 16:50:32.464347 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:32.315782 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 16:50:32.464347 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:32.405166 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 16:45:31 +0000 UTC" deadline="2027-12-03 04:41:00.382168677 +0000 UTC" Jul 09 16:50:32.464347 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:32.405199 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12275h50m27.976973699s" Jul 09 16:50:32.464347 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:32.415321 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-57.ec2.internal\" not found" Jul 09 16:50:32.582102 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:32.515838 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-57.ec2.internal\" not found" Jul 09 16:50:32.582102 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:32.551853 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:50:32.739692 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:32.616554 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-57.ec2.internal\" not found" Jul 09 16:50:32.739692 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:32.663980 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd34fa0511bd800d4ea4b978db4cd47.slice/crio-4a12e339535c7993935bffcebd855744982e70a19409a2de3ba39a398ff57ff5 WatchSource:0}: Error finding container 4a12e339535c7993935bffcebd855744982e70a19409a2de3ba39a398ff57ff5: Status 404 returned error can't find the container with id 4a12e339535c7993935bffcebd855744982e70a19409a2de3ba39a398ff57ff5 Jul 09 16:50:32.739692 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:32.668130 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:50:32.739692 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:32.697619 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:50:32.895811 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:32.783679 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal" Jul 09 16:50:32.895811 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:32.795879 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 16:50:32.895811 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:32.796707 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-57.ec2.internal" Jul 09 16:50:32.895811 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:32.805081 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 16:50:33.083771 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:32.976497 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087471a9f59f7c1e03f22c0bf78eab5d.slice/crio-b284c61cbaa569f9bdd1948240d53ec9016d08f51f45a8df48630b654936fa91 WatchSource:0}: Error finding container b284c61cbaa569f9bdd1948240d53ec9016d08f51f45a8df48630b654936fa91: Status 404 returned error can't find the container with id b284c61cbaa569f9bdd1948240d53ec9016d08f51f45a8df48630b654936fa91 Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.435844 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.435848 2554 apiserver.go:52] "Watching apiserver" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.445658 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.446030 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-57.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq","openshift-cluster-node-tuning-operator/tuned-htfld","openshift-multus/multus-additional-cni-plugins-p9cpq","openshift-multus/network-metrics-daemon-wqxpv","openshift-network-diagnostics/network-check-target-4dn5j","kube-system/global-pull-secret-syncer-f7rmt","kube-system/konnectivity-agent-c874l","openshift-dns/node-resolver-nnnfb","openshift-image-registry/node-ca-nms4w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal","openshift-multus/multus-5hgnp","openshift-network-operator/iptables-alerter-p597h","openshift-ovn-kubernetes/ovnkube-node-jsg5t"] Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.448985 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.449401 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:33.449464 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.451342 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p597h" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.453424 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.454006 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.454042 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.454071 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.454135 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h5lwr\"" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.455610 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.455755 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.455765 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.455891 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tvbt7\"" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.457897 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:33.457957 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.458181 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.458207 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.458772 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.458786 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.458800 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 16:50:33.482082 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.458858 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w7h9m\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.463307 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:33.463357 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.465397 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nnnfb" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.467813 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.467848 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k6zt8\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.467912 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.467929 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.470291 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.470291 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.470691 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.470718 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.470744 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.470694 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.471120 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.471339 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4fv94\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.473128 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6szp6" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.473266 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.473381 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sstx6\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.473509 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.473569 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nms4w" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.473648 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.482572 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6szp6" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.482860 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.483117 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2tjj5\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.483342 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 16:50:33.483552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.483548 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 16:50:33.484968 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.483788 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c874l" Jul 09 16:50:33.485641 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.485319 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.487272 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.486671 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-btp7k\"" Jul 09 16:50:33.487272 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.486708 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 16:50:33.487272 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.486721 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.487480 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.487657 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pqpkc\"" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.535900 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1b2f3565-468b-40b1-aa95-05eaf1ea2288-multus-daemon-config\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.535935 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-sysctl-d\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.535974 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-cni-netd\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536011 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536038 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwr64\" (UniqueName: \"kubernetes.io/projected/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-kube-api-access-nwr64\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536057 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-socket-dir\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536076 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-sysctl-conf\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536114 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-systemd\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536150 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-run-ovn\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536173 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-multus-socket-dir-parent\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536190 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-kubelet-config\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536207 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-kubelet\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.640358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536227 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-var-lib-openvswitch\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.641577 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536260 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-env-overrides\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.641577 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536282 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdnmg\" (UniqueName: \"kubernetes.io/projected/52f9eea5-3668-4c12-ba94-ea441750861f-kube-api-access-hdnmg\") pod \"node-ca-nms4w\" (UID: \"52f9eea5-3668-4c12-ba94-ea441750861f\") " pod="openshift-image-registry/node-ca-nms4w" Jul 09 16:50:33.641577 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536304 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.641577 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536323 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-registration-dir\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.641577 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536347 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/862c17b2-7e3e-4971-8cfa-3cb73d2fce4b-agent-certs\") pod \"konnectivity-agent-c874l\" (UID: \"862c17b2-7e3e-4971-8cfa-3cb73d2fce4b\") " pod="kube-system/konnectivity-agent-c874l" Jul 09 16:50:33.641577 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536362 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b2f3565-468b-40b1-aa95-05eaf1ea2288-cni-binary-copy\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.641577 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536411 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.641577 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536438 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-cnibin\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.641577 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536462 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-run-netns\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.641577 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536488 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-run\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.641577 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536509 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c5xj\" (UniqueName: \"kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj\") pod \"network-check-target-4dn5j\" (UID: \"a63eb4bd-dca4-44d7-a240-9dce65a98c92\") " pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:33.641577 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536544 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-node-log\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.641577 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536572 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6fk9\" (UniqueName: \"kubernetes.io/projected/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-kube-api-access-n6fk9\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.641577 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536594 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n54w\" (UniqueName: \"kubernetes.io/projected/e6218f09-2689-4275-912f-499ea15f15f8-kube-api-access-7n54w\") pod \"network-metrics-daemon-wqxpv\" (UID: \"e6218f09-2689-4275-912f-499ea15f15f8\") " pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:33.644581 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536616 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-etc-selinux\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.644581 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536638 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-var-lib-cni-bin\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.644581 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536692 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7z6l\" (UniqueName: \"kubernetes.io/projected/1c429941-4fc7-4e4e-ac78-ff2cee2fe854-kube-api-access-w7z6l\") pod \"iptables-alerter-p597h\" (UID: \"1c429941-4fc7-4e4e-ac78-ff2cee2fe854\") " pod="openshift-network-operator/iptables-alerter-p597h" Jul 09 16:50:33.644581 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536740 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.644581 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536793 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.644581 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536824 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-system-cni-dir\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.644581 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536849 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-os-release\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.644581 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536866 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:33.644581 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536881 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-modprobe-d\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.644581 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536910 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-lib-modules\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.644581 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536968 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-run-netns\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.644581 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.536992 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-etc-openvswitch\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.644581 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537014 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-device-dir\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.645707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537036 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-dbus\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:33.645707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537059 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1c429941-4fc7-4e4e-ac78-ff2cee2fe854-iptables-alerter-script\") pod \"iptables-alerter-p597h\" (UID: \"1c429941-4fc7-4e4e-ac78-ff2cee2fe854\") " pod="openshift-network-operator/iptables-alerter-p597h" Jul 09 16:50:33.645707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537084 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-var-lib-kubelet\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.645707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537102 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44bd29d3-9dcd-4792-8176-7eb4aee75a2c-hosts-file\") pod \"node-resolver-nnnfb\" (UID: \"44bd29d3-9dcd-4792-8176-7eb4aee75a2c\") " pod="openshift-dns/node-resolver-nnnfb" Jul 09 16:50:33.645707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537121 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-run-systemd\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.645707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537150 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-run-ovn-kubernetes\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.645707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537174 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-system-cni-dir\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.645707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537197 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-os-release\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.645707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537234 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs\") pod \"network-metrics-daemon-wqxpv\" (UID: \"e6218f09-2689-4275-912f-499ea15f15f8\") " pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:33.645707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537261 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-sysconfig\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.645707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537282 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-tuned\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.645707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537306 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-slash\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.645707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537343 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-run-openvswitch\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.645707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537399 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-ovnkube-config\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.650479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537420 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-multus-conf-dir\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.650479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537454 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e63647d0-47d9-4615-aa28-ac09722f1bc1-tmp\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.650479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537471 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-systemd-units\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.650479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537501 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-run-k8s-cni-cncf-io\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.650479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537545 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-etc-kubernetes\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.650479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537565 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpghw\" (UniqueName: \"kubernetes.io/projected/1b2f3565-468b-40b1-aa95-05eaf1ea2288-kube-api-access-wpghw\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.650479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537596 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-sys\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.650479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537616 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44bd29d3-9dcd-4792-8176-7eb4aee75a2c-tmp-dir\") pod \"node-resolver-nnnfb\" (UID: \"44bd29d3-9dcd-4792-8176-7eb4aee75a2c\") " pod="openshift-dns/node-resolver-nnnfb" Jul 09 16:50:33.650479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537631 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-ovnkube-script-lib\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.650479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537673 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52f9eea5-3668-4c12-ba94-ea441750861f-serviceca\") pod \"node-ca-nms4w\" (UID: \"52f9eea5-3668-4c12-ba94-ea441750861f\") " pod="openshift-image-registry/node-ca-nms4w" Jul 09 16:50:33.650479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537693 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-multus-cni-dir\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.650479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537723 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-run-multus-certs\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.650479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537749 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-kubernetes\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.650479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537771 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-log-socket\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.651720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537806 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.651720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537833 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-sys-fs\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.651720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537855 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-var-lib-cni-multus\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.651720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537850 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-57.ec2.internal" event={"ID":"087471a9f59f7c1e03f22c0bf78eab5d","Type":"ContainerStarted","Data":"b284c61cbaa569f9bdd1948240d53ec9016d08f51f45a8df48630b654936fa91"} Jul 09 16:50:33.651720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537876 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-host\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.651720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537934 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6lsf\" (UniqueName: \"kubernetes.io/projected/44bd29d3-9dcd-4792-8176-7eb4aee75a2c-kube-api-access-r6lsf\") pod \"node-resolver-nnnfb\" (UID: \"44bd29d3-9dcd-4792-8176-7eb4aee75a2c\") " pod="openshift-dns/node-resolver-nnnfb" Jul 09 16:50:33.651720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537958 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-cni-bin\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.651720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.537981 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-ovn-node-metrics-cert\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.651720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.538003 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-var-lib-kubelet\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.651720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.538026 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c429941-4fc7-4e4e-ac78-ff2cee2fe854-host-slash\") pod \"iptables-alerter-p597h\" (UID: \"1c429941-4fc7-4e4e-ac78-ff2cee2fe854\") " pod="openshift-network-operator/iptables-alerter-p597h" Jul 09 16:50:33.651720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.538049 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw6ks\" (UniqueName: \"kubernetes.io/projected/e63647d0-47d9-4615-aa28-ac09722f1bc1-kube-api-access-nw6ks\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.651720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.538082 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52f9eea5-3668-4c12-ba94-ea441750861f-host\") pod \"node-ca-nms4w\" (UID: \"52f9eea5-3668-4c12-ba94-ea441750861f\") " pod="openshift-image-registry/node-ca-nms4w" Jul 09 16:50:33.651720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.538110 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-cnibin\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.651720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.538132 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2g9s\" (UniqueName: \"kubernetes.io/projected/bde50a61-2db7-44d1-991d-83bd861d9733-kube-api-access-s2g9s\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.538154 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/862c17b2-7e3e-4971-8cfa-3cb73d2fce4b-konnectivity-ca\") pod \"konnectivity-agent-c874l\" (UID: \"862c17b2-7e3e-4971-8cfa-3cb73d2fce4b\") " pod="kube-system/konnectivity-agent-c874l" Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.538179 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-hostroot\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.538859 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal" event={"ID":"ecd34fa0511bd800d4ea4b978db4cd47","Type":"ContainerStarted","Data":"4a12e339535c7993935bffcebd855744982e70a19409a2de3ba39a398ff57ff5"} Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.583965 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.638402 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n54w\" (UniqueName: \"kubernetes.io/projected/e6218f09-2689-4275-912f-499ea15f15f8-kube-api-access-7n54w\") pod \"network-metrics-daemon-wqxpv\" (UID: \"e6218f09-2689-4275-912f-499ea15f15f8\") " pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.638451 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-etc-selinux\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.638477 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-var-lib-cni-bin\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.638502 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7z6l\" (UniqueName: \"kubernetes.io/projected/1c429941-4fc7-4e4e-ac78-ff2cee2fe854-kube-api-access-w7z6l\") pod \"iptables-alerter-p597h\" (UID: \"1c429941-4fc7-4e4e-ac78-ff2cee2fe854\") " pod="openshift-network-operator/iptables-alerter-p597h" Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.638562 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.638577 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-var-lib-cni-bin\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.638612 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-etc-selinux\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.638737 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.638585 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.638884 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-system-cni-dir\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.656941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.638914 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-os-release\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.658007 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.638941 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:33.658007 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.638965 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-modprobe-d\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.658007 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.638987 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-lib-modules\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.658007 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.639401 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-os-release\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.658007 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.639427 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-system-cni-dir\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.658007 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:33.639537 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:50:33.658007 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.639560 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-modprobe-d\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.658007 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:33.639607 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret podName:1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f nodeName:}" failed. No retries permitted until 2026-07-09 16:50:34.139580152 +0000 UTC m=+3.182355396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret") pod "global-pull-secret-syncer-f7rmt" (UID: "1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:50:33.658007 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.639673 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-lib-modules\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.658007 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.639672 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.658007 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642042 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-run-netns\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.658007 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642092 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-etc-openvswitch\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.658007 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642131 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-device-dir\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.658007 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642158 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-dbus\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:33.661891 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642183 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1c429941-4fc7-4e4e-ac78-ff2cee2fe854-iptables-alerter-script\") pod \"iptables-alerter-p597h\" (UID: \"1c429941-4fc7-4e4e-ac78-ff2cee2fe854\") " pod="openshift-network-operator/iptables-alerter-p597h" Jul 09 16:50:33.661891 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642216 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-var-lib-kubelet\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.661891 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44bd29d3-9dcd-4792-8176-7eb4aee75a2c-hosts-file\") pod \"node-resolver-nnnfb\" (UID: \"44bd29d3-9dcd-4792-8176-7eb4aee75a2c\") " pod="openshift-dns/node-resolver-nnnfb" Jul 09 16:50:33.661891 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642274 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-run-systemd\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.661891 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642304 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-run-ovn-kubernetes\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.661891 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642327 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-system-cni-dir\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.661891 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642357 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-os-release\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.661891 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642401 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs\") pod \"network-metrics-daemon-wqxpv\" (UID: \"e6218f09-2689-4275-912f-499ea15f15f8\") " pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:33.661891 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642428 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-sysconfig\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.661891 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642456 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-tuned\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.661891 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642486 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-slash\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.661891 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642512 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-run-openvswitch\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.661891 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642539 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-ovnkube-config\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.661891 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-multus-conf-dir\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642596 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e63647d0-47d9-4615-aa28-ac09722f1bc1-tmp\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642619 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-systemd-units\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642649 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-run-k8s-cni-cncf-io\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642678 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-etc-kubernetes\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642708 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpghw\" (UniqueName: \"kubernetes.io/projected/1b2f3565-468b-40b1-aa95-05eaf1ea2288-kube-api-access-wpghw\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642735 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-sys\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642759 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44bd29d3-9dcd-4792-8176-7eb4aee75a2c-tmp-dir\") pod \"node-resolver-nnnfb\" (UID: \"44bd29d3-9dcd-4792-8176-7eb4aee75a2c\") " pod="openshift-dns/node-resolver-nnnfb" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642786 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-ovnkube-script-lib\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642848 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52f9eea5-3668-4c12-ba94-ea441750861f-serviceca\") pod \"node-ca-nms4w\" (UID: \"52f9eea5-3668-4c12-ba94-ea441750861f\") " pod="openshift-image-registry/node-ca-nms4w" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642886 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-multus-cni-dir\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642910 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-run-multus-certs\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642938 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-kubernetes\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.642997 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-log-socket\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643044 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.662746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643074 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-sys-fs\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643102 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-var-lib-cni-multus\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643130 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-host\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643234 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-etc-openvswitch\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643330 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-run-netns\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643334 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-device-dir\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643350 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-host\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643595 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-multus-conf-dir\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643643 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-dbus\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643686 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-os-release\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643746 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-var-lib-kubelet\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643824 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44bd29d3-9dcd-4792-8176-7eb4aee75a2c-hosts-file\") pod \"node-resolver-nnnfb\" (UID: \"44bd29d3-9dcd-4792-8176-7eb4aee75a2c\") " pod="openshift-dns/node-resolver-nnnfb" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643855 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1c429941-4fc7-4e4e-ac78-ff2cee2fe854-iptables-alerter-script\") pod \"iptables-alerter-p597h\" (UID: \"1c429941-4fc7-4e4e-ac78-ff2cee2fe854\") " pod="openshift-network-operator/iptables-alerter-p597h" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643869 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-run-systemd\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643930 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-system-cni-dir\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.665124 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:33.643958 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:50:33.666212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.643987 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-ovnkube-config\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.666212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644062 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6lsf\" (UniqueName: \"kubernetes.io/projected/44bd29d3-9dcd-4792-8176-7eb4aee75a2c-kube-api-access-r6lsf\") pod \"node-resolver-nnnfb\" (UID: \"44bd29d3-9dcd-4792-8176-7eb4aee75a2c\") " pod="openshift-dns/node-resolver-nnnfb" Jul 09 16:50:33.666212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644086 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 16:50:33.666212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644111 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-cni-bin\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.666212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644154 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-ovn-node-metrics-cert\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.666212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644184 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-var-lib-kubelet\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.666212 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:33.644222 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs podName:e6218f09-2689-4275-912f-499ea15f15f8 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:34.144180166 +0000 UTC m=+3.186955397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs") pod "network-metrics-daemon-wqxpv" (UID: "e6218f09-2689-4275-912f-499ea15f15f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:50:33.666212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644226 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-var-lib-kubelet\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.666212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644264 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c429941-4fc7-4e4e-ac78-ff2cee2fe854-host-slash\") pod \"iptables-alerter-p597h\" (UID: \"1c429941-4fc7-4e4e-ac78-ff2cee2fe854\") " pod="openshift-network-operator/iptables-alerter-p597h" Jul 09 16:50:33.666212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644299 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw6ks\" (UniqueName: \"kubernetes.io/projected/e63647d0-47d9-4615-aa28-ac09722f1bc1-kube-api-access-nw6ks\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.666212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644327 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52f9eea5-3668-4c12-ba94-ea441750861f-host\") pod \"node-ca-nms4w\" (UID: \"52f9eea5-3668-4c12-ba94-ea441750861f\") " pod="openshift-image-registry/node-ca-nms4w" Jul 09 16:50:33.666212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644359 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-cnibin\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.666212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644386 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52f9eea5-3668-4c12-ba94-ea441750861f-serviceca\") pod \"node-ca-nms4w\" (UID: \"52f9eea5-3668-4c12-ba94-ea441750861f\") " pod="openshift-image-registry/node-ca-nms4w" Jul 09 16:50:33.666212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644459 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-systemd-units\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644493 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2g9s\" (UniqueName: \"kubernetes.io/projected/bde50a61-2db7-44d1-991d-83bd861d9733-kube-api-access-s2g9s\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644546 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-run-k8s-cni-cncf-io\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644548 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/862c17b2-7e3e-4971-8cfa-3cb73d2fce4b-konnectivity-ca\") pod \"konnectivity-agent-c874l\" (UID: \"862c17b2-7e3e-4971-8cfa-3cb73d2fce4b\") " pod="kube-system/konnectivity-agent-c874l" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644566 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-cni-bin\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644635 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-etc-kubernetes\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.644904 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-sys\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.645091 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-slash\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.645150 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-run-openvswitch\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.645182 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44bd29d3-9dcd-4792-8176-7eb4aee75a2c-tmp-dir\") pod \"node-resolver-nnnfb\" (UID: \"44bd29d3-9dcd-4792-8176-7eb4aee75a2c\") " pod="openshift-dns/node-resolver-nnnfb" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.645289 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c429941-4fc7-4e4e-ac78-ff2cee2fe854-host-slash\") pod \"iptables-alerter-p597h\" (UID: \"1c429941-4fc7-4e4e-ac78-ff2cee2fe854\") " pod="openshift-network-operator/iptables-alerter-p597h" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.645495 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-multus-cni-dir\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.645575 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-run-multus-certs\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.645582 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52f9eea5-3668-4c12-ba94-ea441750861f-host\") pod \"node-ca-nms4w\" (UID: \"52f9eea5-3668-4c12-ba94-ea441750861f\") " pod="openshift-image-registry/node-ca-nms4w" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.645212 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-run-ovn-kubernetes\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.671849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.645645 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-log-socket\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.673139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.645697 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-cnibin\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.673139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.645800 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/862c17b2-7e3e-4971-8cfa-3cb73d2fce4b-konnectivity-ca\") pod \"konnectivity-agent-c874l\" (UID: \"862c17b2-7e3e-4971-8cfa-3cb73d2fce4b\") " pod="kube-system/konnectivity-agent-c874l" Jul 09 16:50:33.673139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.645823 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-ovnkube-script-lib\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.673139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.645919 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-var-lib-cni-multus\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.673139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.645996 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-kubernetes\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.673139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646238 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-sys-fs\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.673139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646323 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-sysconfig\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.673139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646401 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-hostroot\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.673139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646458 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1b2f3565-468b-40b1-aa95-05eaf1ea2288-multus-daemon-config\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.673139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646510 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-sysctl-d\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.673139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646547 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-cni-netd\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.673139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646584 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-hostroot\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.673139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646591 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.673139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646624 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwr64\" (UniqueName: \"kubernetes.io/projected/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-kube-api-access-nwr64\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.676158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646654 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-socket-dir\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.676158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646679 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-sysctl-conf\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.676158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646718 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-systemd\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.676158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646725 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.676158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646741 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-run-ovn\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.676158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646829 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-multus-socket-dir-parent\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.676158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646841 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-sysctl-d\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.676158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646862 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-kubelet-config\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:33.676158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646895 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-kubelet\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.676158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646902 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-cni-netd\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.676158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.646988 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.676158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647009 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-run-ovn\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.676158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647016 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-multus-socket-dir-parent\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.676158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647055 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-host-kubelet\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.676804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647152 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-socket-dir\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.676804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647200 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-var-lib-openvswitch\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.676804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647187 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-systemd\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.676804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647245 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-sysctl-conf\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.676804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647256 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-env-overrides\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.676804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647339 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-kubelet-config\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:33.676804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647633 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdnmg\" (UniqueName: \"kubernetes.io/projected/52f9eea5-3668-4c12-ba94-ea441750861f-kube-api-access-hdnmg\") pod \"node-ca-nms4w\" (UID: \"52f9eea5-3668-4c12-ba94-ea441750861f\") " pod="openshift-image-registry/node-ca-nms4w" Jul 09 16:50:33.676804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647654 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1b2f3565-468b-40b1-aa95-05eaf1ea2288-multus-daemon-config\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.676804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647675 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.676804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-registration-dir\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.676804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647754 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/862c17b2-7e3e-4971-8cfa-3cb73d2fce4b-agent-certs\") pod \"konnectivity-agent-c874l\" (UID: \"862c17b2-7e3e-4971-8cfa-3cb73d2fce4b\") " pod="kube-system/konnectivity-agent-c874l" Jul 09 16:50:33.676804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647830 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b2f3565-468b-40b1-aa95-05eaf1ea2288-cni-binary-copy\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.676804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647898 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-var-lib-openvswitch\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.676804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647905 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.647974 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-cnibin\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.648385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-run-netns\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.648400 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bde50a61-2db7-44d1-991d-83bd861d9733-registration-dir\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.648423 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-run\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.648466 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xj\" (UniqueName: \"kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj\") pod \"network-check-target-4dn5j\" (UID: \"a63eb4bd-dca4-44d7-a240-9dce65a98c92\") " pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.648525 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.648683 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-env-overrides\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.648751 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-node-log\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.648812 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-host-run-netns\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.648874 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e63647d0-47d9-4615-aa28-ac09722f1bc1-run\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.648462 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b2f3565-468b-40b1-aa95-05eaf1ea2288-cnibin\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.648946 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b2f3565-468b-40b1-aa95-05eaf1ea2288-cni-binary-copy\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.648987 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.648803 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6fk9\" (UniqueName: \"kubernetes.io/projected/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-kube-api-access-n6fk9\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.680020 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.649045 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-node-log\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.680676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.652101 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-ovn-node-metrics-cert\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.680676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.652338 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n54w\" (UniqueName: \"kubernetes.io/projected/e6218f09-2689-4275-912f-499ea15f15f8-kube-api-access-7n54w\") pod \"network-metrics-daemon-wqxpv\" (UID: \"e6218f09-2689-4275-912f-499ea15f15f8\") " pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:33.680676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.652537 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/862c17b2-7e3e-4971-8cfa-3cb73d2fce4b-agent-certs\") pod \"konnectivity-agent-c874l\" (UID: \"862c17b2-7e3e-4971-8cfa-3cb73d2fce4b\") " pod="kube-system/konnectivity-agent-c874l" Jul 09 16:50:33.680676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.652552 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e63647d0-47d9-4615-aa28-ac09722f1bc1-tmp\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.680676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.652671 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e63647d0-47d9-4615-aa28-ac09722f1bc1-etc-tuned\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.680676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.653694 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7z6l\" (UniqueName: \"kubernetes.io/projected/1c429941-4fc7-4e4e-ac78-ff2cee2fe854-kube-api-access-w7z6l\") pod \"iptables-alerter-p597h\" (UID: \"1c429941-4fc7-4e4e-ac78-ff2cee2fe854\") " pod="openshift-network-operator/iptables-alerter-p597h" Jul 09 16:50:33.680676 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:33.654657 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:50:33.680676 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:33.654682 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:50:33.680676 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:33.654697 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8c5xj for pod openshift-network-diagnostics/network-check-target-4dn5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:50:33.680676 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:33.654791 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj podName:a63eb4bd-dca4-44d7-a240-9dce65a98c92 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:34.15477296 +0000 UTC m=+3.197548206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8c5xj" (UniqueName: "kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj") pod "network-check-target-4dn5j" (UID: "a63eb4bd-dca4-44d7-a240-9dce65a98c92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:50:33.680676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.656106 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdnmg\" (UniqueName: \"kubernetes.io/projected/52f9eea5-3668-4c12-ba94-ea441750861f-kube-api-access-hdnmg\") pod \"node-ca-nms4w\" (UID: \"52f9eea5-3668-4c12-ba94-ea441750861f\") " pod="openshift-image-registry/node-ca-nms4w" Jul 09 16:50:33.680676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.657561 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6fk9\" (UniqueName: \"kubernetes.io/projected/377f2e33-17a4-4663-9ff8-7d42c1ed3b05-kube-api-access-n6fk9\") pod \"ovnkube-node-jsg5t\" (UID: \"377f2e33-17a4-4663-9ff8-7d42c1ed3b05\") " pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.680676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.659029 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw6ks\" (UniqueName: \"kubernetes.io/projected/e63647d0-47d9-4615-aa28-ac09722f1bc1-kube-api-access-nw6ks\") pod \"tuned-htfld\" (UID: \"e63647d0-47d9-4615-aa28-ac09722f1bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.680676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.659260 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2g9s\" (UniqueName: \"kubernetes.io/projected/bde50a61-2db7-44d1-991d-83bd861d9733-kube-api-access-s2g9s\") pod \"aws-ebs-csi-driver-node-sc5wq\" (UID: \"bde50a61-2db7-44d1-991d-83bd861d9733\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.681325 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.659321 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6lsf\" (UniqueName: \"kubernetes.io/projected/44bd29d3-9dcd-4792-8176-7eb4aee75a2c-kube-api-access-r6lsf\") pod \"node-resolver-nnnfb\" (UID: \"44bd29d3-9dcd-4792-8176-7eb4aee75a2c\") " pod="openshift-dns/node-resolver-nnnfb" Jul 09 16:50:33.681325 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.659478 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpghw\" (UniqueName: \"kubernetes.io/projected/1b2f3565-468b-40b1-aa95-05eaf1ea2288-kube-api-access-wpghw\") pod \"multus-5hgnp\" (UID: \"1b2f3565-468b-40b1-aa95-05eaf1ea2288\") " pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.681325 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.660808 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwr64\" (UniqueName: \"kubernetes.io/projected/98c3fe82-cf7e-4b0f-81bc-621f3f946dce-kube-api-access-nwr64\") pod \"multus-additional-cni-plugins-p9cpq\" (UID: \"98c3fe82-cf7e-4b0f-81bc-621f3f946dce\") " pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.765346 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p597h" Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.769576 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-htfld" Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:33.777820 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c429941_4fc7_4e4e_ac78_ff2cee2fe854.slice/crio-2ed31abc84a2a877fd5b768c4fa481e0327a983d0111a8717595c4c5b1a09d39 WatchSource:0}: Error finding container 2ed31abc84a2a877fd5b768c4fa481e0327a983d0111a8717595c4c5b1a09d39: Status 404 returned error can't find the container with id 2ed31abc84a2a877fd5b768c4fa481e0327a983d0111a8717595c4c5b1a09d39 Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:33.779595 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63647d0_47d9_4615_aa28_ac09722f1bc1.slice/crio-d30e357ef240857276ebd2fb0714c9304d9a7d9e45766cb40632ee838133b0ad WatchSource:0}: Error finding container d30e357ef240857276ebd2fb0714c9304d9a7d9e45766cb40632ee838133b0ad: Status 404 returned error can't find the container with id d30e357ef240857276ebd2fb0714c9304d9a7d9e45766cb40632ee838133b0ad Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.784089 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p9cpq" Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.789928 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nnnfb" Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.792310 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:33.794295 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c3fe82_cf7e_4b0f_81bc_621f3f946dce.slice/crio-c31861095b067e0d8923061fc7c9c72a53a244f8ac27a76236c1a3ac00c79b0f WatchSource:0}: Error finding container c31861095b067e0d8923061fc7c9c72a53a244f8ac27a76236c1a3ac00c79b0f: Status 404 returned error can't find the container with id c31861095b067e0d8923061fc7c9c72a53a244f8ac27a76236c1a3ac00c79b0f Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.798870 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:33.800739 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44bd29d3_9dcd_4792_8176_7eb4aee75a2c.slice/crio-c5f4b16ea38c92626785efeeb460dfe8d962072b6b285efbacc83b4ef13b20db WatchSource:0}: Error finding container c5f4b16ea38c92626785efeeb460dfe8d962072b6b285efbacc83b4ef13b20db: Status 404 returned error can't find the container with id c5f4b16ea38c92626785efeeb460dfe8d962072b6b285efbacc83b4ef13b20db Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.803644 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:33.810706 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377f2e33_17a4_4663_9ff8_7d42c1ed3b05.slice/crio-1a948d303fe182fb7bda1c9ad411b33b5da08e2f96d98eb8ae90d78eac084372 WatchSource:0}: Error finding container 1a948d303fe182fb7bda1c9ad411b33b5da08e2f96d98eb8ae90d78eac084372: Status 404 returned error can't find the container with id 1a948d303fe182fb7bda1c9ad411b33b5da08e2f96d98eb8ae90d78eac084372 Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.810744 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nms4w" Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:33.814312 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde50a61_2db7_44d1_991d_83bd861d9733.slice/crio-d83c4e6772d390daaaed8709decb52373717628200357a3be859c36336ddbfff WatchSource:0}: Error finding container d83c4e6772d390daaaed8709decb52373717628200357a3be859c36336ddbfff: Status 404 returned error can't find the container with id d83c4e6772d390daaaed8709decb52373717628200357a3be859c36336ddbfff Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.817220 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c874l" Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:33.821548 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5hgnp" Jul 09 16:50:33.849494 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:33.823014 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52f9eea5_3668_4c12_ba94_ea441750861f.slice/crio-7789695d9ee8ca60bd42072e135697732b155c1f8fe0b40a3ab4904ea7c1b372 WatchSource:0}: Error finding container 7789695d9ee8ca60bd42072e135697732b155c1f8fe0b40a3ab4904ea7c1b372: Status 404 returned error can't find the container with id 7789695d9ee8ca60bd42072e135697732b155c1f8fe0b40a3ab4904ea7c1b372 Jul 09 16:50:33.851889 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:33.831805 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862c17b2_7e3e_4971_8cfa_3cb73d2fce4b.slice/crio-eaab72b87e147697c5ccb4ed564cc60e8c046f81be79ed8b1b95321bc8255358 WatchSource:0}: Error finding container eaab72b87e147697c5ccb4ed564cc60e8c046f81be79ed8b1b95321bc8255358: Status 404 returned error can't find the container with id eaab72b87e147697c5ccb4ed564cc60e8c046f81be79ed8b1b95321bc8255358 Jul 09 16:50:33.851889 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:50:33.834285 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2f3565_468b_40b1_aa95_05eaf1ea2288.slice/crio-3d4c586647eb4e5cd3f12e239f10a93f7752e381dd45c48d43c449a232e85ac8 WatchSource:0}: Error finding container 3d4c586647eb4e5cd3f12e239f10a93f7752e381dd45c48d43c449a232e85ac8: Status 404 returned error can't find the container with id 3d4c586647eb4e5cd3f12e239f10a93f7752e381dd45c48d43c449a232e85ac8 Jul 09 16:50:34.092916 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.092833 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:50:34.152451 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.152418 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:34.152598 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.152471 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs\") pod \"network-metrics-daemon-wqxpv\" (UID: \"e6218f09-2689-4275-912f-499ea15f15f8\") " pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:34.152712 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:34.152660 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:50:34.152765 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:34.152718 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs podName:e6218f09-2689-4275-912f-499ea15f15f8 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:35.152699683 +0000 UTC m=+4.195474930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs") pod "network-metrics-daemon-wqxpv" (UID: "e6218f09-2689-4275-912f-499ea15f15f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:50:34.152765 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:34.152749 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:50:34.152861 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:34.152785 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret podName:1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f nodeName:}" failed. No retries permitted until 2026-07-09 16:50:35.152774161 +0000 UTC m=+4.195549403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret") pod "global-pull-secret-syncer-f7rmt" (UID: "1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:50:34.253486 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.253450 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xj\" (UniqueName: \"kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj\") pod \"network-check-target-4dn5j\" (UID: \"a63eb4bd-dca4-44d7-a240-9dce65a98c92\") " pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:34.253661 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:34.253636 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:50:34.253716 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:34.253661 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:50:34.253716 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:34.253676 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8c5xj for pod openshift-network-diagnostics/network-check-target-4dn5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:50:34.253777 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:34.253738 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj podName:a63eb4bd-dca4-44d7-a240-9dce65a98c92 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:35.25371854 +0000 UTC m=+4.296493767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8c5xj" (UniqueName: "kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj") pod "network-check-target-4dn5j" (UID: "a63eb4bd-dca4-44d7-a240-9dce65a98c92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:50:34.487164 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.487071 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 16:45:33 +0000 UTC" deadline="2028-01-14 22:56:37.258317868 +0000 UTC" Jul 09 16:50:34.487164 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.487109 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13302h6m2.771213338s" Jul 09 16:50:34.533476 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.533443 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:34.533611 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:34.533584 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:50:34.541724 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.541693 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c874l" event={"ID":"862c17b2-7e3e-4971-8cfa-3cb73d2fce4b","Type":"ContainerStarted","Data":"eaab72b87e147697c5ccb4ed564cc60e8c046f81be79ed8b1b95321bc8255358"} Jul 09 16:50:34.542771 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.542735 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nms4w" event={"ID":"52f9eea5-3668-4c12-ba94-ea441750861f","Type":"ContainerStarted","Data":"7789695d9ee8ca60bd42072e135697732b155c1f8fe0b40a3ab4904ea7c1b372"} Jul 09 16:50:34.543983 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.543960 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" event={"ID":"bde50a61-2db7-44d1-991d-83bd861d9733","Type":"ContainerStarted","Data":"d83c4e6772d390daaaed8709decb52373717628200357a3be859c36336ddbfff"} Jul 09 16:50:34.545095 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.545076 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nnnfb" event={"ID":"44bd29d3-9dcd-4792-8176-7eb4aee75a2c","Type":"ContainerStarted","Data":"c5f4b16ea38c92626785efeeb460dfe8d962072b6b285efbacc83b4ef13b20db"} Jul 09 16:50:34.546094 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.546071 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cpq" event={"ID":"98c3fe82-cf7e-4b0f-81bc-621f3f946dce","Type":"ContainerStarted","Data":"c31861095b067e0d8923061fc7c9c72a53a244f8ac27a76236c1a3ac00c79b0f"} Jul 09 16:50:34.547218 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.547195 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-htfld" event={"ID":"e63647d0-47d9-4615-aa28-ac09722f1bc1","Type":"ContainerStarted","Data":"d30e357ef240857276ebd2fb0714c9304d9a7d9e45766cb40632ee838133b0ad"} Jul 09 16:50:34.548379 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.548338 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p597h" event={"ID":"1c429941-4fc7-4e4e-ac78-ff2cee2fe854","Type":"ContainerStarted","Data":"2ed31abc84a2a877fd5b768c4fa481e0327a983d0111a8717595c4c5b1a09d39"} Jul 09 16:50:34.549501 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.549483 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5hgnp" event={"ID":"1b2f3565-468b-40b1-aa95-05eaf1ea2288","Type":"ContainerStarted","Data":"3d4c586647eb4e5cd3f12e239f10a93f7752e381dd45c48d43c449a232e85ac8"} Jul 09 16:50:34.550602 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:34.550582 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" event={"ID":"377f2e33-17a4-4663-9ff8-7d42c1ed3b05","Type":"ContainerStarted","Data":"1a948d303fe182fb7bda1c9ad411b33b5da08e2f96d98eb8ae90d78eac084372"} Jul 09 16:50:35.162628 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:35.161832 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs\") pod \"network-metrics-daemon-wqxpv\" (UID: \"e6218f09-2689-4275-912f-499ea15f15f8\") " pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:35.162628 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:35.161936 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:35.162628 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:35.162067 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:50:35.162628 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:35.162127 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret podName:1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f nodeName:}" failed. No retries permitted until 2026-07-09 16:50:37.162108414 +0000 UTC m=+6.204883663 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret") pod "global-pull-secret-syncer-f7rmt" (UID: "1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:50:35.162628 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:35.162549 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:50:35.162628 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:35.162597 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs podName:e6218f09-2689-4275-912f-499ea15f15f8 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:37.162582086 +0000 UTC m=+6.205357319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs") pod "network-metrics-daemon-wqxpv" (UID: "e6218f09-2689-4275-912f-499ea15f15f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:50:35.263706 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:35.263000 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xj\" (UniqueName: \"kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj\") pod \"network-check-target-4dn5j\" (UID: \"a63eb4bd-dca4-44d7-a240-9dce65a98c92\") " pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:35.263706 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:35.263164 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:50:35.263706 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:35.263196 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:50:35.263706 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:35.263209 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8c5xj for pod openshift-network-diagnostics/network-check-target-4dn5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:50:35.263706 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:35.263264 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj podName:a63eb4bd-dca4-44d7-a240-9dce65a98c92 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:37.263246785 +0000 UTC m=+6.306022019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8c5xj" (UniqueName: "kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj") pod "network-check-target-4dn5j" (UID: "a63eb4bd-dca4-44d7-a240-9dce65a98c92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:50:35.487351 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:35.487261 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 16:45:33 +0000 UTC" deadline="2027-12-23 08:23:37.696685396 +0000 UTC" Jul 09 16:50:35.487351 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:35.487304 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12759h33m2.209388372s" Jul 09 16:50:35.537379 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:35.536716 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:35.537379 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:35.536854 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:50:35.537379 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:35.537245 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:35.537379 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:35.537331 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:50:36.534259 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:36.534172 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:36.534708 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:36.534314 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:50:37.180618 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:37.180577 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:37.180811 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:37.180637 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs\") pod \"network-metrics-daemon-wqxpv\" (UID: \"e6218f09-2689-4275-912f-499ea15f15f8\") " pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:37.180811 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:37.180781 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:50:37.180928 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:37.180845 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs podName:e6218f09-2689-4275-912f-499ea15f15f8 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:41.180824649 +0000 UTC m=+10.223599879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs") pod "network-metrics-daemon-wqxpv" (UID: "e6218f09-2689-4275-912f-499ea15f15f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:50:37.181353 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:37.181327 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:50:37.181497 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:37.181396 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret podName:1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f nodeName:}" failed. No retries permitted until 2026-07-09 16:50:41.18138133 +0000 UTC m=+10.224156573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret") pod "global-pull-secret-syncer-f7rmt" (UID: "1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:50:37.281707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:37.281648 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xj\" (UniqueName: \"kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj\") pod \"network-check-target-4dn5j\" (UID: \"a63eb4bd-dca4-44d7-a240-9dce65a98c92\") " pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:37.281889 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:37.281876 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:50:37.281950 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:37.281899 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:50:37.281950 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:37.281912 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8c5xj for pod openshift-network-diagnostics/network-check-target-4dn5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:50:37.282037 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:37.281968 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj podName:a63eb4bd-dca4-44d7-a240-9dce65a98c92 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:41.28194917 +0000 UTC m=+10.324724404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8c5xj" (UniqueName: "kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj") pod "network-check-target-4dn5j" (UID: "a63eb4bd-dca4-44d7-a240-9dce65a98c92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:50:37.537071 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:37.536313 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:37.537071 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:37.536483 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:50:37.537071 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:37.536843 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:37.537071 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:37.536925 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:50:38.533949 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:38.533893 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:38.534093 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:38.534035 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:50:39.534261 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:39.534224 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:39.534261 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:39.534261 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:39.534718 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:39.534413 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:50:39.534718 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:39.534456 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:50:40.534387 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:40.533987 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:40.534387 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:40.534325 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:50:41.209486 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:41.209442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:41.209678 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:41.209503 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs\") pod \"network-metrics-daemon-wqxpv\" (UID: \"e6218f09-2689-4275-912f-499ea15f15f8\") " pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:41.209678 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:41.209613 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:50:41.209678 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:41.209663 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:50:41.209836 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:41.209695 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret podName:1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f nodeName:}" failed. No retries permitted until 2026-07-09 16:50:49.209673737 +0000 UTC m=+18.252448976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret") pod "global-pull-secret-syncer-f7rmt" (UID: "1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:50:41.209836 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:41.209726 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs podName:e6218f09-2689-4275-912f-499ea15f15f8 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:49.209706804 +0000 UTC m=+18.252482057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs") pod "network-metrics-daemon-wqxpv" (UID: "e6218f09-2689-4275-912f-499ea15f15f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:50:41.310695 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:41.310650 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xj\" (UniqueName: \"kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj\") pod \"network-check-target-4dn5j\" (UID: \"a63eb4bd-dca4-44d7-a240-9dce65a98c92\") " pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:41.310870 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:41.310817 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:50:41.310870 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:41.310836 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:50:41.310870 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:41.310848 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8c5xj for pod openshift-network-diagnostics/network-check-target-4dn5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:50:41.311028 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:41.310907 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj podName:a63eb4bd-dca4-44d7-a240-9dce65a98c92 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:49.310890056 +0000 UTC m=+18.353665298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8c5xj" (UniqueName: "kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj") pod "network-check-target-4dn5j" (UID: "a63eb4bd-dca4-44d7-a240-9dce65a98c92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:50:41.535394 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:41.535106 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:41.535394 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:41.535249 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:50:41.535394 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:41.535318 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:41.535925 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:41.535438 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:50:42.534001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:42.533966 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:42.534179 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:42.534104 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:50:43.533802 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:43.533762 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:43.534242 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:43.533891 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:50:43.534876 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:43.534313 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:43.534876 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:43.534442 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:50:44.533858 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.533690 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:44.534329 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:44.533953 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:50:44.576032 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.575991 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c874l" event={"ID":"862c17b2-7e3e-4971-8cfa-3cb73d2fce4b","Type":"ContainerStarted","Data":"b28949dda32ffbbe16ddeedac65eefa49e4eb33985d9d24d2c220682ba11a294"} Jul 09 16:50:44.577411 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.577386 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nms4w" event={"ID":"52f9eea5-3668-4c12-ba94-ea441750861f","Type":"ContainerStarted","Data":"fb571dfb66ccfd1034fd7f3dc466532d22ac37f3c6ad9da69bc0707413ae5453"} Jul 09 16:50:44.579160 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.579137 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" event={"ID":"bde50a61-2db7-44d1-991d-83bd861d9733","Type":"ContainerStarted","Data":"435a5c6f8dd5cc88b8550471ecb2320e34003dfa988bcbfca2c08c2fe9353f84"} Jul 09 16:50:44.580624 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.580604 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nnnfb" event={"ID":"44bd29d3-9dcd-4792-8176-7eb4aee75a2c","Type":"ContainerStarted","Data":"b7c4cc26754dc9ab61e9455256dfcea7f5d09510d6712029799d359bcfd92764"} Jul 09 16:50:44.582046 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.582017 2554 generic.go:356] "Generic (PLEG): container finished" podID="98c3fe82-cf7e-4b0f-81bc-621f3f946dce" containerID="0c8ef61d2e102e0e4bb0f8d66a296559c72f84da2caae29bff3dacd083ff1e81" exitCode=0 Jul 09 16:50:44.582143 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.582083 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cpq" event={"ID":"98c3fe82-cf7e-4b0f-81bc-621f3f946dce","Type":"ContainerDied","Data":"0c8ef61d2e102e0e4bb0f8d66a296559c72f84da2caae29bff3dacd083ff1e81"} Jul 09 16:50:44.584120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.584096 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-htfld" event={"ID":"e63647d0-47d9-4615-aa28-ac09722f1bc1","Type":"ContainerStarted","Data":"702286c4cb26f3c4bd7807d889f2c01b28e566226f28fc7e389e341ce1ab8350"} Jul 09 16:50:44.585613 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.585588 2554 generic.go:356] "Generic (PLEG): container finished" podID="ecd34fa0511bd800d4ea4b978db4cd47" containerID="00095335b9fcf2b5a172b42b7339a1eae4f4e8d5b09f82889c87f8e1930776f5" exitCode=0 Jul 09 16:50:44.585710 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.585670 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal" event={"ID":"ecd34fa0511bd800d4ea4b978db4cd47","Type":"ContainerDied","Data":"00095335b9fcf2b5a172b42b7339a1eae4f4e8d5b09f82889c87f8e1930776f5"} Jul 09 16:50:44.587178 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.587148 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-57.ec2.internal" event={"ID":"087471a9f59f7c1e03f22c0bf78eab5d","Type":"ContainerStarted","Data":"6379c431a1e15cea17f6f05b19ffa1498be8e224433bec937ea88533046083b6"} Jul 09 16:50:44.597201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.597153 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c874l" podStartSLOduration=3.808354872 podStartE2EDuration="13.597123528s" totalImagesPullingTime="9.788768656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:50:44.593736223 +0000 UTC m=+13.636511474" watchObservedRunningTime="2026-07-09 16:50:44.597123528 +0000 UTC m=+13.639898778" Jul 09 16:50:44.641867 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.641815 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-57.ec2.internal" podStartSLOduration=12.641795771 podStartE2EDuration="12.641795771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:50:44.626137029 +0000 UTC m=+13.668912279" watchObservedRunningTime="2026-07-09 16:50:44.641795771 +0000 UTC m=+13.684571022" Jul 09 16:50:44.642007 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.641980 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-htfld" podStartSLOduration=3.763401814 podStartE2EDuration="13.641972956s" totalImagesPullingTime="9.878571142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:50:44.641426315 +0000 UTC m=+13.684201566" watchObservedRunningTime="2026-07-09 16:50:44.641972956 +0000 UTC m=+13.684748219" Jul 09 16:50:44.685942 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.685897 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nnnfb" podStartSLOduration=3.868893731 podStartE2EDuration="13.6858808s" totalImagesPullingTime="9.816987069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:50:44.685584989 +0000 UTC m=+13.728360238" watchObservedRunningTime="2026-07-09 16:50:44.6858808 +0000 UTC m=+13.728656055" Jul 09 16:50:44.699426 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:44.699387 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nms4w" podStartSLOduration=3.893485804 podStartE2EDuration="13.699354442s" totalImagesPullingTime="9.805868638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:50:44.699178951 +0000 UTC m=+13.741954182" watchObservedRunningTime="2026-07-09 16:50:44.699354442 +0000 UTC m=+13.742129692" Jul 09 16:50:45.533560 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:45.533474 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:45.533737 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:45.533474 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:45.533737 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:45.533611 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:50:45.533737 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:45.533659 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:50:45.593042 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:45.593006 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p597h" event={"ID":"1c429941-4fc7-4e4e-ac78-ff2cee2fe854","Type":"ContainerStarted","Data":"369c1465a89916faab7ac527c0af520aaf90db876c20cc6a83568d70cbf7f85f"} Jul 09 16:50:45.595977 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:45.595949 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal" event={"ID":"ecd34fa0511bd800d4ea4b978db4cd47","Type":"ContainerStarted","Data":"00266756fdda5cc61dc497127208870cf2d6379097cc6b846b7aa004278adda5"} Jul 09 16:50:45.623277 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:45.623220 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-57.ec2.internal" podStartSLOduration=13.623202803 podStartE2EDuration="13.623202803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:50:45.622779864 +0000 UTC m=+14.665555115" watchObservedRunningTime="2026-07-09 16:50:45.623202803 +0000 UTC m=+14.665978053" Jul 09 16:50:45.623475 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:45.623386 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p597h" podStartSLOduration=4.769274068 podStartE2EDuration="14.623362527s" totalImagesPullingTime="9.854088459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:50:45.608746811 +0000 UTC m=+14.651522062" watchObservedRunningTime="2026-07-09 16:50:45.623362527 +0000 UTC m=+14.666137776" Jul 09 16:50:45.803927 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:45.803897 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 16:50:46.481153 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:46.480426 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T16:50:45.803923085Z","UUID":"1132b6d5-f345-4e79-8989-a0239a5e80dc","Handler":null,"Name":"","Endpoint":""} Jul 09 16:50:46.482930 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:46.482333 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 16:50:46.482930 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:46.482387 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 16:50:46.533691 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:46.533661 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:46.533838 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:46.533776 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:50:46.599541 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:46.599513 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" event={"ID":"bde50a61-2db7-44d1-991d-83bd861d9733","Type":"ContainerStarted","Data":"4e12ebdaba73b1100f0c28146ae57afb2da6972e0c4f3a040debd2077a59ba4c"} Jul 09 16:50:47.441229 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:47.441199 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c874l" Jul 09 16:50:47.442348 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:47.442137 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c874l" Jul 09 16:50:47.533461 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:47.533393 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:47.533610 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:47.533524 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:50:47.533939 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:47.533796 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:47.533939 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:47.533892 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:50:47.601508 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:47.601484 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c874l" Jul 09 16:50:47.602058 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:47.602040 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c874l" Jul 09 16:50:48.533713 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:48.533683 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:48.533938 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:48.533815 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:50:49.278475 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:49.278439 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:49.279010 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:49.278484 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs\") pod \"network-metrics-daemon-wqxpv\" (UID: \"e6218f09-2689-4275-912f-499ea15f15f8\") " pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:49.279010 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:49.278590 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:50:49.279010 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:49.278608 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:50:49.279010 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:49.278651 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs podName:e6218f09-2689-4275-912f-499ea15f15f8 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:05.278636152 +0000 UTC m=+34.321411379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs") pod "network-metrics-daemon-wqxpv" (UID: "e6218f09-2689-4275-912f-499ea15f15f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:50:49.279010 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:49.278672 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret podName:1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f nodeName:}" failed. No retries permitted until 2026-07-09 16:51:05.278662989 +0000 UTC m=+34.321438219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret") pod "global-pull-secret-syncer-f7rmt" (UID: "1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:50:49.379704 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:49.379667 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xj\" (UniqueName: \"kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj\") pod \"network-check-target-4dn5j\" (UID: \"a63eb4bd-dca4-44d7-a240-9dce65a98c92\") " pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:49.379851 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:49.379813 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:50:49.379851 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:49.379832 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:50:49.379851 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:49.379840 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8c5xj for pod openshift-network-diagnostics/network-check-target-4dn5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:50:49.379984 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:49.379894 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj podName:a63eb4bd-dca4-44d7-a240-9dce65a98c92 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:05.379874519 +0000 UTC m=+34.422649747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8c5xj" (UniqueName: "kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj") pod "network-check-target-4dn5j" (UID: "a63eb4bd-dca4-44d7-a240-9dce65a98c92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:50:49.534148 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:49.534026 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:49.534305 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:49.534159 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:50:49.534305 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:49.534198 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:49.534429 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:49.534333 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:50:50.534179 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:50.533952 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:50.534604 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:50.534284 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:50:51.534088 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:51.534057 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:51.534262 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:51.534185 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:50:51.534262 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:51.534243 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:51.534635 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:51.534382 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:50:52.533939 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:52.533910 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:52.534106 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:52.534036 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:50:53.533607 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:53.533572 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:53.534164 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:53.533572 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:53.534164 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:53.533705 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:50:53.534164 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:53.533779 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:50:54.534223 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:54.534187 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:54.534653 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:54.534308 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:50:55.533637 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:55.533601 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:55.533919 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:55.533611 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:55.533919 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:55.533743 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:50:55.533919 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:55.533828 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:50:56.533478 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:56.533437 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:56.533941 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:56.533560 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:50:57.533517 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:57.533490 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:57.533859 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:57.533607 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:50:57.533859 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:57.533652 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:57.533859 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:57.533740 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:50:57.622507 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:57.622481 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" event={"ID":"bde50a61-2db7-44d1-991d-83bd861d9733","Type":"ContainerStarted","Data":"a5587652ab7550e20325e53bf409a9f27857d6ee68b6e3e97a40dbd0a94352ba"} Jul 09 16:50:57.624089 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:57.624063 2554 generic.go:356] "Generic (PLEG): container finished" podID="98c3fe82-cf7e-4b0f-81bc-621f3f946dce" containerID="aa4d873c25f648ebc35097b32e4b7bc79bae3fd2038be8845c5887c697612f0e" exitCode=0 Jul 09 16:50:57.624176 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:57.624146 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cpq" event={"ID":"98c3fe82-cf7e-4b0f-81bc-621f3f946dce","Type":"ContainerDied","Data":"aa4d873c25f648ebc35097b32e4b7bc79bae3fd2038be8845c5887c697612f0e"} Jul 09 16:50:57.625532 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:57.625510 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5hgnp" event={"ID":"1b2f3565-468b-40b1-aa95-05eaf1ea2288","Type":"ContainerStarted","Data":"3dc2efeea3c427cc367afda1e94b62503eb86159272c10381cb5cc921cee2afa"} Jul 09 16:50:57.627941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:57.627924 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" event={"ID":"377f2e33-17a4-4663-9ff8-7d42c1ed3b05","Type":"ContainerStarted","Data":"f0f5cd66e7530b19d8bfb246f409ad12a12f1fafe038baba54c28de4d9476602"} Jul 09 16:50:57.628030 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:57.627974 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" event={"ID":"377f2e33-17a4-4663-9ff8-7d42c1ed3b05","Type":"ContainerStarted","Data":"a72497f6401aecc647dca1ff978f2a461b140c02c32c542fdde6a8f8bec30a05"} Jul 09 16:50:57.628030 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:57.628011 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" event={"ID":"377f2e33-17a4-4663-9ff8-7d42c1ed3b05","Type":"ContainerStarted","Data":"9353a1e6b79011d8ba7df9891c926489a0ff01b8bf09f6f899c027ab2dc85e94"} Jul 09 16:50:57.628148 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:57.628040 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" event={"ID":"377f2e33-17a4-4663-9ff8-7d42c1ed3b05","Type":"ContainerStarted","Data":"cc5957b061287eb97ceab7d9b6423bbb7e73f3815adea7a4c7c021a4d91f985c"} Jul 09 16:50:57.640479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:57.640439 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc5wq" podStartSLOduration=3.94485654 podStartE2EDuration="26.640424092s" totalImagesPullingTime="22.695567552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:50:57.640289523 +0000 UTC m=+26.683064773" watchObservedRunningTime="2026-07-09 16:50:57.640424092 +0000 UTC m=+26.683199341" Jul 09 16:50:57.656986 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:57.656843 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5hgnp" podStartSLOduration=3.292559856 podStartE2EDuration="26.656831118s" totalImagesPullingTime="23.364271262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:50:57.656689927 +0000 UTC m=+26.699465205" watchObservedRunningTime="2026-07-09 16:50:57.656831118 +0000 UTC m=+26.699606368" Jul 09 16:50:58.533512 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:58.533443 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:50:58.533704 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:58.533541 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:50:58.633321 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:58.633277 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" event={"ID":"377f2e33-17a4-4663-9ff8-7d42c1ed3b05","Type":"ContainerStarted","Data":"d3eaf9bf702be8c29a9de319f838f00bb5523786af356ecba79ceb318c8b2c5e"} Jul 09 16:50:58.633523 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:58.633384 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" event={"ID":"377f2e33-17a4-4663-9ff8-7d42c1ed3b05","Type":"ContainerStarted","Data":"80a2dba385bc158d5c419d4ea9793d1dd3660ff628a94cfb8838977ea39e1c31"} Jul 09 16:50:59.533958 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:59.533929 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:50:59.534448 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:59.534024 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:50:59.534448 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:59.534123 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:50:59.534448 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:50:59.534217 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:50:59.636818 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:59.636796 2554 generic.go:356] "Generic (PLEG): container finished" podID="98c3fe82-cf7e-4b0f-81bc-621f3f946dce" containerID="d65b5e3369561bf08500ba8056ec81165669fbc71333b8baf1fc8a0893f3ee89" exitCode=0 Jul 09 16:50:59.636988 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:50:59.636842 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cpq" event={"ID":"98c3fe82-cf7e-4b0f-81bc-621f3f946dce","Type":"ContainerDied","Data":"d65b5e3369561bf08500ba8056ec81165669fbc71333b8baf1fc8a0893f3ee89"} Jul 09 16:51:00.534160 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:00.534130 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:51:00.534612 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:00.534238 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:51:00.641805 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:00.641771 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" event={"ID":"377f2e33-17a4-4663-9ff8-7d42c1ed3b05","Type":"ContainerStarted","Data":"ba258c64c0a2c0a781021f4a105e9595c5f2e8c137ddaee96e7dd8edb3a7903a"} Jul 09 16:51:01.534853 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:01.534823 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:51:01.535256 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:01.534899 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:51:01.535256 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:01.534984 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:51:01.535256 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:01.535100 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:51:01.649139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:01.649103 2554 generic.go:356] "Generic (PLEG): container finished" podID="98c3fe82-cf7e-4b0f-81bc-621f3f946dce" containerID="8f7296650479e1287a6e1e826a3e8929b4d08f274ebf2f1a4620b0a438b3b860" exitCode=0 Jul 09 16:51:01.649295 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:01.649157 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cpq" event={"ID":"98c3fe82-cf7e-4b0f-81bc-621f3f946dce","Type":"ContainerDied","Data":"8f7296650479e1287a6e1e826a3e8929b4d08f274ebf2f1a4620b0a438b3b860"} Jul 09 16:51:02.533995 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:02.533833 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:51:02.534159 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:02.534057 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:51:02.654872 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:02.654838 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" event={"ID":"377f2e33-17a4-4663-9ff8-7d42c1ed3b05","Type":"ContainerStarted","Data":"b42c30dc398bb0096f7e5099c62f8439a3c8f806f93cbb540d9a1bc701bf3d5f"} Jul 09 16:51:02.655322 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:02.655126 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:51:02.670537 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:02.670513 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:51:02.683987 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:02.683946 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" podStartSLOduration=8.332993605 podStartE2EDuration="31.683932111s" totalImagesPullingTime="23.350938506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:02.683491808 +0000 UTC m=+31.726267060" watchObservedRunningTime="2026-07-09 16:51:02.683932111 +0000 UTC m=+31.726707361" Jul 09 16:51:03.533626 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:03.533594 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:51:03.533796 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:03.533716 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:51:03.533796 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:03.533754 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:51:03.533918 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:03.533833 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:51:03.658432 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:03.658267 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:51:03.658432 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:03.658356 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:51:03.673781 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:03.673755 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:51:03.976313 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:03.976278 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wqxpv"] Jul 09 16:51:03.976535 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:03.976480 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:51:03.976616 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:03.976594 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:51:03.981156 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:03.981128 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4dn5j"] Jul 09 16:51:03.981444 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:03.981237 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:51:03.981444 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:03.981327 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:51:03.981792 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:03.981596 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f7rmt"] Jul 09 16:51:03.981792 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:03.981668 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:51:03.981792 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:03.981740 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:51:05.301918 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:05.301881 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:51:05.301918 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:05.301919 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs\") pod \"network-metrics-daemon-wqxpv\" (UID: \"e6218f09-2689-4275-912f-499ea15f15f8\") " pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:51:05.302408 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:05.302028 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:05.302408 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:05.302038 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:05.302408 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:05.302089 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs podName:e6218f09-2689-4275-912f-499ea15f15f8 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:37.302071861 +0000 UTC m=+66.344847102 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs") pod "network-metrics-daemon-wqxpv" (UID: "e6218f09-2689-4275-912f-499ea15f15f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:05.302408 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:05.302106 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret podName:1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f nodeName:}" failed. No retries permitted until 2026-07-09 16:51:37.302098018 +0000 UTC m=+66.344873259 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret") pod "global-pull-secret-syncer-f7rmt" (UID: "1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:05.402209 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:05.402181 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xj\" (UniqueName: \"kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj\") pod \"network-check-target-4dn5j\" (UID: \"a63eb4bd-dca4-44d7-a240-9dce65a98c92\") " pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:51:05.402404 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:05.402379 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:51:05.402464 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:05.402404 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:51:05.402464 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:05.402417 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8c5xj for pod openshift-network-diagnostics/network-check-target-4dn5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:05.402542 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:05.402481 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj podName:a63eb4bd-dca4-44d7-a240-9dce65a98c92 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:37.402462242 +0000 UTC m=+66.445237484 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8c5xj" (UniqueName: "kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj") pod "network-check-target-4dn5j" (UID: "a63eb4bd-dca4-44d7-a240-9dce65a98c92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:05.534187 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:05.534149 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:51:05.534349 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:05.534150 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:51:05.534349 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:05.534258 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:51:05.534349 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:05.534241 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:51:05.534349 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:05.534343 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:51:05.534571 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:05.534449 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:51:07.534047 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:07.533873 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:51:07.534410 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:07.533874 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:51:07.534410 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:07.533930 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:51:07.534410 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:07.534225 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:51:07.535698 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:07.535594 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:51:07.536593 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:07.536560 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:51:07.669951 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:07.669917 2554 generic.go:356] "Generic (PLEG): container finished" podID="98c3fe82-cf7e-4b0f-81bc-621f3f946dce" containerID="0ffaddddc929995977e51f2daaf261581f637b37d6f93f8d6d2bff56e60b782b" exitCode=0 Jul 09 16:51:07.670115 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:07.669983 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cpq" event={"ID":"98c3fe82-cf7e-4b0f-81bc-621f3f946dce","Type":"ContainerDied","Data":"0ffaddddc929995977e51f2daaf261581f637b37d6f93f8d6d2bff56e60b782b"} Jul 09 16:51:08.674703 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:08.674670 2554 generic.go:356] "Generic (PLEG): container finished" podID="98c3fe82-cf7e-4b0f-81bc-621f3f946dce" containerID="f5ffa2caeaf13dcebf01f717944f7defa8abcec5a6a0e9dc34fe7ba12d201d5e" exitCode=0 Jul 09 16:51:08.675142 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:08.674734 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cpq" event={"ID":"98c3fe82-cf7e-4b0f-81bc-621f3f946dce","Type":"ContainerDied","Data":"f5ffa2caeaf13dcebf01f717944f7defa8abcec5a6a0e9dc34fe7ba12d201d5e"} Jul 09 16:51:09.533986 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.533953 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:51:09.533986 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.533982 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:51:09.534190 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.533958 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:51:09.534190 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:09.534055 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxpv" podUID="e6218f09-2689-4275-912f-499ea15f15f8" Jul 09 16:51:09.534190 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:09.534153 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f7rmt" podUID="1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f" Jul 09 16:51:09.534282 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:09.534239 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dn5j" podUID="a63eb4bd-dca4-44d7-a240-9dce65a98c92" Jul 09 16:51:09.679657 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.679628 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9cpq" event={"ID":"98c3fe82-cf7e-4b0f-81bc-621f3f946dce","Type":"ContainerStarted","Data":"aa0e31f4195d39d823fcb52684a08e5840e822e8bb7002d5acedb7db34a04443"} Jul 09 16:51:09.706905 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.706858 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p9cpq" podStartSLOduration=7.815070089 podStartE2EDuration="38.706845242s" totalImagesPullingTime="30.891775153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:09.704773732 +0000 UTC m=+38.747548984" watchObservedRunningTime="2026-07-09 16:51:09.706845242 +0000 UTC m=+38.749620492" Jul 09 16:51:09.769166 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.769140 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-57.ec2.internal" event="NodeReady" Jul 09 16:51:09.769271 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.769250 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 16:51:09.799941 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.799879 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl"] Jul 09 16:51:09.821400 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.821356 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-8qhrw"] Jul 09 16:51:09.821529 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.821511 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" Jul 09 16:51:09.825681 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.825659 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 16:51:09.825792 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.825773 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wvtqd\"" Jul 09 16:51:09.825860 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.825806 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 16:51:09.826300 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.826286 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:51:09.838052 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.838020 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:09.845456 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.845432 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54"] Jul 09 16:51:09.845554 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.845531 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-8qhrw" Jul 09 16:51:09.848218 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.848202 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mv97b\"" Jul 09 16:51:09.848300 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.848240 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 16:51:09.848646 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.848623 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:51:09.859644 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.859625 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-nj9s6"] Jul 09 16:51:09.860109 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.860089 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" Jul 09 16:51:09.862763 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.862716 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-n94cv\"" Jul 09 16:51:09.863222 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.863004 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 16:51:09.863653 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.863428 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 16:51:09.863653 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.863448 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:51:09.863653 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.863553 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 16:51:09.875681 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.875663 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2"] Jul 09 16:51:09.875789 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.875766 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:09.878779 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.878764 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 16:51:09.878779 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.878777 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 16:51:09.879039 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.879024 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:51:09.879090 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.879078 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 16:51:09.879217 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.879200 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9r4bs\"" Jul 09 16:51:09.883297 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.883280 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 16:51:09.889783 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.889767 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-mzdjr"] Jul 09 16:51:09.889892 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.889879 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:09.894837 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.894818 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 16:51:09.894942 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.894886 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 16:51:09.894942 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.894906 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 16:51:09.896381 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.896355 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wqhcj\"" Jul 09 16:51:09.897604 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.897590 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 16:51:09.903787 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.903769 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6vr4n"] Jul 09 16:51:09.903880 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.903866 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:09.915939 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.915920 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 16:51:09.916528 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.916512 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 16:51:09.916777 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.916761 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 16:51:09.917151 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.917137 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 16:51:09.917986 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.917971 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks"] Jul 09 16:51:09.918131 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.918115 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:09.918232 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.918217 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sr6w5\"" Jul 09 16:51:09.921445 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.921426 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 16:51:09.921888 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.921873 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pdg8n\"" Jul 09 16:51:09.922278 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.922265 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 16:51:09.922394 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.922359 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 16:51:09.930403 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.930385 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1876b077-aa7e-412c-9d33-b579aa0da20e-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qmt54\" (UID: \"1876b077-aa7e-412c-9d33-b579aa0da20e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" Jul 09 16:51:09.930483 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.930414 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/030be92e-4ef0-4a99-a4e8-d5f55803bb62-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:09.930483 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.930453 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1876b077-aa7e-412c-9d33-b579aa0da20e-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qmt54\" (UID: \"1876b077-aa7e-412c-9d33-b579aa0da20e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" Jul 09 16:51:09.930483 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.930470 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7qbcl\" (UID: \"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" Jul 09 16:51:09.930578 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.930489 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e25e426-6b92-427a-a57a-3cef3ca130df-serving-cert\") pod \"console-operator-7866497494-nj9s6\" (UID: \"4e25e426-6b92-427a-a57a-3cef3ca130df\") " pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:09.930578 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.930510 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e25e426-6b92-427a-a57a-3cef3ca130df-trusted-ca\") pod \"console-operator-7866497494-nj9s6\" (UID: \"4e25e426-6b92-427a-a57a-3cef3ca130df\") " pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:09.930578 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.930547 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrk2c\" (UniqueName: \"kubernetes.io/projected/b9ea0f7d-503b-4f39-b1d4-fa4698cb24c8-kube-api-access-wrk2c\") pod \"volume-data-source-validator-78495597f6-8qhrw\" (UID: \"b9ea0f7d-503b-4f39-b1d4-fa4698cb24c8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-8qhrw" Jul 09 16:51:09.930663 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.930578 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e25e426-6b92-427a-a57a-3cef3ca130df-config\") pod \"console-operator-7866497494-nj9s6\" (UID: \"4e25e426-6b92-427a-a57a-3cef3ca130df\") " pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:09.930663 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.930598 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxfbm\" (UniqueName: \"kubernetes.io/projected/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-kube-api-access-bxfbm\") pod \"cluster-samples-operator-65db858894-7qbcl\" (UID: \"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" Jul 09 16:51:09.930663 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.930613 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:09.930663 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.930641 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8qfb\" (UniqueName: \"kubernetes.io/projected/1876b077-aa7e-412c-9d33-b579aa0da20e-kube-api-access-c8qfb\") pod \"kube-storage-version-migrator-operator-799cb7f958-qmt54\" (UID: \"1876b077-aa7e-412c-9d33-b579aa0da20e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" Jul 09 16:51:09.930766 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.930686 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksdnb\" (UniqueName: \"kubernetes.io/projected/030be92e-4ef0-4a99-a4e8-d5f55803bb62-kube-api-access-ksdnb\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:09.930766 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.930713 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddzw7\" (UniqueName: \"kubernetes.io/projected/4e25e426-6b92-427a-a57a-3cef3ca130df-kube-api-access-ddzw7\") pod \"console-operator-7866497494-nj9s6\" (UID: \"4e25e426-6b92-427a-a57a-3cef3ca130df\") " pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:09.931983 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.931966 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77f7495649-j27jg"] Jul 09 16:51:09.932080 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.932068 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" Jul 09 16:51:09.935690 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.935675 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 16:51:09.936207 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.936168 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:51:09.936309 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.936292 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 16:51:09.936491 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.936475 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 16:51:09.936569 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.936497 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ks27n\"" Jul 09 16:51:09.946307 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.946287 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6bfddd6d84-ldxz4"] Jul 09 16:51:09.946419 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.946406 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:09.949066 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.949043 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 16:51:09.949536 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.949518 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 16:51:09.950281 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.950178 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f446k\"" Jul 09 16:51:09.950281 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.950217 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 16:51:09.959790 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.959774 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 16:51:09.970335 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.970313 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl"] Jul 09 16:51:09.970434 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.970344 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-8qhrw"] Jul 09 16:51:09.970434 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.970357 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54"] Jul 09 16:51:09.970434 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.970393 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2"] Jul 09 16:51:09.970434 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.970407 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6vr4n"] Jul 09 16:51:09.970434 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.970424 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v9h26"] Jul 09 16:51:09.970658 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.970439 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:09.972881 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.972863 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 16:51:09.972970 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.972898 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 16:51:09.973027 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.973013 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 16:51:09.973218 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.973202 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 16:51:09.973286 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.973275 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 16:51:09.973461 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.973446 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 16:51:09.973567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.973553 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-v9d47\"" Jul 09 16:51:09.976203 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.976107 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:09.986339 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.986316 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-hmngr"] Jul 09 16:51:09.986439 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.986430 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v9h26" Jul 09 16:51:09.989110 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.989092 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 16:51:09.989192 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.989114 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pbgfq\"" Jul 09 16:51:09.989192 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.989154 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 16:51:09.989192 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:09.989095 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 16:51:10.008427 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.008409 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77f7495649-j27jg"] Jul 09 16:51:10.008521 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.008442 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-xbwhp"] Jul 09 16:51:10.008521 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.008512 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" Jul 09 16:51:10.010965 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.010942 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 09 16:51:10.010965 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.010944 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 09 16:51:10.011077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.011017 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dbdph\"" Jul 09 16:51:10.030573 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.030550 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb"] Jul 09 16:51:10.030673 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.030658 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xbwhp" Jul 09 16:51:10.031085 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031064 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrk2c\" (UniqueName: \"kubernetes.io/projected/b9ea0f7d-503b-4f39-b1d4-fa4698cb24c8-kube-api-access-wrk2c\") pod \"volume-data-source-validator-78495597f6-8qhrw\" (UID: \"b9ea0f7d-503b-4f39-b1d4-fa4698cb24c8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-8qhrw" Jul 09 16:51:10.031191 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031105 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-snapshots\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.031191 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031148 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-default-certificate\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.031292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031199 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxfbm\" (UniqueName: \"kubernetes.io/projected/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-kube-api-access-bxfbm\") pod \"cluster-samples-operator-65db858894-7qbcl\" (UID: \"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" Jul 09 16:51:10.031292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031238 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:10.031406 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031323 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f888d89-ac7e-4d32-bb6d-ece8c6a5974a-cert\") pod \"ingress-canary-v9h26\" (UID: \"7f888d89-ac7e-4d32-bb6d-ece8c6a5974a\") " pod="openshift-ingress-canary/ingress-canary-v9h26" Jul 09 16:51:10.031406 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.031337 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 16:51:10.031406 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031381 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8qfb\" (UniqueName: \"kubernetes.io/projected/1876b077-aa7e-412c-9d33-b579aa0da20e-kube-api-access-c8qfb\") pod \"kube-storage-version-migrator-operator-799cb7f958-qmt54\" (UID: \"1876b077-aa7e-412c-9d33-b579aa0da20e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" Jul 09 16:51:10.031406 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031402 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/670a601a-9ac1-493f-86c2-035f818f910a-trusted-ca\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.031586 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.031433 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls podName:030be92e-4ef0-4a99-a4e8-d5f55803bb62 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:10.531416753 +0000 UTC m=+39.574191980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vzqx2" (UID: "030be92e-4ef0-4a99-a4e8-d5f55803bb62") : secret "cluster-monitoring-operator-tls" not found Jul 09 16:51:10.031586 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031450 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rj9q\" (UniqueName: \"kubernetes.io/projected/6ecd3511-8dcc-4892-b7f3-bde3024a65c8-kube-api-access-8rj9q\") pod \"service-ca-operator-7695fc6c8c-v5hks\" (UID: \"6ecd3511-8dcc-4892-b7f3-bde3024a65c8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" Jul 09 16:51:10.031586 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031467 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d9cac543-ec4f-47b6-be53-f3ac697c99d6-config-volume\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:10.031586 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031482 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-tmp\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.031586 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031496 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-stats-auth\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.031586 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031521 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/670a601a-9ac1-493f-86c2-035f818f910a-installation-pull-secrets\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.031586 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031553 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2n5v\" (UniqueName: \"kubernetes.io/projected/d131f137-3bee-4979-89b5-daafa4bd9deb-kube-api-access-n2n5v\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.031586 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031584 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ecd3511-8dcc-4892-b7f3-bde3024a65c8-serving-cert\") pod \"service-ca-operator-7695fc6c8c-v5hks\" (UID: \"6ecd3511-8dcc-4892-b7f3-bde3024a65c8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" Jul 09 16:51:10.031896 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031604 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.031896 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031627 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e25e426-6b92-427a-a57a-3cef3ca130df-trusted-ca\") pod \"console-operator-7866497494-nj9s6\" (UID: \"4e25e426-6b92-427a-a57a-3cef3ca130df\") " pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:10.031896 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031643 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.031896 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031660 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7qbcl\" (UID: \"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" Jul 09 16:51:10.031896 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031682 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-serving-cert\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.031896 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031705 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-bound-sa-token\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.031896 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031721 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp2h4\" (UniqueName: \"kubernetes.io/projected/7f888d89-ac7e-4d32-bb6d-ece8c6a5974a-kube-api-access-qp2h4\") pod \"ingress-canary-v9h26\" (UID: \"7f888d89-ac7e-4d32-bb6d-ece8c6a5974a\") " pod="openshift-ingress-canary/ingress-canary-v9h26" Jul 09 16:51:10.031896 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031738 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.031896 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.031760 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 16:51:10.031896 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031779 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/670a601a-9ac1-493f-86c2-035f818f910a-ca-trust-extracted\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.031896 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.031816 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls podName:d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:10.531800077 +0000 UTC m=+39.574575330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls") pod "cluster-samples-operator-65db858894-7qbcl" (UID: "d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8") : secret "samples-operator-tls" not found Jul 09 16:51:10.031896 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031874 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e25e426-6b92-427a-a57a-3cef3ca130df-config\") pod \"console-operator-7866497494-nj9s6\" (UID: \"4e25e426-6b92-427a-a57a-3cef3ca130df\") " pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:10.032424 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031905 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.032424 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031938 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/670a601a-9ac1-493f-86c2-035f818f910a-registry-certificates\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.032424 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.031977 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksdnb\" (UniqueName: \"kubernetes.io/projected/030be92e-4ef0-4a99-a4e8-d5f55803bb62-kube-api-access-ksdnb\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:10.032424 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032001 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-454mw\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-kube-api-access-454mw\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.032424 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032025 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9cac543-ec4f-47b6-be53-f3ac697c99d6-tmp-dir\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:10.032424 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032054 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/670a601a-9ac1-493f-86c2-035f818f910a-image-registry-private-configuration\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.032424 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032080 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:10.032424 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032102 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzwcp\" (UniqueName: \"kubernetes.io/projected/d9cac543-ec4f-47b6-be53-f3ac697c99d6-kube-api-access-kzwcp\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:10.032424 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032133 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddzw7\" (UniqueName: \"kubernetes.io/projected/4e25e426-6b92-427a-a57a-3cef3ca130df-kube-api-access-ddzw7\") pod \"console-operator-7866497494-nj9s6\" (UID: \"4e25e426-6b92-427a-a57a-3cef3ca130df\") " pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:10.032424 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032162 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ecd3511-8dcc-4892-b7f3-bde3024a65c8-config\") pod \"service-ca-operator-7695fc6c8c-v5hks\" (UID: \"6ecd3511-8dcc-4892-b7f3-bde3024a65c8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" Jul 09 16:51:10.032424 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032190 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkxt5\" (UniqueName: \"kubernetes.io/projected/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-kube-api-access-kkxt5\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.032424 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032219 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1876b077-aa7e-412c-9d33-b579aa0da20e-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qmt54\" (UID: \"1876b077-aa7e-412c-9d33-b579aa0da20e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" Jul 09 16:51:10.032424 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032342 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/030be92e-4ef0-4a99-a4e8-d5f55803bb62-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:10.032990 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032465 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1876b077-aa7e-412c-9d33-b579aa0da20e-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qmt54\" (UID: \"1876b077-aa7e-412c-9d33-b579aa0da20e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" Jul 09 16:51:10.032990 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032494 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e25e426-6b92-427a-a57a-3cef3ca130df-serving-cert\") pod \"console-operator-7866497494-nj9s6\" (UID: \"4e25e426-6b92-427a-a57a-3cef3ca130df\") " pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:10.032990 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032520 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.032990 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032550 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e25e426-6b92-427a-a57a-3cef3ca130df-trusted-ca\") pod \"console-operator-7866497494-nj9s6\" (UID: \"4e25e426-6b92-427a-a57a-3cef3ca130df\") " pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:10.032990 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032550 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e25e426-6b92-427a-a57a-3cef3ca130df-config\") pod \"console-operator-7866497494-nj9s6\" (UID: \"4e25e426-6b92-427a-a57a-3cef3ca130df\") " pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:10.032990 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.032901 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1876b077-aa7e-412c-9d33-b579aa0da20e-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qmt54\" (UID: \"1876b077-aa7e-412c-9d33-b579aa0da20e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" Jul 09 16:51:10.033204 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.033032 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/030be92e-4ef0-4a99-a4e8-d5f55803bb62-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:10.036245 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.036225 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1876b077-aa7e-412c-9d33-b579aa0da20e-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qmt54\" (UID: \"1876b077-aa7e-412c-9d33-b579aa0da20e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" Jul 09 16:51:10.036354 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.036338 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e25e426-6b92-427a-a57a-3cef3ca130df-serving-cert\") pod \"console-operator-7866497494-nj9s6\" (UID: \"4e25e426-6b92-427a-a57a-3cef3ca130df\") " pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:10.037326 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.037309 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 16:51:10.037556 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.037540 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 16:51:10.037710 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.037698 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dnkvt\"" Jul 09 16:51:10.042853 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.042833 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksdnb\" (UniqueName: \"kubernetes.io/projected/030be92e-4ef0-4a99-a4e8-d5f55803bb62-kube-api-access-ksdnb\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:10.048198 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.048173 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8qfb\" (UniqueName: \"kubernetes.io/projected/1876b077-aa7e-412c-9d33-b579aa0da20e-kube-api-access-c8qfb\") pod \"kube-storage-version-migrator-operator-799cb7f958-qmt54\" (UID: \"1876b077-aa7e-412c-9d33-b579aa0da20e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" Jul 09 16:51:10.049166 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.049141 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrk2c\" (UniqueName: \"kubernetes.io/projected/b9ea0f7d-503b-4f39-b1d4-fa4698cb24c8-kube-api-access-wrk2c\") pod \"volume-data-source-validator-78495597f6-8qhrw\" (UID: \"b9ea0f7d-503b-4f39-b1d4-fa4698cb24c8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-8qhrw" Jul 09 16:51:10.049471 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.049454 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddzw7\" (UniqueName: \"kubernetes.io/projected/4e25e426-6b92-427a-a57a-3cef3ca130df-kube-api-access-ddzw7\") pod \"console-operator-7866497494-nj9s6\" (UID: \"4e25e426-6b92-427a-a57a-3cef3ca130df\") " pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:10.053823 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.053771 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxfbm\" (UniqueName: \"kubernetes.io/projected/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-kube-api-access-bxfbm\") pod \"cluster-samples-operator-65db858894-7qbcl\" (UID: \"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" Jul 09 16:51:10.066956 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.066936 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm"] Jul 09 16:51:10.067073 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.067058 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.071843 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.071802 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 16:51:10.071937 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.071851 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 16:51:10.071937 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.071904 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 09 16:51:10.071937 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.071917 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 16:51:10.072099 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.072015 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 09 16:51:10.072099 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.072056 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 09 16:51:10.072309 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.072293 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 09 16:51:10.089213 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.089195 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-nj9s6"] Jul 09 16:51:10.089282 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.089225 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56"] Jul 09 16:51:10.089328 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.089307 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm" Jul 09 16:51:10.092690 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.092434 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vfxq7\"" Jul 09 16:51:10.092690 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.092654 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 09 16:51:10.103382 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.103350 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks"] Jul 09 16:51:10.103450 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.103402 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-mzdjr"] Jul 09 16:51:10.103450 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.103424 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v9h26"] Jul 09 16:51:10.103450 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.103434 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" Jul 09 16:51:10.103450 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.103442 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-xbwhp"] Jul 09 16:51:10.103589 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.103460 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bfddd6d84-ldxz4"] Jul 09 16:51:10.103589 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.103479 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-hmngr"] Jul 09 16:51:10.103589 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.103499 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm"] Jul 09 16:51:10.103589 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.103514 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56"] Jul 09 16:51:10.103589 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.103544 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb"] Jul 09 16:51:10.105763 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.105746 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 09 16:51:10.133502 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.133479 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-default-certificate\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.133587 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.133516 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f888d89-ac7e-4d32-bb6d-ece8c6a5974a-cert\") pod \"ingress-canary-v9h26\" (UID: \"7f888d89-ac7e-4d32-bb6d-ece8c6a5974a\") " pod="openshift-ingress-canary/ingress-canary-v9h26" Jul 09 16:51:10.133587 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.133535 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27-tmp\") pod \"klusterlet-addon-workmgr-697cb66c4c-fmn56\" (UID: \"1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" Jul 09 16:51:10.133587 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.133552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/670a601a-9ac1-493f-86c2-035f818f910a-trusted-ca\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.133587 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.133569 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rj9q\" (UniqueName: \"kubernetes.io/projected/6ecd3511-8dcc-4892-b7f3-bde3024a65c8-kube-api-access-8rj9q\") pod \"service-ca-operator-7695fc6c8c-v5hks\" (UID: \"6ecd3511-8dcc-4892-b7f3-bde3024a65c8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" Jul 09 16:51:10.133779 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.133673 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d9cac543-ec4f-47b6-be53-f3ac697c99d6-config-volume\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:10.134120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.133826 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-tmp\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.134120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.133863 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-stats-auth\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.134120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.133909 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27-klusterlet-config\") pod \"klusterlet-addon-workmgr-697cb66c4c-fmn56\" (UID: \"1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" Jul 09 16:51:10.134120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.133939 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/670a601a-9ac1-493f-86c2-035f818f910a-installation-pull-secrets\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.134120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.133967 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcp8n\" (UniqueName: \"kubernetes.io/projected/17510db1-cfc6-4ae1-86e5-5e1d78017c2f-kube-api-access-kcp8n\") pod \"network-check-source-869dcfcdcd-xbwhp\" (UID: \"17510db1-cfc6-4ae1-86e5-5e1d78017c2f\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xbwhp" Jul 09 16:51:10.134120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.134001 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2n5v\" (UniqueName: \"kubernetes.io/projected/d131f137-3bee-4979-89b5-daafa4bd9deb-kube-api-access-n2n5v\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.134120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.134026 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdd5f\" (UniqueName: \"kubernetes.io/projected/8f10133f-c41c-472a-bc91-18eb223b46b1-kube-api-access-wdd5f\") pod \"managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm\" (UID: \"8f10133f-c41c-472a-bc91-18eb223b46b1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm" Jul 09 16:51:10.134120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.134055 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ecd3511-8dcc-4892-b7f3-bde3024a65c8-serving-cert\") pod \"service-ca-operator-7695fc6c8c-v5hks\" (UID: \"6ecd3511-8dcc-4892-b7f3-bde3024a65c8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" Jul 09 16:51:10.134120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.134079 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.134120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.134103 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jjd4\" (UniqueName: \"kubernetes.io/projected/fd1f503d-7acd-472b-ba6f-d528fd1b2830-kube-api-access-2jjd4\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.134120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.134129 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.135435 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.134171 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-serving-cert\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.135435 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.134217 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f10133f-c41c-472a-bc91-18eb223b46b1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm\" (UID: \"8f10133f-c41c-472a-bc91-18eb223b46b1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm" Jul 09 16:51:10.135435 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.134249 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-bound-sa-token\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.135435 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.134328 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d9cac543-ec4f-47b6-be53-f3ac697c99d6-config-volume\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:10.135435 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.134443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp2h4\" (UniqueName: \"kubernetes.io/projected/7f888d89-ac7e-4d32-bb6d-ece8c6a5974a-kube-api-access-qp2h4\") pod \"ingress-canary-v9h26\" (UID: \"7f888d89-ac7e-4d32-bb6d-ece8c6a5974a\") " pod="openshift-ingress-canary/ingress-canary-v9h26" Jul 09 16:51:10.135435 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.134492 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.135435 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.134515 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/670a601a-9ac1-493f-86c2-035f818f910a-ca-trust-extracted\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.135435 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.134620 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle podName:d131f137-3bee-4979-89b5-daafa4bd9deb nodeName:}" failed. No retries permitted until 2026-07-09 16:51:10.634602155 +0000 UTC m=+39.677377407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle") pod "router-default-6bfddd6d84-ldxz4" (UID: "d131f137-3bee-4979-89b5-daafa4bd9deb") : configmap references non-existent config key: service-ca.crt Jul 09 16:51:10.135809 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.135443 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 16:51:10.135809 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.135495 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs podName:d131f137-3bee-4979-89b5-daafa4bd9deb nodeName:}" failed. No retries permitted until 2026-07-09 16:51:10.63547753 +0000 UTC m=+39.678252761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs") pod "router-default-6bfddd6d84-ldxz4" (UID: "d131f137-3bee-4979-89b5-daafa4bd9deb") : secret "router-metrics-certs-default" not found Jul 09 16:51:10.135809 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.135790 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/670a601a-9ac1-493f-86c2-035f818f910a-ca-trust-extracted\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.135948 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.135844 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fd1f503d-7acd-472b-ba6f-d528fd1b2830-ca\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.135948 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.135881 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.135948 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.135918 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fd1f503d-7acd-472b-ba6f-d528fd1b2830-hub\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.136089 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.135958 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/670a601a-9ac1-493f-86c2-035f818f910a-registry-certificates\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.136089 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.135984 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcw4r\" (UniqueName: \"kubernetes.io/projected/1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27-kube-api-access-fcw4r\") pod \"klusterlet-addon-workmgr-697cb66c4c-fmn56\" (UID: \"1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" Jul 09 16:51:10.136089 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136035 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-454mw\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-kube-api-access-454mw\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.136089 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136062 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9cac543-ec4f-47b6-be53-f3ac697c99d6-tmp-dir\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:10.136278 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136092 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/670a601a-9ac1-493f-86c2-035f818f910a-image-registry-private-configuration\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.136278 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136118 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:10.136278 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136145 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwcp\" (UniqueName: \"kubernetes.io/projected/d9cac543-ec4f-47b6-be53-f3ac697c99d6-kube-api-access-kzwcp\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:10.136278 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136175 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fd1f503d-7acd-472b-ba6f-d528fd1b2830-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.136278 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ecd3511-8dcc-4892-b7f3-bde3024a65c8-config\") pod \"service-ca-operator-7695fc6c8c-v5hks\" (UID: \"6ecd3511-8dcc-4892-b7f3-bde3024a65c8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" Jul 09 16:51:10.136278 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136241 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18807929-f09f-43ee-bf4a-280ef5005665-nginx-conf\") pod \"networking-console-plugin-6cf856758c-hmngr\" (UID: \"18807929-f09f-43ee-bf4a-280ef5005665\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" Jul 09 16:51:10.136602 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136284 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkxt5\" (UniqueName: \"kubernetes.io/projected/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-kube-api-access-kkxt5\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.136602 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136491 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd1f503d-7acd-472b-ba6f-d528fd1b2830-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.136602 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136523 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hmngr\" (UID: \"18807929-f09f-43ee-bf4a-280ef5005665\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" Jul 09 16:51:10.136602 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136564 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.136602 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136590 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd1f503d-7acd-472b-ba6f-d528fd1b2830-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.136835 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136624 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-snapshots\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.136835 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136745 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-tmp\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.136835 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136765 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.136835 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136766 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/670a601a-9ac1-493f-86c2-035f818f910a-trusted-ca\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.137012 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.136848 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-stats-auth\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.137188 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.137169 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f888d89-ac7e-4d32-bb6d-ece8c6a5974a-cert\") pod \"ingress-canary-v9h26\" (UID: \"7f888d89-ac7e-4d32-bb6d-ece8c6a5974a\") " pod="openshift-ingress-canary/ingress-canary-v9h26" Jul 09 16:51:10.137256 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.137195 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-serving-cert\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.137256 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.137183 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-default-certificate\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.137319 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.137253 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-snapshots\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.137543 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.137508 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/670a601a-9ac1-493f-86c2-035f818f910a-installation-pull-secrets\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.137543 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.137524 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:51:10.137543 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.137541 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f7495649-j27jg: secret "image-registry-tls" not found Jul 09 16:51:10.137720 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.137618 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls podName:670a601a-9ac1-493f-86c2-035f818f910a nodeName:}" failed. No retries permitted until 2026-07-09 16:51:10.637596019 +0000 UTC m=+39.680371265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls") pod "image-registry-77f7495649-j27jg" (UID: "670a601a-9ac1-493f-86c2-035f818f910a") : secret "image-registry-tls" not found Jul 09 16:51:10.137938 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.137906 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:51:10.138039 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.137957 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls podName:d9cac543-ec4f-47b6-be53-f3ac697c99d6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:10.63794257 +0000 UTC m=+39.680717816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls") pod "dns-default-6vr4n" (UID: "d9cac543-ec4f-47b6-be53-f3ac697c99d6") : secret "dns-default-metrics-tls" not found Jul 09 16:51:10.138039 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.137950 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9cac543-ec4f-47b6-be53-f3ac697c99d6-tmp-dir\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:10.138039 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.137977 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/670a601a-9ac1-493f-86c2-035f818f910a-registry-certificates\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.138427 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.138410 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ecd3511-8dcc-4892-b7f3-bde3024a65c8-config\") pod \"service-ca-operator-7695fc6c8c-v5hks\" (UID: \"6ecd3511-8dcc-4892-b7f3-bde3024a65c8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" Jul 09 16:51:10.138507 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.138492 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.138550 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.138522 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ecd3511-8dcc-4892-b7f3-bde3024a65c8-serving-cert\") pod \"service-ca-operator-7695fc6c8c-v5hks\" (UID: \"6ecd3511-8dcc-4892-b7f3-bde3024a65c8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" Jul 09 16:51:10.139717 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.139698 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/670a601a-9ac1-493f-86c2-035f818f910a-image-registry-private-configuration\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.143026 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.143001 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2n5v\" (UniqueName: \"kubernetes.io/projected/d131f137-3bee-4979-89b5-daafa4bd9deb-kube-api-access-n2n5v\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.143426 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.143405 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rj9q\" (UniqueName: \"kubernetes.io/projected/6ecd3511-8dcc-4892-b7f3-bde3024a65c8-kube-api-access-8rj9q\") pod \"service-ca-operator-7695fc6c8c-v5hks\" (UID: \"6ecd3511-8dcc-4892-b7f3-bde3024a65c8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" Jul 09 16:51:10.143987 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.143958 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp2h4\" (UniqueName: \"kubernetes.io/projected/7f888d89-ac7e-4d32-bb6d-ece8c6a5974a-kube-api-access-qp2h4\") pod \"ingress-canary-v9h26\" (UID: \"7f888d89-ac7e-4d32-bb6d-ece8c6a5974a\") " pod="openshift-ingress-canary/ingress-canary-v9h26" Jul 09 16:51:10.145151 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.145126 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkxt5\" (UniqueName: \"kubernetes.io/projected/86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1-kube-api-access-kkxt5\") pod \"insights-operator-68d9dd94cf-mzdjr\" (UID: \"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1\") " pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.145549 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.145528 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-454mw\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-kube-api-access-454mw\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.145626 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.145599 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-bound-sa-token\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.145751 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.145736 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzwcp\" (UniqueName: \"kubernetes.io/projected/d9cac543-ec4f-47b6-be53-f3ac697c99d6-kube-api-access-kzwcp\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:10.160748 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.160731 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-8qhrw" Jul 09 16:51:10.169337 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.169319 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" Jul 09 16:51:10.183487 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.183469 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:10.211921 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.211870 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" Jul 09 16:51:10.238085 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.237881 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd1f503d-7acd-472b-ba6f-d528fd1b2830-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.238085 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.237913 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hmngr\" (UID: \"18807929-f09f-43ee-bf4a-280ef5005665\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" Jul 09 16:51:10.238085 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.237936 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd1f503d-7acd-472b-ba6f-d528fd1b2830-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.238085 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.237981 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27-tmp\") pod \"klusterlet-addon-workmgr-697cb66c4c-fmn56\" (UID: \"1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" Jul 09 16:51:10.238085 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.238000 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27-klusterlet-config\") pod \"klusterlet-addon-workmgr-697cb66c4c-fmn56\" (UID: \"1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" Jul 09 16:51:10.238085 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.238020 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcp8n\" (UniqueName: \"kubernetes.io/projected/17510db1-cfc6-4ae1-86e5-5e1d78017c2f-kube-api-access-kcp8n\") pod \"network-check-source-869dcfcdcd-xbwhp\" (UID: \"17510db1-cfc6-4ae1-86e5-5e1d78017c2f\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xbwhp" Jul 09 16:51:10.238085 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.238047 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdd5f\" (UniqueName: \"kubernetes.io/projected/8f10133f-c41c-472a-bc91-18eb223b46b1-kube-api-access-wdd5f\") pod \"managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm\" (UID: \"8f10133f-c41c-472a-bc91-18eb223b46b1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm" Jul 09 16:51:10.238085 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.238074 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jjd4\" (UniqueName: \"kubernetes.io/projected/fd1f503d-7acd-472b-ba6f-d528fd1b2830-kube-api-access-2jjd4\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.238580 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.238105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f10133f-c41c-472a-bc91-18eb223b46b1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm\" (UID: \"8f10133f-c41c-472a-bc91-18eb223b46b1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm" Jul 09 16:51:10.238580 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.238481 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fd1f503d-7acd-472b-ba6f-d528fd1b2830-ca\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.238580 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.238532 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 16:51:10.238580 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.238540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fd1f503d-7acd-472b-ba6f-d528fd1b2830-hub\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.238580 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.238568 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcw4r\" (UniqueName: \"kubernetes.io/projected/1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27-kube-api-access-fcw4r\") pod \"klusterlet-addon-workmgr-697cb66c4c-fmn56\" (UID: \"1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" Jul 09 16:51:10.238820 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.238600 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert podName:18807929-f09f-43ee-bf4a-280ef5005665 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:10.738583002 +0000 UTC m=+39.781358244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hmngr" (UID: "18807929-f09f-43ee-bf4a-280ef5005665") : secret "networking-console-plugin-cert" not found Jul 09 16:51:10.238820 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.238651 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fd1f503d-7acd-472b-ba6f-d528fd1b2830-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.238820 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.238681 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18807929-f09f-43ee-bf4a-280ef5005665-nginx-conf\") pod \"networking-console-plugin-6cf856758c-hmngr\" (UID: \"18807929-f09f-43ee-bf4a-280ef5005665\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" Jul 09 16:51:10.238820 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.238773 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd1f503d-7acd-472b-ba6f-d528fd1b2830-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.239420 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.239397 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18807929-f09f-43ee-bf4a-280ef5005665-nginx-conf\") pod \"networking-console-plugin-6cf856758c-hmngr\" (UID: \"18807929-f09f-43ee-bf4a-280ef5005665\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" Jul 09 16:51:10.239515 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.239499 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" Jul 09 16:51:10.239952 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.239903 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27-tmp\") pod \"klusterlet-addon-workmgr-697cb66c4c-fmn56\" (UID: \"1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" Jul 09 16:51:10.241132 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.241108 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd1f503d-7acd-472b-ba6f-d528fd1b2830-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.241239 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.241204 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fd1f503d-7acd-472b-ba6f-d528fd1b2830-ca\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.241663 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.241646 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27-klusterlet-config\") pod \"klusterlet-addon-workmgr-697cb66c4c-fmn56\" (UID: \"1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" Jul 09 16:51:10.241933 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.241911 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f10133f-c41c-472a-bc91-18eb223b46b1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm\" (UID: \"8f10133f-c41c-472a-bc91-18eb223b46b1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm" Jul 09 16:51:10.242470 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.242447 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fd1f503d-7acd-472b-ba6f-d528fd1b2830-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.243542 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.243297 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fd1f503d-7acd-472b-ba6f-d528fd1b2830-hub\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.247754 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.247723 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcp8n\" (UniqueName: \"kubernetes.io/projected/17510db1-cfc6-4ae1-86e5-5e1d78017c2f-kube-api-access-kcp8n\") pod \"network-check-source-869dcfcdcd-xbwhp\" (UID: \"17510db1-cfc6-4ae1-86e5-5e1d78017c2f\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xbwhp" Jul 09 16:51:10.248408 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.248185 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcw4r\" (UniqueName: \"kubernetes.io/projected/1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27-kube-api-access-fcw4r\") pod \"klusterlet-addon-workmgr-697cb66c4c-fmn56\" (UID: \"1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" Jul 09 16:51:10.248408 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.248290 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jjd4\" (UniqueName: \"kubernetes.io/projected/fd1f503d-7acd-472b-ba6f-d528fd1b2830-kube-api-access-2jjd4\") pod \"cluster-proxy-proxy-agent-68fbf996f5-jbfqb\" (UID: \"fd1f503d-7acd-472b-ba6f-d528fd1b2830\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.248698 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.248538 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdd5f\" (UniqueName: \"kubernetes.io/projected/8f10133f-c41c-472a-bc91-18eb223b46b1-kube-api-access-wdd5f\") pod \"managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm\" (UID: \"8f10133f-c41c-472a-bc91-18eb223b46b1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm" Jul 09 16:51:10.295067 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.294798 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v9h26" Jul 09 16:51:10.353293 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.350922 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xbwhp" Jul 09 16:51:10.394649 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.388654 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-8qhrw"] Jul 09 16:51:10.400327 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.400091 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:51:10.402315 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.401760 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54"] Jul 09 16:51:10.413164 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.408430 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm" Jul 09 16:51:10.417137 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:10.417014 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1876b077_aa7e_412c_9d33_b579aa0da20e.slice/crio-13d3a2ff7877533f287120e0d96e8095e99b83797e7b195356dfbd87fc53810a WatchSource:0}: Error finding container 13d3a2ff7877533f287120e0d96e8095e99b83797e7b195356dfbd87fc53810a: Status 404 returned error can't find the container with id 13d3a2ff7877533f287120e0d96e8095e99b83797e7b195356dfbd87fc53810a Jul 09 16:51:10.417796 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.417680 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" Jul 09 16:51:10.451748 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.451349 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-nj9s6"] Jul 09 16:51:10.454590 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.453514 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-mzdjr"] Jul 09 16:51:10.459264 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:10.458630 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e25e426_6b92_427a_a57a_3cef3ca130df.slice/crio-f53b5e0899f0e7d26c862141c9cbec16588a1f96a0069e32196c6fcbd3947d23 WatchSource:0}: Error finding container f53b5e0899f0e7d26c862141c9cbec16588a1f96a0069e32196c6fcbd3947d23: Status 404 returned error can't find the container with id f53b5e0899f0e7d26c862141c9cbec16588a1f96a0069e32196c6fcbd3947d23 Jul 09 16:51:10.462790 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:10.462762 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86cf7e9d_3d57_451d_9c6d_5cb0e1dd49c1.slice/crio-18e3e8d48516c2677eb31090850555e985def24ad598db2cecfd77e41786b492 WatchSource:0}: Error finding container 18e3e8d48516c2677eb31090850555e985def24ad598db2cecfd77e41786b492: Status 404 returned error can't find the container with id 18e3e8d48516c2677eb31090850555e985def24ad598db2cecfd77e41786b492 Jul 09 16:51:10.480732 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.480699 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks"] Jul 09 16:51:10.497987 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:10.496837 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ecd3511_8dcc_4892_b7f3_bde3024a65c8.slice/crio-30511ca7457f3959668eda7b9a958bdff42960555d51ed7ee4182098c00c175d WatchSource:0}: Error finding container 30511ca7457f3959668eda7b9a958bdff42960555d51ed7ee4182098c00c175d: Status 404 returned error can't find the container with id 30511ca7457f3959668eda7b9a958bdff42960555d51ed7ee4182098c00c175d Jul 09 16:51:10.506883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.506060 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v9h26"] Jul 09 16:51:10.541935 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.541540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:10.541935 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.541633 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7qbcl\" (UID: \"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" Jul 09 16:51:10.541935 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.541794 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 16:51:10.541935 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.541859 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls podName:d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:11.541839715 +0000 UTC m=+40.584614943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls") pod "cluster-samples-operator-65db858894-7qbcl" (UID: "d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8") : secret "samples-operator-tls" not found Jul 09 16:51:10.542436 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.541987 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 16:51:10.542436 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.542060 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls podName:030be92e-4ef0-4a99-a4e8-d5f55803bb62 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:11.542045482 +0000 UTC m=+40.584820725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vzqx2" (UID: "030be92e-4ef0-4a99-a4e8-d5f55803bb62") : secret "cluster-monitoring-operator-tls" not found Jul 09 16:51:10.569594 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.569521 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-xbwhp"] Jul 09 16:51:10.574626 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:10.574589 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17510db1_cfc6_4ae1_86e5_5e1d78017c2f.slice/crio-469e3cdf60a077b41ad41c043a28a202489e67a25577e5a13d41f37c46f9fc8b WatchSource:0}: Error finding container 469e3cdf60a077b41ad41c043a28a202489e67a25577e5a13d41f37c46f9fc8b: Status 404 returned error can't find the container with id 469e3cdf60a077b41ad41c043a28a202489e67a25577e5a13d41f37c46f9fc8b Jul 09 16:51:10.602028 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.602000 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb"] Jul 09 16:51:10.605085 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:10.605063 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd1f503d_7acd_472b_ba6f_d528fd1b2830.slice/crio-19c5b92b476360248d43fa9ab6b955686b85eeab8d165b457ab834655ce8a59d WatchSource:0}: Error finding container 19c5b92b476360248d43fa9ab6b955686b85eeab8d165b457ab834655ce8a59d: Status 404 returned error can't find the container with id 19c5b92b476360248d43fa9ab6b955686b85eeab8d165b457ab834655ce8a59d Jul 09 16:51:10.617202 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.617178 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm"] Jul 09 16:51:10.619708 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:10.619682 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f10133f_c41c_472a_bc91_18eb223b46b1.slice/crio-e7fd1cfa035d3d159352880638ea376bd24d428292efd845e9bda4961e92580f WatchSource:0}: Error finding container e7fd1cfa035d3d159352880638ea376bd24d428292efd845e9bda4961e92580f: Status 404 returned error can't find the container with id e7fd1cfa035d3d159352880638ea376bd24d428292efd845e9bda4961e92580f Jul 09 16:51:10.642361 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.642339 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56"] Jul 09 16:51:10.642580 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.642515 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.642580 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.642569 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:10.642670 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.642601 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:10.642670 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.642650 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:10.642778 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.642691 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle podName:d131f137-3bee-4979-89b5-daafa4bd9deb nodeName:}" failed. No retries permitted until 2026-07-09 16:51:11.642671544 +0000 UTC m=+40.685446791 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle") pod "router-default-6bfddd6d84-ldxz4" (UID: "d131f137-3bee-4979-89b5-daafa4bd9deb") : configmap references non-existent config key: service-ca.crt Jul 09 16:51:10.642778 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.642745 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 16:51:10.642852 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.642745 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:51:10.642852 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.642805 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs podName:d131f137-3bee-4979-89b5-daafa4bd9deb nodeName:}" failed. No retries permitted until 2026-07-09 16:51:11.642786686 +0000 UTC m=+40.685561929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs") pod "router-default-6bfddd6d84-ldxz4" (UID: "d131f137-3bee-4979-89b5-daafa4bd9deb") : secret "router-metrics-certs-default" not found Jul 09 16:51:10.642852 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.642748 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:51:10.642852 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.642826 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls podName:d9cac543-ec4f-47b6-be53-f3ac697c99d6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:11.64281588 +0000 UTC m=+40.685591107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls") pod "dns-default-6vr4n" (UID: "d9cac543-ec4f-47b6-be53-f3ac697c99d6") : secret "dns-default-metrics-tls" not found Jul 09 16:51:10.642852 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.642841 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f7495649-j27jg: secret "image-registry-tls" not found Jul 09 16:51:10.643012 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.642876 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls podName:670a601a-9ac1-493f-86c2-035f818f910a nodeName:}" failed. No retries permitted until 2026-07-09 16:51:11.642868005 +0000 UTC m=+40.685643233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls") pod "image-registry-77f7495649-j27jg" (UID: "670a601a-9ac1-493f-86c2-035f818f910a") : secret "image-registry-tls" not found Jul 09 16:51:10.644427 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:10.644409 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1570572f_3b4b_4f1d_b77e_bcdcfc5b8f27.slice/crio-a25b981bf1f0f0e5ef20f291ecb0addf418f0357f3789280beb8f3df948ab193 WatchSource:0}: Error finding container a25b981bf1f0f0e5ef20f291ecb0addf418f0357f3789280beb8f3df948ab193: Status 404 returned error can't find the container with id a25b981bf1f0f0e5ef20f291ecb0addf418f0357f3789280beb8f3df948ab193 Jul 09 16:51:10.683411 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.683357 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm" event={"ID":"8f10133f-c41c-472a-bc91-18eb223b46b1","Type":"ContainerStarted","Data":"e7fd1cfa035d3d159352880638ea376bd24d428292efd845e9bda4961e92580f"} Jul 09 16:51:10.684492 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.684471 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" event={"ID":"fd1f503d-7acd-472b-ba6f-d528fd1b2830","Type":"ContainerStarted","Data":"19c5b92b476360248d43fa9ab6b955686b85eeab8d165b457ab834655ce8a59d"} Jul 09 16:51:10.685467 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.685441 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" event={"ID":"1876b077-aa7e-412c-9d33-b579aa0da20e","Type":"ContainerStarted","Data":"13d3a2ff7877533f287120e0d96e8095e99b83797e7b195356dfbd87fc53810a"} Jul 09 16:51:10.686613 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.686584 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-8qhrw" event={"ID":"b9ea0f7d-503b-4f39-b1d4-fa4698cb24c8","Type":"ContainerStarted","Data":"7783f41a1427afdec56360cd889a8ad4eb9a9badeaf85be00926aea5704b3c23"} Jul 09 16:51:10.687669 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.687651 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" event={"ID":"1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27","Type":"ContainerStarted","Data":"a25b981bf1f0f0e5ef20f291ecb0addf418f0357f3789280beb8f3df948ab193"} Jul 09 16:51:10.688710 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.688692 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xbwhp" event={"ID":"17510db1-cfc6-4ae1-86e5-5e1d78017c2f","Type":"ContainerStarted","Data":"469e3cdf60a077b41ad41c043a28a202489e67a25577e5a13d41f37c46f9fc8b"} Jul 09 16:51:10.689751 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.689732 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" event={"ID":"6ecd3511-8dcc-4892-b7f3-bde3024a65c8","Type":"ContainerStarted","Data":"30511ca7457f3959668eda7b9a958bdff42960555d51ed7ee4182098c00c175d"} Jul 09 16:51:10.690774 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.690755 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" event={"ID":"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1","Type":"ContainerStarted","Data":"18e3e8d48516c2677eb31090850555e985def24ad598db2cecfd77e41786b492"} Jul 09 16:51:10.691777 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.691753 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v9h26" event={"ID":"7f888d89-ac7e-4d32-bb6d-ece8c6a5974a","Type":"ContainerStarted","Data":"2e1b6a881ab1e9874d63d3d325839f7c43fadbefa3a127a9dca91d559b9aa3db"} Jul 09 16:51:10.696591 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.696560 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-nj9s6" event={"ID":"4e25e426-6b92-427a-a57a-3cef3ca130df","Type":"ContainerStarted","Data":"f53b5e0899f0e7d26c862141c9cbec16588a1f96a0069e32196c6fcbd3947d23"} Jul 09 16:51:10.743666 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:10.743640 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hmngr\" (UID: \"18807929-f09f-43ee-bf4a-280ef5005665\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" Jul 09 16:51:10.743796 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.743774 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 16:51:10.743861 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:10.743850 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert podName:18807929-f09f-43ee-bf4a-280ef5005665 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:11.74383227 +0000 UTC m=+40.786607513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hmngr" (UID: "18807929-f09f-43ee-bf4a-280ef5005665") : secret "networking-console-plugin-cert" not found Jul 09 16:51:11.545088 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:11.545055 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:51:11.545897 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:11.545427 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:51:11.545897 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:11.545449 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:51:11.548158 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:11.548122 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 16:51:11.550460 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:11.549716 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4z5xv\"" Jul 09 16:51:11.550460 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:11.550025 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 16:51:11.550460 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:11.550226 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k87dn\"" Jul 09 16:51:11.551037 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:11.550772 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7qbcl\" (UID: \"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" Jul 09 16:51:11.551037 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:11.550935 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:11.551194 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:11.551056 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 16:51:11.551194 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:11.551112 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls podName:030be92e-4ef0-4a99-a4e8-d5f55803bb62 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:13.551093406 +0000 UTC m=+42.593868653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vzqx2" (UID: "030be92e-4ef0-4a99-a4e8-d5f55803bb62") : secret "cluster-monitoring-operator-tls" not found Jul 09 16:51:11.551194 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:11.551185 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 16:51:11.551394 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:11.551222 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls podName:d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:13.551209294 +0000 UTC m=+42.593984525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls") pod "cluster-samples-operator-65db858894-7qbcl" (UID: "d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8") : secret "samples-operator-tls" not found Jul 09 16:51:11.652176 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:11.652132 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:11.652345 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:11.652224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:11.652345 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:11.652255 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:11.652345 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:11.652301 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:11.652616 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:11.652529 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:51:11.652616 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:11.652589 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls podName:d9cac543-ec4f-47b6-be53-f3ac697c99d6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:13.652570458 +0000 UTC m=+42.695345699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls") pod "dns-default-6vr4n" (UID: "d9cac543-ec4f-47b6-be53-f3ac697c99d6") : secret "dns-default-metrics-tls" not found Jul 09 16:51:11.652728 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:11.652671 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle podName:d131f137-3bee-4979-89b5-daafa4bd9deb nodeName:}" failed. No retries permitted until 2026-07-09 16:51:13.652660028 +0000 UTC m=+42.695435258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle") pod "router-default-6bfddd6d84-ldxz4" (UID: "d131f137-3bee-4979-89b5-daafa4bd9deb") : configmap references non-existent config key: service-ca.crt Jul 09 16:51:11.653221 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:11.653203 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 16:51:11.653298 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:11.653253 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs podName:d131f137-3bee-4979-89b5-daafa4bd9deb nodeName:}" failed. No retries permitted until 2026-07-09 16:51:13.653237314 +0000 UTC m=+42.696012546 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs") pod "router-default-6bfddd6d84-ldxz4" (UID: "d131f137-3bee-4979-89b5-daafa4bd9deb") : secret "router-metrics-certs-default" not found Jul 09 16:51:11.653381 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:11.653325 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:51:11.653381 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:11.653336 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f7495649-j27jg: secret "image-registry-tls" not found Jul 09 16:51:11.653477 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:11.653383 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls podName:670a601a-9ac1-493f-86c2-035f818f910a nodeName:}" failed. No retries permitted until 2026-07-09 16:51:13.653356363 +0000 UTC m=+42.696131593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls") pod "image-registry-77f7495649-j27jg" (UID: "670a601a-9ac1-493f-86c2-035f818f910a") : secret "image-registry-tls" not found Jul 09 16:51:11.754085 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:11.752958 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hmngr\" (UID: \"18807929-f09f-43ee-bf4a-280ef5005665\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" Jul 09 16:51:11.754085 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:11.753119 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 16:51:11.754085 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:11.753179 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert podName:18807929-f09f-43ee-bf4a-280ef5005665 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:13.753159999 +0000 UTC m=+42.795935231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hmngr" (UID: "18807929-f09f-43ee-bf4a-280ef5005665") : secret "networking-console-plugin-cert" not found Jul 09 16:51:13.573148 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:13.573105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:13.573605 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:13.573192 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7qbcl\" (UID: \"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" Jul 09 16:51:13.573605 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:13.573329 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 16:51:13.573605 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:13.573410 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls podName:d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:17.57339139 +0000 UTC m=+46.616166623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls") pod "cluster-samples-operator-65db858894-7qbcl" (UID: "d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8") : secret "samples-operator-tls" not found Jul 09 16:51:13.573808 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:13.573788 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 16:51:13.573876 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:13.573844 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls podName:030be92e-4ef0-4a99-a4e8-d5f55803bb62 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:17.573829964 +0000 UTC m=+46.616605199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vzqx2" (UID: "030be92e-4ef0-4a99-a4e8-d5f55803bb62") : secret "cluster-monitoring-operator-tls" not found Jul 09 16:51:13.675347 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:13.674257 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:13.675347 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:13.674421 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:13.675347 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:13.674475 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:13.675347 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:13.674506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:13.675347 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:13.674647 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:51:13.675347 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:13.674661 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f7495649-j27jg: secret "image-registry-tls" not found Jul 09 16:51:13.675347 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:13.674716 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls podName:670a601a-9ac1-493f-86c2-035f818f910a nodeName:}" failed. No retries permitted until 2026-07-09 16:51:17.674697811 +0000 UTC m=+46.717473042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls") pod "image-registry-77f7495649-j27jg" (UID: "670a601a-9ac1-493f-86c2-035f818f910a") : secret "image-registry-tls" not found Jul 09 16:51:13.675347 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:13.675100 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:51:13.675347 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:13.675146 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls podName:d9cac543-ec4f-47b6-be53-f3ac697c99d6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:17.675130696 +0000 UTC m=+46.717905931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls") pod "dns-default-6vr4n" (UID: "d9cac543-ec4f-47b6-be53-f3ac697c99d6") : secret "dns-default-metrics-tls" not found Jul 09 16:51:13.675347 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:13.675226 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle podName:d131f137-3bee-4979-89b5-daafa4bd9deb nodeName:}" failed. No retries permitted until 2026-07-09 16:51:17.675216279 +0000 UTC m=+46.717991510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle") pod "router-default-6bfddd6d84-ldxz4" (UID: "d131f137-3bee-4979-89b5-daafa4bd9deb") : configmap references non-existent config key: service-ca.crt Jul 09 16:51:13.675347 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:13.675287 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 16:51:13.675347 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:13.675317 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs podName:d131f137-3bee-4979-89b5-daafa4bd9deb nodeName:}" failed. No retries permitted until 2026-07-09 16:51:17.67530697 +0000 UTC m=+46.718082204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs") pod "router-default-6bfddd6d84-ldxz4" (UID: "d131f137-3bee-4979-89b5-daafa4bd9deb") : secret "router-metrics-certs-default" not found Jul 09 16:51:13.775529 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:13.775430 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hmngr\" (UID: \"18807929-f09f-43ee-bf4a-280ef5005665\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" Jul 09 16:51:13.775679 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:13.775608 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 16:51:13.775679 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:13.775667 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert podName:18807929-f09f-43ee-bf4a-280ef5005665 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:17.77564975 +0000 UTC m=+46.818424996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hmngr" (UID: "18807929-f09f-43ee-bf4a-280ef5005665") : secret "networking-console-plugin-cert" not found Jul 09 16:51:15.107326 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:15.107287 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:15.168321 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:15.168272 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:17.617517 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:17.617335 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:17.617968 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:17.617547 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7qbcl\" (UID: \"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" Jul 09 16:51:17.617968 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:17.617462 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 16:51:17.617968 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:17.617635 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 16:51:17.617968 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:17.617660 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls podName:030be92e-4ef0-4a99-a4e8-d5f55803bb62 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:25.617636411 +0000 UTC m=+54.660411652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vzqx2" (UID: "030be92e-4ef0-4a99-a4e8-d5f55803bb62") : secret "cluster-monitoring-operator-tls" not found Jul 09 16:51:17.617968 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:17.617682 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls podName:d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:25.61767146 +0000 UTC m=+54.660446701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls") pod "cluster-samples-operator-65db858894-7qbcl" (UID: "d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8") : secret "samples-operator-tls" not found Jul 09 16:51:17.718647 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:17.718617 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:17.718820 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:17.718800 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:51:17.718868 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:17.718837 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:17.718974 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:17.718866 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls podName:d9cac543-ec4f-47b6-be53-f3ac697c99d6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:25.718848319 +0000 UTC m=+54.761623550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls") pod "dns-default-6vr4n" (UID: "d9cac543-ec4f-47b6-be53-f3ac697c99d6") : secret "dns-default-metrics-tls" not found Jul 09 16:51:17.718974 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:17.718937 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:17.718974 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:17.718942 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle podName:d131f137-3bee-4979-89b5-daafa4bd9deb nodeName:}" failed. No retries permitted until 2026-07-09 16:51:25.718928266 +0000 UTC m=+54.761703498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle") pod "router-default-6bfddd6d84-ldxz4" (UID: "d131f137-3bee-4979-89b5-daafa4bd9deb") : configmap references non-existent config key: service-ca.crt Jul 09 16:51:17.719127 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:17.718976 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:17.719127 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:17.719008 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 16:51:17.719127 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:17.719044 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs podName:d131f137-3bee-4979-89b5-daafa4bd9deb nodeName:}" failed. No retries permitted until 2026-07-09 16:51:25.719035583 +0000 UTC m=+54.761810816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs") pod "router-default-6bfddd6d84-ldxz4" (UID: "d131f137-3bee-4979-89b5-daafa4bd9deb") : secret "router-metrics-certs-default" not found Jul 09 16:51:17.719127 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:17.719081 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:51:17.719127 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:17.719092 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f7495649-j27jg: secret "image-registry-tls" not found Jul 09 16:51:17.719127 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:17.719125 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls podName:670a601a-9ac1-493f-86c2-035f818f910a nodeName:}" failed. No retries permitted until 2026-07-09 16:51:25.719114346 +0000 UTC m=+54.761889595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls") pod "image-registry-77f7495649-j27jg" (UID: "670a601a-9ac1-493f-86c2-035f818f910a") : secret "image-registry-tls" not found Jul 09 16:51:17.820157 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:17.820115 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hmngr\" (UID: \"18807929-f09f-43ee-bf4a-280ef5005665\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" Jul 09 16:51:17.820317 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:17.820271 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 16:51:17.820392 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:17.820342 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert podName:18807929-f09f-43ee-bf4a-280ef5005665 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:25.82032597 +0000 UTC m=+54.863101200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hmngr" (UID: "18807929-f09f-43ee-bf4a-280ef5005665") : secret "networking-console-plugin-cert" not found Jul 09 16:51:17.931627 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:17.931591 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:17.989465 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:17.989418 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:18.051035 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:18.050999 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:20.453095 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:20.453056 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:20.510590 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:20.510554 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:24.757075 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.757034 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm" event={"ID":"8f10133f-c41c-472a-bc91-18eb223b46b1","Type":"ContainerStarted","Data":"5567e779698bf8d4da932d4e83de5d5ebfea43c28e893d490cf4a0125bc14a4f"} Jul 09 16:51:24.759473 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.759446 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" event={"ID":"fd1f503d-7acd-472b-ba6f-d528fd1b2830","Type":"ContainerStarted","Data":"80896e0b0569ef45b40e8c626f6951f5e1d45bb7760ad7fe2fdbd8fc999ae07d"} Jul 09 16:51:24.761778 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.761746 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" event={"ID":"1876b077-aa7e-412c-9d33-b579aa0da20e","Type":"ContainerStarted","Data":"cfd5ce60115924b136adf45838be11dca497798d56500d4419ea61d5338c3ce7"} Jul 09 16:51:24.764402 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.763353 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-8qhrw" event={"ID":"b9ea0f7d-503b-4f39-b1d4-fa4698cb24c8","Type":"ContainerStarted","Data":"57a63f88412d82498b64a77edb37df0d26d9ae22bec6e07476fa3824b133f99d"} Jul 09 16:51:24.766049 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.765381 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" event={"ID":"1570572f-3b4b-4f1d-b77e-bcdcfc5b8f27","Type":"ContainerStarted","Data":"a8902ad895ce4da91a3990175eabb0f1d736ad8970e641533c125dec59042975"} Jul 09 16:51:24.766147 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.766018 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" Jul 09 16:51:24.768301 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.767573 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xbwhp" event={"ID":"17510db1-cfc6-4ae1-86e5-5e1d78017c2f","Type":"ContainerStarted","Data":"f4019fd4efa5a716fecf6f2eaf1ac4d20451e91833862a7e55b05eb08faea4f3"} Jul 09 16:51:24.768548 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.768488 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" Jul 09 16:51:24.771147 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.771120 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" event={"ID":"6ecd3511-8dcc-4892-b7f3-bde3024a65c8","Type":"ContainerStarted","Data":"682cef5b6f58496bea30603b6cb6a1a552ec23c5bbdc375af1bba4b85abe4c37"} Jul 09 16:51:24.772703 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.772637 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" event={"ID":"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1","Type":"ContainerStarted","Data":"b1927b8650b93a8738ea356b267300b4f1241520975e2d76aa8550d6c1d0c653"} Jul 09 16:51:24.775526 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.775475 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6fb9dd56-ml7pm" podStartSLOduration=23.340980886 podStartE2EDuration="36.775457383s" totalImagesPullingTime="13.434476497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:24.773669208 +0000 UTC m=+53.816444456" watchObservedRunningTime="2026-07-09 16:51:24.775457383 +0000 UTC m=+53.818232636" Jul 09 16:51:24.778051 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.777642 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v9h26" event={"ID":"7f888d89-ac7e-4d32-bb6d-ece8c6a5974a","Type":"ContainerStarted","Data":"1c15e508bfa6baeb4fb46b50ef5f426042a2b0038bbc4070d594df0a7a49a455"} Jul 09 16:51:24.779575 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.779557 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/0.log" Jul 09 16:51:24.779681 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.779595 2554 generic.go:356] "Generic (PLEG): container finished" podID="4e25e426-6b92-427a-a57a-3cef3ca130df" containerID="9a958d54f606fa5d71714557970ca629684dd6b3ce393342f31b6ec0be0c7817" exitCode=255 Jul 09 16:51:24.779681 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.779624 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-nj9s6" event={"ID":"4e25e426-6b92-427a-a57a-3cef3ca130df","Type":"ContainerDied","Data":"9a958d54f606fa5d71714557970ca629684dd6b3ce393342f31b6ec0be0c7817"} Jul 09 16:51:24.779924 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.779903 2554 scope.go:117] "RemoveContainer" containerID="9a958d54f606fa5d71714557970ca629684dd6b3ce393342f31b6ec0be0c7817" Jul 09 16:51:24.792556 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.792361 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" podStartSLOduration=37.215865439 podStartE2EDuration="50.792343376s" totalImagesPullingTime="13.576477937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:24.790930687 +0000 UTC m=+53.833705936" watchObservedRunningTime="2026-07-09 16:51:24.792343376 +0000 UTC m=+53.835118672" Jul 09 16:51:24.817685 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.817641 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" podStartSLOduration=37.321226234 podStartE2EDuration="50.817623331s" totalImagesPullingTime="13.496397097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:24.817426367 +0000 UTC m=+53.860201618" watchObservedRunningTime="2026-07-09 16:51:24.817623331 +0000 UTC m=+53.860398582" Jul 09 16:51:24.858483 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.857633 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" podStartSLOduration=37.264503589 podStartE2EDuration="50.857613611s" totalImagesPullingTime="13.593110022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:24.837226802 +0000 UTC m=+53.880002053" watchObservedRunningTime="2026-07-09 16:51:24.857613611 +0000 UTC m=+53.900388862" Jul 09 16:51:24.859403 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.858822 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-8qhrw" podStartSLOduration=37.280488801 podStartE2EDuration="50.858811148s" totalImagesPullingTime="13.578322347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:24.857069335 +0000 UTC m=+53.899844590" watchObservedRunningTime="2026-07-09 16:51:24.858811148 +0000 UTC m=+53.901586399" Jul 09 16:51:24.883684 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.883610 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-697cb66c4c-fmn56" podStartSLOduration=23.070229735 podStartE2EDuration="36.883588926s" totalImagesPullingTime="13.813359191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:24.882617703 +0000 UTC m=+53.925392954" watchObservedRunningTime="2026-07-09 16:51:24.883588926 +0000 UTC m=+53.926364173" Jul 09 16:51:24.908382 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.908321 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xbwhp" podStartSLOduration=37.429177034 podStartE2EDuration="50.908301655s" totalImagesPullingTime="13.479124621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:24.907641114 +0000 UTC m=+53.950416362" watchObservedRunningTime="2026-07-09 16:51:24.908301655 +0000 UTC m=+53.951076905" Jul 09 16:51:24.969053 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:24.968955 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:25.169120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.169091 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:25.279704 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.279615 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:25.388073 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.388041 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:25.447720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.447690 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:25.689866 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.689827 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:25.694753 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.694726 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7qbcl\" (UID: \"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" Jul 09 16:51:25.694890 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.694865 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 16:51:25.694948 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.694903 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:25.694948 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.694922 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls podName:d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:41.694907321 +0000 UTC m=+70.737682549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls") pod "cluster-samples-operator-65db858894-7qbcl" (UID: "d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8") : secret "samples-operator-tls" not found Jul 09 16:51:25.695065 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.694996 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 16:51:25.695065 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.695054 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls podName:030be92e-4ef0-4a99-a4e8-d5f55803bb62 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:41.695037773 +0000 UTC m=+70.737813005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vzqx2" (UID: "030be92e-4ef0-4a99-a4e8-d5f55803bb62") : secret "cluster-monitoring-operator-tls" not found Jul 09 16:51:25.786124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.786091 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" event={"ID":"fd1f503d-7acd-472b-ba6f-d528fd1b2830","Type":"ContainerStarted","Data":"a6895793ca84b62a0c014580efef2430f9971df84c2a10d683b130fb95ae2475"} Jul 09 16:51:25.786594 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.786143 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" event={"ID":"fd1f503d-7acd-472b-ba6f-d528fd1b2830","Type":"ContainerStarted","Data":"b4c28fcc578c4a6409de5c0ce9fd245fc0f36c7fb8ebbaad8dca830b16c518a7"} Jul 09 16:51:25.787803 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.787783 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 16:51:25.788183 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.788169 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/0.log" Jul 09 16:51:25.788245 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.788204 2554 generic.go:356] "Generic (PLEG): container finished" podID="4e25e426-6b92-427a-a57a-3cef3ca130df" containerID="f53c90cbedb90553518a44030ac0262acad879ca5884ea415795acd40b6b4cf2" exitCode=255 Jul 09 16:51:25.788297 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.788233 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-nj9s6" event={"ID":"4e25e426-6b92-427a-a57a-3cef3ca130df","Type":"ContainerDied","Data":"f53c90cbedb90553518a44030ac0262acad879ca5884ea415795acd40b6b4cf2"} Jul 09 16:51:25.788337 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.788305 2554 scope.go:117] "RemoveContainer" containerID="9a958d54f606fa5d71714557970ca629684dd6b3ce393342f31b6ec0be0c7817" Jul 09 16:51:25.788592 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.788576 2554 scope.go:117] "RemoveContainer" containerID="f53c90cbedb90553518a44030ac0262acad879ca5884ea415795acd40b6b4cf2" Jul 09 16:51:25.788782 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.788750 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-nj9s6_openshift-console-operator(4e25e426-6b92-427a-a57a-3cef3ca130df)\"" pod="openshift-console-operator/console-operator-7866497494-nj9s6" podUID="4e25e426-6b92-427a-a57a-3cef3ca130df" Jul 09 16:51:25.790847 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.790826 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:25.796165 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.796140 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:25.796254 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.796202 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:25.796254 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.796232 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:25.796404 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.796276 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:25.796404 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.796297 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle podName:d131f137-3bee-4979-89b5-daafa4bd9deb nodeName:}" failed. No retries permitted until 2026-07-09 16:51:41.796277928 +0000 UTC m=+70.839053166 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle") pod "router-default-6bfddd6d84-ldxz4" (UID: "d131f137-3bee-4979-89b5-daafa4bd9deb") : configmap references non-existent config key: service-ca.crt Jul 09 16:51:25.796404 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.796348 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 16:51:25.796404 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.796358 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:51:25.796404 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.796353 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:51:25.796592 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.796409 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f7495649-j27jg: secret "image-registry-tls" not found Jul 09 16:51:25.796592 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.796413 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs podName:d131f137-3bee-4979-89b5-daafa4bd9deb nodeName:}" failed. No retries permitted until 2026-07-09 16:51:41.79639848 +0000 UTC m=+70.839173729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs") pod "router-default-6bfddd6d84-ldxz4" (UID: "d131f137-3bee-4979-89b5-daafa4bd9deb") : secret "router-metrics-certs-default" not found Jul 09 16:51:25.796592 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.796432 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls podName:d9cac543-ec4f-47b6-be53-f3ac697c99d6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:41.796422606 +0000 UTC m=+70.839197840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls") pod "dns-default-6vr4n" (UID: "d9cac543-ec4f-47b6-be53-f3ac697c99d6") : secret "dns-default-metrics-tls" not found Jul 09 16:51:25.796592 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.796452 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls podName:670a601a-9ac1-493f-86c2-035f818f910a nodeName:}" failed. No retries permitted until 2026-07-09 16:51:41.796437131 +0000 UTC m=+70.839212383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls") pod "image-registry-77f7495649-j27jg" (UID: "670a601a-9ac1-493f-86c2-035f818f910a") : secret "image-registry-tls" not found Jul 09 16:51:25.806178 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.806142 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" podStartSLOduration=24.342692186 podStartE2EDuration="37.806129025s" totalImagesPullingTime="13.463436839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:25.80510814 +0000 UTC m=+54.847883415" watchObservedRunningTime="2026-07-09 16:51:25.806129025 +0000 UTC m=+54.848904274" Jul 09 16:51:25.806338 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.806319 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v9h26" podStartSLOduration=3.262785246 podStartE2EDuration="16.806312485s" totalImagesPullingTime="13.543527239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:24.951072915 +0000 UTC m=+53.993848166" watchObservedRunningTime="2026-07-09 16:51:25.806312485 +0000 UTC m=+54.849087779" Jul 09 16:51:25.897220 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.897180 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hmngr\" (UID: \"18807929-f09f-43ee-bf4a-280ef5005665\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" Jul 09 16:51:25.897418 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.897324 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 16:51:25.897418 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:25.897409 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert podName:18807929-f09f-43ee-bf4a-280ef5005665 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:41.897388569 +0000 UTC m=+70.940163818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hmngr" (UID: "18807929-f09f-43ee-bf4a-280ef5005665") : secret "networking-console-plugin-cert" not found Jul 09 16:51:25.900676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:25.900651 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:26.002231 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.002139 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:26.198884 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.198843 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9bk6q"] Jul 09 16:51:26.202656 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.202635 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.205307 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.205285 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 16:51:26.205445 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.205285 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 16:51:26.205717 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.205698 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7gwx2\"" Jul 09 16:51:26.212412 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.212393 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9bk6q"] Jul 09 16:51:26.237793 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.237764 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:26.301321 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.301246 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.301321 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.301285 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bztjs\" (UniqueName: \"kubernetes.io/projected/71f2e19d-a596-4872-8897-1a911b056109-kube-api-access-bztjs\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.301520 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.301390 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71f2e19d-a596-4872-8897-1a911b056109-crio-socket\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.301520 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.301425 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.301604 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.301530 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71f2e19d-a596-4872-8897-1a911b056109-data-volume\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.321539 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.321512 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:26.402578 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.402552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71f2e19d-a596-4872-8897-1a911b056109-crio-socket\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.402578 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.402582 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.402782 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:26.402674 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 16:51:26.402782 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.402688 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71f2e19d-a596-4872-8897-1a911b056109-crio-socket\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.402782 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:26.402753 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm podName:71f2e19d-a596-4872-8897-1a911b056109 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:26.902732205 +0000 UTC m=+55.945507450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9bk6q" (UID: "71f2e19d-a596-4872-8897-1a911b056109") : configmap "kube-rbac-proxy" not found Jul 09 16:51:26.402948 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.402787 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71f2e19d-a596-4872-8897-1a911b056109-data-volume\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.402948 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.402909 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.403066 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.402947 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bztjs\" (UniqueName: \"kubernetes.io/projected/71f2e19d-a596-4872-8897-1a911b056109-kube-api-access-bztjs\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.403306 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:26.403286 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 16:51:26.403444 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.403303 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71f2e19d-a596-4872-8897-1a911b056109-data-volume\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.403444 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:26.403410 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls podName:71f2e19d-a596-4872-8897-1a911b056109 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:26.903393421 +0000 UTC m=+55.946168670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9bk6q" (UID: "71f2e19d-a596-4872-8897-1a911b056109") : secret "insights-runtime-extractor-tls" not found Jul 09 16:51:26.442167 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.442143 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bztjs\" (UniqueName: \"kubernetes.io/projected/71f2e19d-a596-4872-8897-1a911b056109-kube-api-access-bztjs\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.498118 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.498086 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:26.513113 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.513084 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kctr7"] Jul 09 16:51:26.515747 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.515730 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kctr7" Jul 09 16:51:26.518183 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.518164 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 16:51:26.518314 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.518297 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 16:51:26.518399 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.518296 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-m9r7j\"" Jul 09 16:51:26.526254 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.526233 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kctr7"] Jul 09 16:51:26.593289 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.593221 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:26.605008 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.604984 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vwsk\" (UniqueName: \"kubernetes.io/projected/dca3a140-9f64-4dda-ab8a-435df418b17a-kube-api-access-7vwsk\") pod \"migrator-7f59b54f6c-kctr7\" (UID: \"dca3a140-9f64-4dda-ab8a-435df418b17a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kctr7" Jul 09 16:51:26.696949 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.696919 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:26.706076 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.706057 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vwsk\" (UniqueName: \"kubernetes.io/projected/dca3a140-9f64-4dda-ab8a-435df418b17a-kube-api-access-7vwsk\") pod \"migrator-7f59b54f6c-kctr7\" (UID: \"dca3a140-9f64-4dda-ab8a-435df418b17a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kctr7" Jul 09 16:51:26.714289 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.714265 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vwsk\" (UniqueName: \"kubernetes.io/projected/dca3a140-9f64-4dda-ab8a-435df418b17a-kube-api-access-7vwsk\") pod \"migrator-7f59b54f6c-kctr7\" (UID: \"dca3a140-9f64-4dda-ab8a-435df418b17a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kctr7" Jul 09 16:51:26.797335 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.797311 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 16:51:26.797917 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.797897 2554 scope.go:117] "RemoveContainer" containerID="f53c90cbedb90553518a44030ac0262acad879ca5884ea415795acd40b6b4cf2" Jul 09 16:51:26.798032 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:26.798016 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-nj9s6_openshift-console-operator(4e25e426-6b92-427a-a57a-3cef3ca130df)\"" pod="openshift-console-operator/console-operator-7866497494-nj9s6" podUID="4e25e426-6b92-427a-a57a-3cef3ca130df" Jul 09 16:51:26.825575 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.825548 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kctr7" Jul 09 16:51:26.908202 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.908169 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.908348 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.908299 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:26.908432 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:26.908339 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 16:51:26.908479 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:26.908433 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls podName:71f2e19d-a596-4872-8897-1a911b056109 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:27.908411129 +0000 UTC m=+56.951186407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9bk6q" (UID: "71f2e19d-a596-4872-8897-1a911b056109") : secret "insights-runtime-extractor-tls" not found Jul 09 16:51:26.908835 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:26.908805 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 16:51:26.908952 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:26.908859 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm podName:71f2e19d-a596-4872-8897-1a911b056109 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:27.908845086 +0000 UTC m=+56.951620314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9bk6q" (UID: "71f2e19d-a596-4872-8897-1a911b056109") : configmap "kube-rbac-proxy" not found Jul 09 16:51:26.947838 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:26.947808 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kctr7"] Jul 09 16:51:26.951412 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:26.951389 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca3a140_9f64_4dda_ab8a_435df418b17a.slice/crio-7a54100dce2b176cd1166d1b88d78ae8f4916d0d6c4a2aaeccb4ecc8a608418c WatchSource:0}: Error finding container 7a54100dce2b176cd1166d1b88d78ae8f4916d0d6c4a2aaeccb4ecc8a608418c: Status 404 returned error can't find the container with id 7a54100dce2b176cd1166d1b88d78ae8f4916d0d6c4a2aaeccb4ecc8a608418c Jul 09 16:51:27.686009 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:27.685984 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nnnfb_44bd29d3-9dcd-4792-8176-7eb4aee75a2c/dns-node-resolver/0.log" Jul 09 16:51:27.801905 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:27.801873 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kctr7" event={"ID":"dca3a140-9f64-4dda-ab8a-435df418b17a","Type":"ContainerStarted","Data":"7a54100dce2b176cd1166d1b88d78ae8f4916d0d6c4a2aaeccb4ecc8a608418c"} Jul 09 16:51:27.918006 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:27.917974 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:27.918159 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:27.918029 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:27.918159 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:27.918125 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 16:51:27.918159 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:27.918139 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 16:51:27.918260 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:27.918188 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm podName:71f2e19d-a596-4872-8897-1a911b056109 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:29.918175209 +0000 UTC m=+58.960950437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9bk6q" (UID: "71f2e19d-a596-4872-8897-1a911b056109") : configmap "kube-rbac-proxy" not found Jul 09 16:51:27.918260 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:27.918200 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls podName:71f2e19d-a596-4872-8897-1a911b056109 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:29.91819425 +0000 UTC m=+58.960969478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9bk6q" (UID: "71f2e19d-a596-4872-8897-1a911b056109") : secret "insights-runtime-extractor-tls" not found Jul 09 16:51:27.962178 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:27.962101 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-49xxj"] Jul 09 16:51:27.965681 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:27.965666 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-49xxj" Jul 09 16:51:27.968247 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:27.968225 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 16:51:27.968247 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:27.968245 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 16:51:27.969431 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:27.969406 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 16:51:27.969476 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:27.969455 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 16:51:27.969476 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:27.969412 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hgqlh\"" Jul 09 16:51:27.975604 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:27.975583 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-49xxj"] Jul 09 16:51:28.074400 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.074347 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:28.119933 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.119903 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/068abcdf-721d-4674-82fa-a463f620771f-signing-cabundle\") pod \"service-ca-79f68b9f4f-49xxj\" (UID: \"068abcdf-721d-4674-82fa-a463f620771f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-49xxj" Jul 09 16:51:28.120053 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.119964 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csvrj\" (UniqueName: \"kubernetes.io/projected/068abcdf-721d-4674-82fa-a463f620771f-kube-api-access-csvrj\") pod \"service-ca-79f68b9f4f-49xxj\" (UID: \"068abcdf-721d-4674-82fa-a463f620771f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-49xxj" Jul 09 16:51:28.120137 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.120120 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/068abcdf-721d-4674-82fa-a463f620771f-signing-key\") pod \"service-ca-79f68b9f4f-49xxj\" (UID: \"068abcdf-721d-4674-82fa-a463f620771f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-49xxj" Jul 09 16:51:28.125128 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.125097 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:28.221244 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.221187 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csvrj\" (UniqueName: \"kubernetes.io/projected/068abcdf-721d-4674-82fa-a463f620771f-kube-api-access-csvrj\") pod \"service-ca-79f68b9f4f-49xxj\" (UID: \"068abcdf-721d-4674-82fa-a463f620771f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-49xxj" Jul 09 16:51:28.221389 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.221356 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/068abcdf-721d-4674-82fa-a463f620771f-signing-key\") pod \"service-ca-79f68b9f4f-49xxj\" (UID: \"068abcdf-721d-4674-82fa-a463f620771f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-49xxj" Jul 09 16:51:28.221464 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.221447 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/068abcdf-721d-4674-82fa-a463f620771f-signing-cabundle\") pod \"service-ca-79f68b9f4f-49xxj\" (UID: \"068abcdf-721d-4674-82fa-a463f620771f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-49xxj" Jul 09 16:51:28.222149 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.222120 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/068abcdf-721d-4674-82fa-a463f620771f-signing-cabundle\") pod \"service-ca-79f68b9f4f-49xxj\" (UID: \"068abcdf-721d-4674-82fa-a463f620771f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-49xxj" Jul 09 16:51:28.223892 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.223870 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/068abcdf-721d-4674-82fa-a463f620771f-signing-key\") pod \"service-ca-79f68b9f4f-49xxj\" (UID: \"068abcdf-721d-4674-82fa-a463f620771f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-49xxj" Jul 09 16:51:28.229751 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.229726 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csvrj\" (UniqueName: \"kubernetes.io/projected/068abcdf-721d-4674-82fa-a463f620771f-kube-api-access-csvrj\") pod \"service-ca-79f68b9f4f-49xxj\" (UID: \"068abcdf-721d-4674-82fa-a463f620771f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-49xxj" Jul 09 16:51:28.274930 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.274908 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-49xxj" Jul 09 16:51:28.403664 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.403634 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:28.411998 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.411975 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-49xxj"] Jul 09 16:51:28.418979 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:28.418952 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068abcdf_721d_4674_82fa_a463f620771f.slice/crio-9137b6b707b90a2623cdeb39edc5451b12f65fe96eb1d58f861852386d44625b WatchSource:0}: Error finding container 9137b6b707b90a2623cdeb39edc5451b12f65fe96eb1d58f861852386d44625b: Status 404 returned error can't find the container with id 9137b6b707b90a2623cdeb39edc5451b12f65fe96eb1d58f861852386d44625b Jul 09 16:51:28.486228 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.486181 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nms4w_52f9eea5-3668-4c12-ba94-ea441750861f/node-ca/0.log" Jul 09 16:51:28.808479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.808399 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-49xxj" event={"ID":"068abcdf-721d-4674-82fa-a463f620771f","Type":"ContainerStarted","Data":"f17dc397bfea5d59fe3440bbdde37979c48a3cf5ae82d27c281bd36e4cbd320d"} Jul 09 16:51:28.808479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.808456 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-49xxj" event={"ID":"068abcdf-721d-4674-82fa-a463f620771f","Type":"ContainerStarted","Data":"9137b6b707b90a2623cdeb39edc5451b12f65fe96eb1d58f861852386d44625b"} Jul 09 16:51:28.827770 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.827718 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-49xxj" podStartSLOduration=1.827702044 podStartE2EDuration="1.827702044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:28.826626948 +0000 UTC m=+57.869402199" watchObservedRunningTime="2026-07-09 16:51:28.827702044 +0000 UTC m=+57.870477293" Jul 09 16:51:28.909637 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:28.909604 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:29.085692 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:29.085631 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v9h26_7f888d89-ac7e-4d32-bb6d-ece8c6a5974a/serve-healthcheck-canary/0.log" Jul 09 16:51:29.814471 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:29.814424 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kctr7" event={"ID":"dca3a140-9f64-4dda-ab8a-435df418b17a","Type":"ContainerStarted","Data":"36806053fd92ff800587eed9e37bfad4375f1fab4f3dfa8976098a6891eb86e7"} Jul 09 16:51:29.814896 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:29.814493 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kctr7" event={"ID":"dca3a140-9f64-4dda-ab8a-435df418b17a","Type":"ContainerStarted","Data":"525dcdaca509771c461e677ca26609a48fe2a46c8c1bb36e29198c219eb44c05"} Jul 09 16:51:29.832584 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:29.832534 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kctr7" podStartSLOduration=1.84236669 podStartE2EDuration="3.832514946s" totalImagesPullingTime="1.990148256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:29.832256693 +0000 UTC m=+58.875031942" watchObservedRunningTime="2026-07-09 16:51:29.832514946 +0000 UTC m=+58.875290197" Jul 09 16:51:29.880687 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:29.880635 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:29.942423 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:29.942390 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:29.942701 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:29.942684 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 16:51:29.942846 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:29.942835 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls podName:71f2e19d-a596-4872-8897-1a911b056109 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:33.942816376 +0000 UTC m=+62.985591608 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9bk6q" (UID: "71f2e19d-a596-4872-8897-1a911b056109") : secret "insights-runtime-extractor-tls" not found Jul 09 16:51:29.942946 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:29.942696 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:29.943355 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:29.942738 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 16:51:29.943451 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:29.943417 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm podName:71f2e19d-a596-4872-8897-1a911b056109 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:33.943400034 +0000 UTC m=+62.986175268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9bk6q" (UID: "71f2e19d-a596-4872-8897-1a911b056109") : configmap "kube-rbac-proxy" not found Jul 09 16:51:29.951890 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:29.951865 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:30.048247 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:30.048221 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:30.102592 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:30.102509 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:30.173244 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:30.173221 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:30.184060 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:30.184035 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:30.184170 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:30.184091 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:30.184493 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:30.184480 2554 scope.go:117] "RemoveContainer" containerID="f53c90cbedb90553518a44030ac0262acad879ca5884ea415795acd40b6b4cf2" Jul 09 16:51:30.184693 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:30.184672 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-nj9s6_openshift-console-operator(4e25e426-6b92-427a-a57a-3cef3ca130df)\"" pod="openshift-console-operator/console-operator-7866497494-nj9s6" podUID="4e25e426-6b92-427a-a57a-3cef3ca130df" Jul 09 16:51:30.379848 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:30.379815 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:30.570307 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:30.570253 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:31.367415 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:31.367382 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:31.973407 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:31.973326 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:32.168198 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:32.168163 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:32.369567 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:32.369485 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:32.570316 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:32.570270 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:33.658046 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:33.658001 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:33.722104 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:33.722064 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:33.775561 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:33.775530 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:33.962937 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:33.962850 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:33.978984 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:33.978956 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:33.979104 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:33.979089 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 16:51:33.979154 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:33.979125 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:33.979196 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:33.979161 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls podName:71f2e19d-a596-4872-8897-1a911b056109 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:41.97913929 +0000 UTC m=+71.021914522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9bk6q" (UID: "71f2e19d-a596-4872-8897-1a911b056109") : secret "insights-runtime-extractor-tls" not found Jul 09 16:51:33.979196 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:33.979183 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 16:51:33.979274 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:33.979236 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm podName:71f2e19d-a596-4872-8897-1a911b056109 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:41.979225643 +0000 UTC m=+71.022000875 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9bk6q" (UID: "71f2e19d-a596-4872-8897-1a911b056109") : configmap "kube-rbac-proxy" not found Jul 09 16:51:34.162337 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:34.162294 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:34.568007 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:34.567967 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:34.622990 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:34.622950 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:34.757965 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:34.757931 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:35.674190 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:35.674164 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jsg5t" Jul 09 16:51:35.994572 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:35.994483 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:37.212408 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.212358 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:37.265334 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.265297 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:37.307634 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.307609 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:51:37.307742 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.307719 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs\") pod \"network-metrics-daemon-wqxpv\" (UID: \"e6218f09-2689-4275-912f-499ea15f15f8\") " pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:51:37.310455 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.310438 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 16:51:37.310511 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.310491 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 16:51:37.319939 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.319910 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f-original-pull-secret\") pod \"global-pull-secret-syncer-f7rmt\" (UID: \"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f\") " pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:51:37.320032 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.319938 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6218f09-2689-4275-912f-499ea15f15f8-metrics-certs\") pod \"network-metrics-daemon-wqxpv\" (UID: \"e6218f09-2689-4275-912f-499ea15f15f8\") " pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:51:37.363760 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.363733 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:37.369514 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.369496 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7rmt" Jul 09 16:51:37.383664 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.383643 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k87dn\"" Jul 09 16:51:37.390180 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.390157 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxpv" Jul 09 16:51:37.408840 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.408805 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xj\" (UniqueName: \"kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj\") pod \"network-check-target-4dn5j\" (UID: \"a63eb4bd-dca4-44d7-a240-9dce65a98c92\") " pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:51:37.411521 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.411499 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c5xj\" (UniqueName: \"kubernetes.io/projected/a63eb4bd-dca4-44d7-a240-9dce65a98c92-kube-api-access-8c5xj\") pod \"network-check-target-4dn5j\" (UID: \"a63eb4bd-dca4-44d7-a240-9dce65a98c92\") " pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:51:37.420297 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.420161 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:37.512424 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.512397 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f7rmt"] Jul 09 16:51:37.514772 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:37.514741 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c2a0c99_8fb4_486d_8e71_e714c7dc1c0f.slice/crio-f25c67b4742cf12a7a14834d15e1d21ff6fa106371b6c86da440e2271b0fcbe2 WatchSource:0}: Error finding container f25c67b4742cf12a7a14834d15e1d21ff6fa106371b6c86da440e2271b0fcbe2: Status 404 returned error can't find the container with id f25c67b4742cf12a7a14834d15e1d21ff6fa106371b6c86da440e2271b0fcbe2 Jul 09 16:51:37.546216 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.546145 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wqxpv"] Jul 09 16:51:37.549087 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:37.549062 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6218f09_2689_4275_912f_499ea15f15f8.slice/crio-ba3221d507f8607e36c847f8f09d90cc81190cb274537c26de79670731d698e8 WatchSource:0}: Error finding container ba3221d507f8607e36c847f8f09d90cc81190cb274537c26de79670731d698e8: Status 404 returned error can't find the container with id ba3221d507f8607e36c847f8f09d90cc81190cb274537c26de79670731d698e8 Jul 09 16:51:37.691306 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.691280 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4z5xv\"" Jul 09 16:51:37.698606 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.698588 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:51:37.821806 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.821776 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4dn5j"] Jul 09 16:51:37.825557 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:37.825532 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda63eb4bd_dca4_44d7_a240_9dce65a98c92.slice/crio-00e2bffae044ac6bd11103fdf5cb9f8466aecf06517d961777f0319ebc70d286 WatchSource:0}: Error finding container 00e2bffae044ac6bd11103fdf5cb9f8466aecf06517d961777f0319ebc70d286: Status 404 returned error can't find the container with id 00e2bffae044ac6bd11103fdf5cb9f8466aecf06517d961777f0319ebc70d286 Jul 09 16:51:37.842657 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.842627 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4dn5j" event={"ID":"a63eb4bd-dca4-44d7-a240-9dce65a98c92","Type":"ContainerStarted","Data":"00e2bffae044ac6bd11103fdf5cb9f8466aecf06517d961777f0319ebc70d286"} Jul 09 16:51:37.844032 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.844008 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wqxpv" event={"ID":"e6218f09-2689-4275-912f-499ea15f15f8","Type":"ContainerStarted","Data":"ba3221d507f8607e36c847f8f09d90cc81190cb274537c26de79670731d698e8"} Jul 09 16:51:37.845324 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.845302 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f7rmt" event={"ID":"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f","Type":"ContainerStarted","Data":"f25c67b4742cf12a7a14834d15e1d21ff6fa106371b6c86da440e2271b0fcbe2"} Jul 09 16:51:37.974874 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:37.974838 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:38.167599 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:38.167567 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:38.365700 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:38.365666 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:38.850571 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:38.850538 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4dn5j" event={"ID":"a63eb4bd-dca4-44d7-a240-9dce65a98c92","Type":"ContainerStarted","Data":"6b1e43fa996d7090205ea822d827e6b7c8ae287ef129b310c775edd8e6738ca9"} Jul 09 16:51:38.850729 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:38.850645 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:51:38.865850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:38.865805 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4dn5j" podStartSLOduration=67.865792244 podStartE2EDuration="1m7.865792244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:38.865566143 +0000 UTC m=+67.908341405" watchObservedRunningTime="2026-07-09 16:51:38.865792244 +0000 UTC m=+67.908567636" Jul 09 16:51:39.614544 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:39.614500 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:39.677814 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:39.677782 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:39.770236 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:39.770193 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:39.974312 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:39.974280 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:40.197296 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:40.197262 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:40.589055 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:40.588973 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:40.862036 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:40.861947 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wqxpv" event={"ID":"e6218f09-2689-4275-912f-499ea15f15f8","Type":"ContainerStarted","Data":"cdb166fd590b0af3414ec3c1cea242c41e984ec1d68b78968d45292f96e8822f"} Jul 09 16:51:40.862502 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:40.862057 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wqxpv" event={"ID":"e6218f09-2689-4275-912f-499ea15f15f8","Type":"ContainerStarted","Data":"f695e786e5647561b576ccb9d82c7e11a6aa10e037d6f0840a1116118d4f9088"} Jul 09 16:51:40.880753 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:40.880706 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wqxpv" podStartSLOduration=67.210185297 podStartE2EDuration="1m9.880691779s" totalImagesPullingTime="2.670506482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:40.87962986 +0000 UTC m=+69.922405112" watchObservedRunningTime="2026-07-09 16:51:40.880691779 +0000 UTC m=+69.923467031" Jul 09 16:51:41.015706 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.015669 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:41.535088 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.535062 2554 scope.go:117] "RemoveContainer" containerID="f53c90cbedb90553518a44030ac0262acad879ca5884ea415795acd40b6b4cf2" Jul 09 16:51:41.748156 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.748113 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7qbcl\" (UID: \"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" Jul 09 16:51:41.748324 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.748232 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:41.750386 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.750341 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/030be92e-4ef0-4a99-a4e8-d5f55803bb62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vzqx2\" (UID: \"030be92e-4ef0-4a99-a4e8-d5f55803bb62\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:41.750495 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.750439 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7qbcl\" (UID: \"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" Jul 09 16:51:41.849227 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.849144 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:41.849227 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.849202 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:41.849227 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.849221 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:41.849523 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.849245 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:41.849935 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.849905 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d131f137-3bee-4979-89b5-daafa4bd9deb-service-ca-bundle\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:41.851448 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.851412 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9cac543-ec4f-47b6-be53-f3ac697c99d6-metrics-tls\") pod \"dns-default-6vr4n\" (UID: \"d9cac543-ec4f-47b6-be53-f3ac697c99d6\") " pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:41.851654 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.851638 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131f137-3bee-4979-89b5-daafa4bd9deb-metrics-certs\") pod \"router-default-6bfddd6d84-ldxz4\" (UID: \"d131f137-3bee-4979-89b5-daafa4bd9deb\") " pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:41.851737 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.851717 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls\") pod \"image-registry-77f7495649-j27jg\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:41.867630 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.867609 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 16:51:41.867908 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.867725 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-nj9s6" event={"ID":"4e25e426-6b92-427a-a57a-3cef3ca130df","Type":"ContainerStarted","Data":"fb8290c857b0d7f20165ea581b9f15909aadffc53252f72eae992a71c671b61d"} Jul 09 16:51:41.868161 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.868138 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:41.891558 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.891508 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-nj9s6" podStartSLOduration=54.294363924 podStartE2EDuration="1m7.891490461s" totalImagesPullingTime="13.597126537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:41.889933195 +0000 UTC m=+70.932708448" watchObservedRunningTime="2026-07-09 16:51:41.891490461 +0000 UTC m=+70.934265712" Jul 09 16:51:41.934199 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.934176 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wvtqd\"" Jul 09 16:51:41.941688 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.941669 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" Jul 09 16:51:41.950923 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.950686 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hmngr\" (UID: \"18807929-f09f-43ee-bf4a-280ef5005665\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" Jul 09 16:51:41.952994 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:41.952975 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18807929-f09f-43ee-bf4a-280ef5005665-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hmngr\" (UID: \"18807929-f09f-43ee-bf4a-280ef5005665\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" Jul 09 16:51:42.012946 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.012720 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wqhcj\"" Jul 09 16:51:42.019686 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.019435 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" Jul 09 16:51:42.028403 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.028231 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pdg8n\"" Jul 09 16:51:42.036479 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.036457 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:42.052054 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.051626 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:42.052054 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.051684 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:42.052403 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.052255 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71f2e19d-a596-4872-8897-1a911b056109-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:42.054604 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.054556 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71f2e19d-a596-4872-8897-1a911b056109-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bk6q\" (UID: \"71f2e19d-a596-4872-8897-1a911b056109\") " pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:42.058128 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.058109 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f446k\"" Jul 09 16:51:42.066534 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.066496 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:42.082234 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.081973 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-v9d47\"" Jul 09 16:51:42.091040 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.090043 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:42.092719 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.092696 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl"] Jul 09 16:51:42.116212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.115770 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7gwx2\"" Jul 09 16:51:42.119001 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.118813 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dbdph\"" Jul 09 16:51:42.123693 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.122512 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9bk6q" Jul 09 16:51:42.126495 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.126468 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" Jul 09 16:51:42.206784 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.206697 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2"] Jul 09 16:51:42.222751 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:42.222697 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030be92e_4ef0_4a99_a4e8_d5f55803bb62.slice/crio-ea8e4798848dfff0bc28fe1b7bb89b4e756912940c5cc33a0785caa39688c621 WatchSource:0}: Error finding container ea8e4798848dfff0bc28fe1b7bb89b4e756912940c5cc33a0785caa39688c621: Status 404 returned error can't find the container with id ea8e4798848dfff0bc28fe1b7bb89b4e756912940c5cc33a0785caa39688c621 Jul 09 16:51:42.250094 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.249482 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6vr4n"] Jul 09 16:51:42.250203 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:42.250128 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9cac543_ec4f_47b6_be53_f3ac697c99d6.slice/crio-0b3fa31abc315e52c7d96e4520c24b65aa4c4e1be2a42ab6984049e88ab20ff3 WatchSource:0}: Error finding container 0b3fa31abc315e52c7d96e4520c24b65aa4c4e1be2a42ab6984049e88ab20ff3: Status 404 returned error can't find the container with id 0b3fa31abc315e52c7d96e4520c24b65aa4c4e1be2a42ab6984049e88ab20ff3 Jul 09 16:51:42.301275 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.301206 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77f7495649-j27jg"] Jul 09 16:51:42.301989 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:42.301951 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod670a601a_9ac1_493f_86c2_035f818f910a.slice/crio-0106dcb0e88c01cb140c7e4ba6cfcaf9e515ee84a39c442a04eb7adda906f89c WatchSource:0}: Error finding container 0106dcb0e88c01cb140c7e4ba6cfcaf9e515ee84a39c442a04eb7adda906f89c: Status 404 returned error can't find the container with id 0106dcb0e88c01cb140c7e4ba6cfcaf9e515ee84a39c442a04eb7adda906f89c Jul 09 16:51:42.329098 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.328202 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bfddd6d84-ldxz4"] Jul 09 16:51:42.333630 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:42.333598 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd131f137_3bee_4979_89b5_daafa4bd9deb.slice/crio-2d524b975953c46239eea60d48b2ff144f450218b9ec13fa57d47d6a00599f73 WatchSource:0}: Error finding container 2d524b975953c46239eea60d48b2ff144f450218b9ec13fa57d47d6a00599f73: Status 404 returned error can't find the container with id 2d524b975953c46239eea60d48b2ff144f450218b9ec13fa57d47d6a00599f73 Jul 09 16:51:42.349636 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.349604 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-hmngr"] Jul 09 16:51:42.375423 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.375385 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9bk6q"] Jul 09 16:51:42.377567 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:42.377546 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f2e19d_a596_4872_8897_1a911b056109.slice/crio-90506163d06c73b3246a75ca6e77950cacd2628eeeab83803951cc3e319391e4 WatchSource:0}: Error finding container 90506163d06c73b3246a75ca6e77950cacd2628eeeab83803951cc3e319391e4: Status 404 returned error can't find the container with id 90506163d06c73b3246a75ca6e77950cacd2628eeeab83803951cc3e319391e4 Jul 09 16:51:42.579095 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.579062 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-nj9s6" Jul 09 16:51:42.756940 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.756814 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:42.858261 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.858222 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:42.894161 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.893272 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" event={"ID":"d131f137-3bee-4979-89b5-daafa4bd9deb","Type":"ContainerStarted","Data":"9c62422e7303e596596265763d5bccff6dcbc604fc7fa209c6c4e6318ad58042"} Jul 09 16:51:42.894161 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.893383 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" event={"ID":"d131f137-3bee-4979-89b5-daafa4bd9deb","Type":"ContainerStarted","Data":"2d524b975953c46239eea60d48b2ff144f450218b9ec13fa57d47d6a00599f73"} Jul 09 16:51:42.907818 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.907732 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" event={"ID":"030be92e-4ef0-4a99-a4e8-d5f55803bb62","Type":"ContainerStarted","Data":"ea8e4798848dfff0bc28fe1b7bb89b4e756912940c5cc33a0785caa39688c621"} Jul 09 16:51:42.910606 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.910537 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6vr4n" event={"ID":"d9cac543-ec4f-47b6-be53-f3ac697c99d6","Type":"ContainerStarted","Data":"0b3fa31abc315e52c7d96e4520c24b65aa4c4e1be2a42ab6984049e88ab20ff3"} Jul 09 16:51:42.914316 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.913316 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" podStartSLOduration=68.913298872 podStartE2EDuration="1m8.913298872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:42.911556434 +0000 UTC m=+71.954331682" watchObservedRunningTime="2026-07-09 16:51:42.913298872 +0000 UTC m=+71.956074115" Jul 09 16:51:42.916715 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.916631 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9bk6q" event={"ID":"71f2e19d-a596-4872-8897-1a911b056109","Type":"ContainerStarted","Data":"90506163d06c73b3246a75ca6e77950cacd2628eeeab83803951cc3e319391e4"} Jul 09 16:51:42.922762 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.922735 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" event={"ID":"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8","Type":"ContainerStarted","Data":"66e1825c7c970ca8811f8a7b506d321e89e5653d0c6dda2f973ff5c151d13179"} Jul 09 16:51:42.928209 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.928153 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" event={"ID":"18807929-f09f-43ee-bf4a-280ef5005665","Type":"ContainerStarted","Data":"eefd944f181c14258843c01c47913861c44aab81a9e4fa3539d5ec5ae07ba171"} Jul 09 16:51:42.936314 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.936193 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77f7495649-j27jg" event={"ID":"670a601a-9ac1-493f-86c2-035f818f910a","Type":"ContainerStarted","Data":"bafb16bcb3d913c8fca507b278bc746236a8ddc7d834081f82d17bc1fa3e02c0"} Jul 09 16:51:42.936314 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.936234 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77f7495649-j27jg" event={"ID":"670a601a-9ac1-493f-86c2-035f818f910a","Type":"ContainerStarted","Data":"0106dcb0e88c01cb140c7e4ba6cfcaf9e515ee84a39c442a04eb7adda906f89c"} Jul 09 16:51:42.936314 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:42.936283 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:51:43.039406 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:43.039284 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:43.093586 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:43.093517 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:43.096503 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:43.096275 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:43.117557 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:43.116927 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77f7495649-j27jg" podStartSLOduration=69.116904614 podStartE2EDuration="1m9.116904614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:42.962525237 +0000 UTC m=+72.005300489" watchObservedRunningTime="2026-07-09 16:51:43.116904614 +0000 UTC m=+72.159679866" Jul 09 16:51:43.121098 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:43.121039 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:43.951989 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:43.951713 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:43.953352 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:43.953149 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6bfddd6d84-ldxz4" Jul 09 16:51:44.494964 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:44.494933 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:44.547243 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:44.547207 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:44.846402 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:44.846310 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:44.948005 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:44.947975 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:46.681438 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:46.681312 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:46.781744 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:46.781713 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:48.081952 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.081907 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77f7495649-j27jg"] Jul 09 16:51:48.102540 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.102511 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-vg4p8"] Jul 09 16:51:48.123081 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.123051 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-vg4p8"] Jul 09 16:51:48.123236 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.123178 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-vg4p8" Jul 09 16:51:48.126159 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.125759 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cjd4k\"" Jul 09 16:51:48.126159 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.125842 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 16:51:48.126159 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.125992 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 16:51:48.198162 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.198127 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:48.203035 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.203006 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b86bcd54c-j8gxx"] Jul 09 16:51:48.209818 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.209796 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.213238 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.213216 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqq9b\" (UniqueName: \"kubernetes.io/projected/466ffcf6-d687-4473-84e1-116404ca3718-kube-api-access-cqq9b\") pod \"downloads-68c9cbb497-vg4p8\" (UID: \"466ffcf6-d687-4473-84e1-116404ca3718\") " pod="openshift-console/downloads-68c9cbb497-vg4p8" Jul 09 16:51:48.221959 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.221936 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b86bcd54c-j8gxx"] Jul 09 16:51:48.294099 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.294064 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:48.314356 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.314326 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1404334-3914-449b-b1e3-1f77334dcaab-trusted-ca\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.314356 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.314380 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1404334-3914-449b-b1e3-1f77334dcaab-registry-certificates\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.314582 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.314475 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqq9b\" (UniqueName: \"kubernetes.io/projected/466ffcf6-d687-4473-84e1-116404ca3718-kube-api-access-cqq9b\") pod \"downloads-68c9cbb497-vg4p8\" (UID: \"466ffcf6-d687-4473-84e1-116404ca3718\") " pod="openshift-console/downloads-68c9cbb497-vg4p8" Jul 09 16:51:48.314582 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.314525 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1404334-3914-449b-b1e3-1f77334dcaab-registry-tls\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.314686 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.314602 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1404334-3914-449b-b1e3-1f77334dcaab-bound-sa-token\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.314686 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.314639 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1404334-3914-449b-b1e3-1f77334dcaab-ca-trust-extracted\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.314686 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.314663 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1404334-3914-449b-b1e3-1f77334dcaab-installation-pull-secrets\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.314811 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.314685 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1404334-3914-449b-b1e3-1f77334dcaab-image-registry-private-configuration\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.314811 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.314755 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blz9x\" (UniqueName: \"kubernetes.io/projected/b1404334-3914-449b-b1e3-1f77334dcaab-kube-api-access-blz9x\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.324129 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.324101 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqq9b\" (UniqueName: \"kubernetes.io/projected/466ffcf6-d687-4473-84e1-116404ca3718-kube-api-access-cqq9b\") pod \"downloads-68c9cbb497-vg4p8\" (UID: \"466ffcf6-d687-4473-84e1-116404ca3718\") " pod="openshift-console/downloads-68c9cbb497-vg4p8" Jul 09 16:51:48.393118 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.393083 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:48.415961 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.415930 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1404334-3914-449b-b1e3-1f77334dcaab-registry-tls\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.416119 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.415987 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1404334-3914-449b-b1e3-1f77334dcaab-bound-sa-token\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.416119 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.416030 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1404334-3914-449b-b1e3-1f77334dcaab-ca-trust-extracted\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.416119 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.416054 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1404334-3914-449b-b1e3-1f77334dcaab-installation-pull-secrets\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.416119 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.416081 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1404334-3914-449b-b1e3-1f77334dcaab-image-registry-private-configuration\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.416401 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.416340 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blz9x\" (UniqueName: \"kubernetes.io/projected/b1404334-3914-449b-b1e3-1f77334dcaab-kube-api-access-blz9x\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.416501 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.416420 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1404334-3914-449b-b1e3-1f77334dcaab-trusted-ca\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.416501 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.416451 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1404334-3914-449b-b1e3-1f77334dcaab-registry-certificates\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.416622 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.416497 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1404334-3914-449b-b1e3-1f77334dcaab-ca-trust-extracted\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.417148 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.417129 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1404334-3914-449b-b1e3-1f77334dcaab-registry-certificates\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.417561 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.417536 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1404334-3914-449b-b1e3-1f77334dcaab-trusted-ca\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.419013 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.418995 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1404334-3914-449b-b1e3-1f77334dcaab-registry-tls\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.419091 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.418999 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1404334-3914-449b-b1e3-1f77334dcaab-image-registry-private-configuration\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.419091 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.419054 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1404334-3914-449b-b1e3-1f77334dcaab-installation-pull-secrets\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.426657 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.426634 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1404334-3914-449b-b1e3-1f77334dcaab-bound-sa-token\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.427506 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.427467 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blz9x\" (UniqueName: \"kubernetes.io/projected/b1404334-3914-449b-b1e3-1f77334dcaab-kube-api-access-blz9x\") pod \"image-registry-6b86bcd54c-j8gxx\" (UID: \"b1404334-3914-449b-b1e3-1f77334dcaab\") " pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:48.436668 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.436625 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-vg4p8" Jul 09 16:51:48.491762 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.491727 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:48.520720 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:48.520698 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:49.632755 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.632717 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-vg4p8"] Jul 09 16:51:49.639195 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:49.639169 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466ffcf6_d687_4473_84e1_116404ca3718.slice/crio-e2e8ca0fffeeea6efb344a6b91d87b7e3da285a0bfbaa94ddf900dc2d4b04409 WatchSource:0}: Error finding container e2e8ca0fffeeea6efb344a6b91d87b7e3da285a0bfbaa94ddf900dc2d4b04409: Status 404 returned error can't find the container with id e2e8ca0fffeeea6efb344a6b91d87b7e3da285a0bfbaa94ddf900dc2d4b04409 Jul 09 16:51:49.671746 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.671233 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b86bcd54c-j8gxx"] Jul 09 16:51:49.682764 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:49.682601 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1404334_3914_449b_b1e3_1f77334dcaab.slice/crio-1474daa1250bb21b7fa919ff1d37eafb74cb732c493a2a7dca56ad1bfad0a787 WatchSource:0}: Error finding container 1474daa1250bb21b7fa919ff1d37eafb74cb732c493a2a7dca56ad1bfad0a787: Status 404 returned error can't find the container with id 1474daa1250bb21b7fa919ff1d37eafb74cb732c493a2a7dca56ad1bfad0a787 Jul 09 16:51:49.978646 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.978607 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" event={"ID":"b1404334-3914-449b-b1e3-1f77334dcaab","Type":"ContainerStarted","Data":"4af50484f14329406859d6a65c853f7e321e13c9fad345ace7daf05492565302"} Jul 09 16:51:49.978814 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.978704 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:51:49.978814 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.978729 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" event={"ID":"b1404334-3914-449b-b1e3-1f77334dcaab","Type":"ContainerStarted","Data":"1474daa1250bb21b7fa919ff1d37eafb74cb732c493a2a7dca56ad1bfad0a787"} Jul 09 16:51:49.980017 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.979986 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-vg4p8" event={"ID":"466ffcf6-d687-4473-84e1-116404ca3718","Type":"ContainerStarted","Data":"e2e8ca0fffeeea6efb344a6b91d87b7e3da285a0bfbaa94ddf900dc2d4b04409"} Jul 09 16:51:49.981738 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.981712 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" event={"ID":"030be92e-4ef0-4a99-a4e8-d5f55803bb62","Type":"ContainerStarted","Data":"232f768affe636f2e3e88edd956e8e39c3261e569c6f9fe57ba94df3574035da"} Jul 09 16:51:49.983979 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.983907 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6vr4n" event={"ID":"d9cac543-ec4f-47b6-be53-f3ac697c99d6","Type":"ContainerStarted","Data":"857b7ec2183d9e5be91dbe0bbdc9b8c860d66c6daf37c87d6db64a9a9f9775e3"} Jul 09 16:51:49.983979 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.983954 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6vr4n" event={"ID":"d9cac543-ec4f-47b6-be53-f3ac697c99d6","Type":"ContainerStarted","Data":"d2f5b6cfea6ea9109e7a5d9a65f3640cfb21479f8e79c9569fab024101708c0e"} Jul 09 16:51:49.984124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.984015 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6vr4n" Jul 09 16:51:49.986059 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.986039 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9bk6q" event={"ID":"71f2e19d-a596-4872-8897-1a911b056109","Type":"ContainerStarted","Data":"fb2b54c241a3d9ad02e25856dbc3181c604925e6188ddea946673ba0396a0309"} Jul 09 16:51:49.987906 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.987882 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" event={"ID":"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8","Type":"ContainerStarted","Data":"8e971f52caff545850414484e8dbc45b73d5a5100cd969ad0bfd91d1e4216663"} Jul 09 16:51:49.987992 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.987928 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" event={"ID":"d133b11d-89b8-4c4b-b78e-ea1d2a9a8da8","Type":"ContainerStarted","Data":"395ab48c799f1a2e3bde49ca2ca2a909ece9fc1dbba90ae01ce56c5555213401"} Jul 09 16:51:49.989588 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.989568 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f7rmt" event={"ID":"1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f","Type":"ContainerStarted","Data":"21b8ad1557ed4ee680c5b874a8af78a2134adb3e5139ef8c0727025b6134c4b6"} Jul 09 16:51:49.991182 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:49.991150 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" event={"ID":"18807929-f09f-43ee-bf4a-280ef5005665","Type":"ContainerStarted","Data":"ae5073557088c747c8d8a359422bbbfa52df522dd61d2ed6eaca50e9ff5205b9"} Jul 09 16:51:50.002357 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.002273 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" podStartSLOduration=2.002262289 podStartE2EDuration="2.002262289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:50.001349187 +0000 UTC m=+79.044124456" watchObservedRunningTime="2026-07-09 16:51:50.002262289 +0000 UTC m=+79.045037532" Jul 09 16:51:50.014637 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.014607 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:50.018871 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.018832 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vzqx2" podStartSLOduration=68.780569009 podStartE2EDuration="1m16.01881944s" totalImagesPullingTime="7.238250431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:50.017876621 +0000 UTC m=+79.060651871" watchObservedRunningTime="2026-07-09 16:51:50.01881944 +0000 UTC m=+79.061594725" Jul 09 16:51:50.040398 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.040332 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-hmngr" podStartSLOduration=68.273734378 podStartE2EDuration="1m15.04031928s" totalImagesPullingTime="6.766584902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:50.039088456 +0000 UTC m=+79.081863707" watchObservedRunningTime="2026-07-09 16:51:50.04031928 +0000 UTC m=+79.083094573" Jul 09 16:51:50.055504 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.055449 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7qbcl" podStartSLOduration=68.761961404 podStartE2EDuration="1m16.055429453s" totalImagesPullingTime="7.293468049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:50.053860761 +0000 UTC m=+79.096636013" watchObservedRunningTime="2026-07-09 16:51:50.055429453 +0000 UTC m=+79.098204704" Jul 09 16:51:50.071349 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.071298 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f7rmt" podStartSLOduration=67.120134286 podStartE2EDuration="1m19.071282058s" totalImagesPullingTime="11.951147772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:50.070787573 +0000 UTC m=+79.113562824" watchObservedRunningTime="2026-07-09 16:51:50.071282058 +0000 UTC m=+79.114057307" Jul 09 16:51:50.087175 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.087121 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6vr4n" podStartSLOduration=33.874324416 podStartE2EDuration="41.08710603s" totalImagesPullingTime="7.212781614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:50.086028529 +0000 UTC m=+79.128803781" watchObservedRunningTime="2026-07-09 16:51:50.08710603 +0000 UTC m=+79.129881280" Jul 09 16:51:50.177912 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.177881 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pbzjm"] Jul 09 16:51:50.182734 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.182710 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pbzjm" Jul 09 16:51:50.185085 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.185061 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4gc6z\"" Jul 09 16:51:50.185391 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.185355 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 16:51:50.190766 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.190735 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pbzjm"] Jul 09 16:51:50.239344 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.239315 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7fa4694e-d6bc-4237-8abd-43b4634bbe4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-pbzjm\" (UID: \"7fa4694e-d6bc-4237-8abd-43b4634bbe4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pbzjm" Jul 09 16:51:50.339758 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.339685 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7fa4694e-d6bc-4237-8abd-43b4634bbe4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-pbzjm\" (UID: \"7fa4694e-d6bc-4237-8abd-43b4634bbe4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pbzjm" Jul 09 16:51:50.339880 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:50.339838 2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 09 16:51:50.340201 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:50.339910 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fa4694e-d6bc-4237-8abd-43b4634bbe4a-tls-certificates podName:7fa4694e-d6bc-4237-8abd-43b4634bbe4a nodeName:}" failed. No retries permitted until 2026-07-09 16:51:50.83989388 +0000 UTC m=+79.882669108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7fa4694e-d6bc-4237-8abd-43b4634bbe4a-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-pbzjm" (UID: "7fa4694e-d6bc-4237-8abd-43b4634bbe4a") : secret "prometheus-operator-admission-webhook-tls" not found Jul 09 16:51:50.844278 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.844243 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7fa4694e-d6bc-4237-8abd-43b4634bbe4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-pbzjm\" (UID: \"7fa4694e-d6bc-4237-8abd-43b4634bbe4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pbzjm" Jul 09 16:51:50.846596 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:50.846574 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7fa4694e-d6bc-4237-8abd-43b4634bbe4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-pbzjm\" (UID: \"7fa4694e-d6bc-4237-8abd-43b4634bbe4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pbzjm" Jul 09 16:51:51.094524 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.094452 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pbzjm" Jul 09 16:51:51.253818 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.253792 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pbzjm"] Jul 09 16:51:51.255859 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:51.255829 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa4694e_d6bc_4237_8abd_43b4634bbe4a.slice/crio-9d649b6828d75a886cc0cf9e271406ddf467538e51d611a67ec03257b6a6a07c WatchSource:0}: Error finding container 9d649b6828d75a886cc0cf9e271406ddf467538e51d611a67ec03257b6a6a07c: Status 404 returned error can't find the container with id 9d649b6828d75a886cc0cf9e271406ddf467538e51d611a67ec03257b6a6a07c Jul 09 16:51:51.405625 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.405590 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:51.459615 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.459578 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:51.867471 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.867392 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-545d474cdc-svhrd"] Jul 09 16:51:51.890415 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.890388 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-545d474cdc-svhrd"] Jul 09 16:51:51.890557 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.890467 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:51.893438 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.893409 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 16:51:51.893438 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.893428 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 16:51:51.894663 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.894640 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 16:51:51.894789 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.894697 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 16:51:51.894904 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.894885 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 16:51:51.894965 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.894909 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tnbw7\"" Jul 09 16:51:51.956199 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.956162 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-serving-cert\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:51.956349 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.956266 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56czc\" (UniqueName: \"kubernetes.io/projected/81713a97-06a5-42c9-8fb2-8f78bd827d92-kube-api-access-56czc\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:51.956349 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.956315 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-config\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:51.956488 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.956351 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-oauth-serving-cert\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:51.956488 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.956403 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-service-ca\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:51.956488 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:51.956446 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-oauth-config\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:52.002066 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.001999 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pbzjm" event={"ID":"7fa4694e-d6bc-4237-8abd-43b4634bbe4a","Type":"ContainerStarted","Data":"9d649b6828d75a886cc0cf9e271406ddf467538e51d611a67ec03257b6a6a07c"} Jul 09 16:51:52.057834 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.057802 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-config\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:52.057984 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.057855 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-oauth-serving-cert\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:52.058031 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.058001 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-service-ca\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:52.058080 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.058059 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-oauth-config\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:52.058146 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.058123 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-serving-cert\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:52.058539 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.058195 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56czc\" (UniqueName: \"kubernetes.io/projected/81713a97-06a5-42c9-8fb2-8f78bd827d92-kube-api-access-56czc\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:52.058665 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.058591 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-oauth-serving-cert\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:52.058997 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.058971 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-service-ca\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:52.059109 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.059022 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-config\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:52.061324 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.061305 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-oauth-config\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:52.061434 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.061413 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-serving-cert\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:52.066536 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.066514 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56czc\" (UniqueName: \"kubernetes.io/projected/81713a97-06a5-42c9-8fb2-8f78bd827d92-kube-api-access-56czc\") pod \"console-545d474cdc-svhrd\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:52.203090 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.203006 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:51:52.672872 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:52.672849 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-545d474cdc-svhrd"] Jul 09 16:51:52.731811 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:52.731776 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81713a97_06a5_42c9_8fb2_8f78bd827d92.slice/crio-e52144bf29ee198444608f8d2581bac9e430f9bd5beb60280915fd9d112995d4 WatchSource:0}: Error finding container e52144bf29ee198444608f8d2581bac9e430f9bd5beb60280915fd9d112995d4: Status 404 returned error can't find the container with id e52144bf29ee198444608f8d2581bac9e430f9bd5beb60280915fd9d112995d4 Jul 09 16:51:53.007517 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.007485 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pbzjm" event={"ID":"7fa4694e-d6bc-4237-8abd-43b4634bbe4a","Type":"ContainerStarted","Data":"7dc9c62542be394869ad4e0700c27f4c648c795c0a5549d55cf07d633a468fb6"} Jul 09 16:51:53.007988 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.007825 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pbzjm" Jul 09 16:51:53.009663 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.009636 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9bk6q" event={"ID":"71f2e19d-a596-4872-8897-1a911b056109","Type":"ContainerStarted","Data":"9d1d20bca5525125e442402b5ce57a039024cc3271da7f86fec59833f38de3b1"} Jul 09 16:51:53.010961 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.010938 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545d474cdc-svhrd" event={"ID":"81713a97-06a5-42c9-8fb2-8f78bd827d92","Type":"ContainerStarted","Data":"e52144bf29ee198444608f8d2581bac9e430f9bd5beb60280915fd9d112995d4"} Jul 09 16:51:53.012691 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.012670 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pbzjm" Jul 09 16:51:53.023955 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.023883 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pbzjm" podStartSLOduration=1.5302568189999999 podStartE2EDuration="3.023868247s" totalImagesPullingTime="1.493611428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:53.022559216 +0000 UTC m=+82.065334467" watchObservedRunningTime="2026-07-09 16:51:53.023868247 +0000 UTC m=+82.066643751" Jul 09 16:51:53.228558 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.228520 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-rzlf9"] Jul 09 16:51:53.239330 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.239298 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:53.239521 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.239503 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-rzlf9"] Jul 09 16:51:53.242450 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.242360 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 16:51:53.249350 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.242786 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 16:51:53.249350 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.243092 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 16:51:53.249350 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.243333 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7jwtf\"" Jul 09 16:51:53.370676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.370594 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-rzlf9\" (UID: \"2f2bc738-82ea-40ba-bb67-05944b7b7fd0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:53.370676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.370671 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-rzlf9\" (UID: \"2f2bc738-82ea-40ba-bb67-05944b7b7fd0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:53.370856 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.370714 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-metrics-client-ca\") pod \"prometheus-operator-64785b6675-rzlf9\" (UID: \"2f2bc738-82ea-40ba-bb67-05944b7b7fd0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:53.370856 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.370753 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxxsg\" (UniqueName: \"kubernetes.io/projected/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-kube-api-access-hxxsg\") pod \"prometheus-operator-64785b6675-rzlf9\" (UID: \"2f2bc738-82ea-40ba-bb67-05944b7b7fd0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:53.472048 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.472015 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-rzlf9\" (UID: \"2f2bc738-82ea-40ba-bb67-05944b7b7fd0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:53.472210 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.472087 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-rzlf9\" (UID: \"2f2bc738-82ea-40ba-bb67-05944b7b7fd0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:53.472210 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.472132 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-metrics-client-ca\") pod \"prometheus-operator-64785b6675-rzlf9\" (UID: \"2f2bc738-82ea-40ba-bb67-05944b7b7fd0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:53.472210 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.472167 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxxsg\" (UniqueName: \"kubernetes.io/projected/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-kube-api-access-hxxsg\") pod \"prometheus-operator-64785b6675-rzlf9\" (UID: \"2f2bc738-82ea-40ba-bb67-05944b7b7fd0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:53.472210 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:53.472178 2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 09 16:51:53.472456 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:53.472311 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-prometheus-operator-tls podName:2f2bc738-82ea-40ba-bb67-05944b7b7fd0 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:53.972288213 +0000 UTC m=+83.015063442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-prometheus-operator-tls") pod "prometheus-operator-64785b6675-rzlf9" (UID: "2f2bc738-82ea-40ba-bb67-05944b7b7fd0") : secret "prometheus-operator-tls" not found Jul 09 16:51:53.473319 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.473269 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-metrics-client-ca\") pod \"prometheus-operator-64785b6675-rzlf9\" (UID: \"2f2bc738-82ea-40ba-bb67-05944b7b7fd0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:53.477106 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.477058 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-rzlf9\" (UID: \"2f2bc738-82ea-40ba-bb67-05944b7b7fd0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:53.501980 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.501951 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxxsg\" (UniqueName: \"kubernetes.io/projected/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-kube-api-access-hxxsg\") pod \"prometheus-operator-64785b6675-rzlf9\" (UID: \"2f2bc738-82ea-40ba-bb67-05944b7b7fd0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:53.643790 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.643736 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:53.701654 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.701617 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:53.805639 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.805605 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:53.977289 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:53.976703 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-rzlf9\" (UID: \"2f2bc738-82ea-40ba-bb67-05944b7b7fd0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:53.977289 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:53.976844 2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 09 16:51:53.977289 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:51:53.976912 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-prometheus-operator-tls podName:2f2bc738-82ea-40ba-bb67-05944b7b7fd0 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:54.976892893 +0000 UTC m=+84.019668125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-prometheus-operator-tls") pod "prometheus-operator-64785b6675-rzlf9" (UID: "2f2bc738-82ea-40ba-bb67-05944b7b7fd0") : secret "prometheus-operator-tls" not found Jul 09 16:51:54.242344 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:54.242266 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:54.384582 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:54.384534 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:54.486298 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:54.486251 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:54.985381 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:54.985324 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-rzlf9\" (UID: \"2f2bc738-82ea-40ba-bb67-05944b7b7fd0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:54.997182 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:54.997145 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f2bc738-82ea-40ba-bb67-05944b7b7fd0-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-rzlf9\" (UID: \"2f2bc738-82ea-40ba-bb67-05944b7b7fd0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:55.056911 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:55.056876 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" Jul 09 16:51:57.907159 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:57.907081 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-rzlf9"] Jul 09 16:51:57.911074 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:51:57.911044 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2bc738_82ea_40ba_bb67_05944b7b7fd0.slice/crio-0b2eccbbfba36be7fb608ccb80f03e6f73a14937e564c063c9f10c084a3ceff4 WatchSource:0}: Error finding container 0b2eccbbfba36be7fb608ccb80f03e6f73a14937e564c063c9f10c084a3ceff4: Status 404 returned error can't find the container with id 0b2eccbbfba36be7fb608ccb80f03e6f73a14937e564c063c9f10c084a3ceff4 Jul 09 16:51:58.039610 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:58.039083 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545d474cdc-svhrd" event={"ID":"81713a97-06a5-42c9-8fb2-8f78bd827d92","Type":"ContainerStarted","Data":"8689bee5f5a09963b58e310f47d80fd84c4e925d60921e46caa0a182c075930b"} Jul 09 16:51:58.041618 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:58.041582 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9bk6q" event={"ID":"71f2e19d-a596-4872-8897-1a911b056109","Type":"ContainerStarted","Data":"748b0b99637b73aeffff80c5a593ee9f30baefbc1d8daecab79cde1f2574e75c"} Jul 09 16:51:58.042901 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:58.042873 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" event={"ID":"2f2bc738-82ea-40ba-bb67-05944b7b7fd0","Type":"ContainerStarted","Data":"0b2eccbbfba36be7fb608ccb80f03e6f73a14937e564c063c9f10c084a3ceff4"} Jul 09 16:51:58.056953 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:58.056813 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-545d474cdc-svhrd" podStartSLOduration=2.032605122 podStartE2EDuration="7.0567947s" totalImagesPullingTime="5.024189578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:58.056188961 +0000 UTC m=+87.098964210" watchObservedRunningTime="2026-07-09 16:51:58.0567947 +0000 UTC m=+87.099569950" Jul 09 16:51:58.074357 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:58.074308 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9bk6q" podStartSLOduration=16.924098038 podStartE2EDuration="32.074289889s" totalImagesPullingTime="15.150191851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:58.072248347 +0000 UTC m=+87.115023598" watchObservedRunningTime="2026-07-09 16:51:58.074289889 +0000 UTC m=+87.117065140" Jul 09 16:51:58.088938 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:58.088876 2554 patch_prober.go:28] interesting pod/image-registry-77f7495649-j27jg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 16:51:58.088938 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:58.088920 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77f7495649-j27jg" podUID="670a601a-9ac1-493f-86c2-035f818f910a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 16:51:58.396010 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:58.395977 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:59.070599 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:59.070562 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:59.171880 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:59.171844 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:59.998112 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:51:59.998078 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6vr4n" Jul 09 16:52:01.046477 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:01.046434 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:01.064788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:01.064756 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" event={"ID":"2f2bc738-82ea-40ba-bb67-05944b7b7fd0","Type":"ContainerStarted","Data":"50d3f7bbf82c738924ba19358a0024fa7e8a3d04499adaa5eac93a70c7a252f3"} Jul 09 16:52:01.064939 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:01.064808 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" event={"ID":"2f2bc738-82ea-40ba-bb67-05944b7b7fd0","Type":"ContainerStarted","Data":"b377f00886a46050c19885046810b4b13162efc1d783d0911463db8c0a3ca58e"} Jul 09 16:52:01.082735 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:01.082683 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-rzlf9" podStartSLOduration=5.281833584 podStartE2EDuration="8.082662985s" totalImagesPullingTime="2.800829401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:01.080265733 +0000 UTC m=+90.123041002" watchObservedRunningTime="2026-07-09 16:52:01.082662985 +0000 UTC m=+90.125438236" Jul 09 16:52:02.193356 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.193301 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:02.203999 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.203976 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:52:02.204135 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.204035 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:52:02.205676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.205652 2554 patch_prober.go:28] interesting pod/console-545d474cdc-svhrd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.28:8443/health\": dial tcp 10.132.0.28:8443: connect: connection refused" start-of-body= Jul 09 16:52:02.205787 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.205704 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-545d474cdc-svhrd" podUID="81713a97-06a5-42c9-8fb2-8f78bd827d92" containerName="console" probeResult="failure" output="Get \"https://10.132.0.28:8443/health\": dial tcp 10.132.0.28:8443: connect: connection refused" Jul 09 16:52:02.302922 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.302886 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:02.395353 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.395297 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:02.661610 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.661576 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8kqb9"] Jul 09 16:52:02.665774 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.665751 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.672259 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.671809 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q92qp\"" Jul 09 16:52:02.672259 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.671833 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 16:52:02.672259 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.672024 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 16:52:02.672259 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.672109 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 16:52:02.760027 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.759986 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.760182 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.760038 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-tls\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.760182 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.760070 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-wtmp\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.760182 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.760093 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.760182 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.760130 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-textfile\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.760182 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.760163 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27488284-4e29-46cc-93d9-631a2ddcac16-root\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.760494 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.760183 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-468vn\" (UniqueName: \"kubernetes.io/projected/27488284-4e29-46cc-93d9-631a2ddcac16-kube-api-access-468vn\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.760494 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.760230 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27488284-4e29-46cc-93d9-631a2ddcac16-metrics-client-ca\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.760494 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.760295 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27488284-4e29-46cc-93d9-631a2ddcac16-sys\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.861268 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.861234 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-tls\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.861447 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.861286 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-wtmp\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.861447 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.861314 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.861447 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.861351 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-textfile\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.861447 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.861399 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27488284-4e29-46cc-93d9-631a2ddcac16-root\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.861447 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.861421 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-468vn\" (UniqueName: \"kubernetes.io/projected/27488284-4e29-46cc-93d9-631a2ddcac16-kube-api-access-468vn\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.861709 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.861463 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27488284-4e29-46cc-93d9-631a2ddcac16-metrics-client-ca\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.861709 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.861518 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27488284-4e29-46cc-93d9-631a2ddcac16-sys\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.861709 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.861531 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-wtmp\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.861709 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.861558 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.861709 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.861532 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27488284-4e29-46cc-93d9-631a2ddcac16-root\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.861950 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.861860 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-textfile\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.861950 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.861928 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27488284-4e29-46cc-93d9-631a2ddcac16-sys\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.862585 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.862293 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.862585 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.862547 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27488284-4e29-46cc-93d9-631a2ddcac16-metrics-client-ca\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.864421 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.864401 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-tls\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.865332 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.865313 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27488284-4e29-46cc-93d9-631a2ddcac16-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.877607 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.877587 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-468vn\" (UniqueName: \"kubernetes.io/projected/27488284-4e29-46cc-93d9-631a2ddcac16-kube-api-access-468vn\") pod \"node-exporter-8kqb9\" (UID: \"27488284-4e29-46cc-93d9-631a2ddcac16\") " pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:02.995480 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:02.995404 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8kqb9" Jul 09 16:52:03.339196 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:03.339047 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:04.505976 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:04.505929 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:04.586048 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:04.586012 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:05.509918 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:05.509870 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:05.568423 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:05.568393 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:06.140164 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:06.140123 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:06.204035 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:06.203994 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:06.896640 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:06.896591 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:06.954068 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:06.954033 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:07.351687 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:07.351590 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:07.370978 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:07.370941 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-545d474cdc-svhrd"] Jul 09 16:52:07.436239 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:07.436200 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:07.979046 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:07.979013 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:08.087490 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:08.087460 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:52:08.091859 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:08.091826 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:08.162569 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:08.162516 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:08.256669 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:08.256551 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:08.313676 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:08.313637 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:08.790350 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:08.790070 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:09.121446 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:52:09.121417 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27488284_4e29_46cc_93d9_631a2ddcac16.slice/crio-932a0a8d1f72d2052334f8d61cc12a70b737bff5291bdb5f7e1bac2b8d11318a WatchSource:0}: Error finding container 932a0a8d1f72d2052334f8d61cc12a70b737bff5291bdb5f7e1bac2b8d11318a: Status 404 returned error can't find the container with id 932a0a8d1f72d2052334f8d61cc12a70b737bff5291bdb5f7e1bac2b8d11318a Jul 09 16:52:09.858079 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:09.857999 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4dn5j" Jul 09 16:52:10.112641 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:10.112293 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-vg4p8" event={"ID":"466ffcf6-d687-4473-84e1-116404ca3718","Type":"ContainerStarted","Data":"9496cfdfab3a28ed018ff2f2098d548b43817c0a35e532d4bad5de49d18727d6"} Jul 09 16:52:10.113052 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:10.112995 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-vg4p8" Jul 09 16:52:10.115324 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:10.115271 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kqb9" event={"ID":"27488284-4e29-46cc-93d9-631a2ddcac16","Type":"ContainerStarted","Data":"932a0a8d1f72d2052334f8d61cc12a70b737bff5291bdb5f7e1bac2b8d11318a"} Jul 09 16:52:10.135723 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:10.135698 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-vg4p8" Jul 09 16:52:10.154624 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:10.154577 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-vg4p8" podStartSLOduration=2.339294248 podStartE2EDuration="22.15455876s" totalImagesPullingTime="19.815264512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:10.135479499 +0000 UTC m=+99.178254750" watchObservedRunningTime="2026-07-09 16:52:10.15455876 +0000 UTC m=+99.197334014" Jul 09 16:52:11.001194 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:11.001166 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b86bcd54c-j8gxx" Jul 09 16:52:11.122751 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:11.122678 2554 generic.go:356] "Generic (PLEG): container finished" podID="27488284-4e29-46cc-93d9-631a2ddcac16" containerID="538489a01aef2d82e3d4826be3978e203e1a62b3e3aa5fb1123e80af767a443d" exitCode=0 Jul 09 16:52:11.123357 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:11.123333 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kqb9" event={"ID":"27488284-4e29-46cc-93d9-631a2ddcac16","Type":"ContainerDied","Data":"538489a01aef2d82e3d4826be3978e203e1a62b3e3aa5fb1123e80af767a443d"} Jul 09 16:52:11.129560 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:11.129533 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:11.212309 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:11.212274 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:11.928882 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:11.928840 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:11.985293 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:11.985255 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:12.131141 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:12.131106 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kqb9" event={"ID":"27488284-4e29-46cc-93d9-631a2ddcac16","Type":"ContainerStarted","Data":"6eab65052b2a0fb602acec46272388adb14c67d4d27f5c34f09dc9e220052af7"} Jul 09 16:52:12.131325 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:12.131213 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kqb9" event={"ID":"27488284-4e29-46cc-93d9-631a2ddcac16","Type":"ContainerStarted","Data":"07eb6878b168123e55b8378967e0c776927470176278e16e6081d0ef497989aa"} Jul 09 16:52:12.153802 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:12.153744 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8kqb9" podStartSLOduration=8.627366784 podStartE2EDuration="10.15372634s" totalImagesPullingTime="1.418787829s" totalInitContainerRuntime="107.571727ms" isStatefulPod=true podCreationTimestamp="2026-07-09 16:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:12.151838166 +0000 UTC m=+101.194613429" watchObservedRunningTime="2026-07-09 16:52:12.15372634 +0000 UTC m=+101.196501590" Jul 09 16:52:13.110843 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.110800 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77f7495649-j27jg" podUID="670a601a-9ac1-493f-86c2-035f818f910a" containerName="registry" containerID="cri-o://bafb16bcb3d913c8fca507b278bc746236a8ddc7d834081f82d17bc1fa3e02c0" gracePeriod=30 Jul 09 16:52:13.435378 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.435343 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:52:13.569740 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.569679 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/670a601a-9ac1-493f-86c2-035f818f910a-installation-pull-secrets\") pod \"670a601a-9ac1-493f-86c2-035f818f910a\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " Jul 09 16:52:13.569906 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.569820 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/670a601a-9ac1-493f-86c2-035f818f910a-image-registry-private-configuration\") pod \"670a601a-9ac1-493f-86c2-035f818f910a\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " Jul 09 16:52:13.569906 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.569865 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/670a601a-9ac1-493f-86c2-035f818f910a-ca-trust-extracted\") pod \"670a601a-9ac1-493f-86c2-035f818f910a\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " Jul 09 16:52:13.569906 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.569894 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-bound-sa-token\") pod \"670a601a-9ac1-493f-86c2-035f818f910a\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " Jul 09 16:52:13.570069 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.569920 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls\") pod \"670a601a-9ac1-493f-86c2-035f818f910a\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " Jul 09 16:52:13.570069 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.569959 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/670a601a-9ac1-493f-86c2-035f818f910a-registry-certificates\") pod \"670a601a-9ac1-493f-86c2-035f818f910a\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " Jul 09 16:52:13.570069 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.569997 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-454mw\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-kube-api-access-454mw\") pod \"670a601a-9ac1-493f-86c2-035f818f910a\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " Jul 09 16:52:13.570069 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.570041 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/670a601a-9ac1-493f-86c2-035f818f910a-trusted-ca\") pod \"670a601a-9ac1-493f-86c2-035f818f910a\" (UID: \"670a601a-9ac1-493f-86c2-035f818f910a\") " Jul 09 16:52:13.570703 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.570674 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/670a601a-9ac1-493f-86c2-035f818f910a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "670a601a-9ac1-493f-86c2-035f818f910a" (UID: "670a601a-9ac1-493f-86c2-035f818f910a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:52:13.571758 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.571687 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/670a601a-9ac1-493f-86c2-035f818f910a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "670a601a-9ac1-493f-86c2-035f818f910a" (UID: "670a601a-9ac1-493f-86c2-035f818f910a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:52:13.573318 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.573187 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/670a601a-9ac1-493f-86c2-035f818f910a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "670a601a-9ac1-493f-86c2-035f818f910a" (UID: "670a601a-9ac1-493f-86c2-035f818f910a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:52:13.573474 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.573432 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/670a601a-9ac1-493f-86c2-035f818f910a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "670a601a-9ac1-493f-86c2-035f818f910a" (UID: "670a601a-9ac1-493f-86c2-035f818f910a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:52:13.573776 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.573697 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "670a601a-9ac1-493f-86c2-035f818f910a" (UID: "670a601a-9ac1-493f-86c2-035f818f910a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:52:13.574044 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.574018 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-kube-api-access-454mw" (OuterVolumeSpecName: "kube-api-access-454mw") pod "670a601a-9ac1-493f-86c2-035f818f910a" (UID: "670a601a-9ac1-493f-86c2-035f818f910a"). InnerVolumeSpecName "kube-api-access-454mw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:52:13.576650 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.576626 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "670a601a-9ac1-493f-86c2-035f818f910a" (UID: "670a601a-9ac1-493f-86c2-035f818f910a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:52:13.581591 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.581514 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/670a601a-9ac1-493f-86c2-035f818f910a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "670a601a-9ac1-493f-86c2-035f818f910a" (UID: "670a601a-9ac1-493f-86c2-035f818f910a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:52:13.671292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.671217 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-454mw\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-kube-api-access-454mw\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:52:13.671292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.671251 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/670a601a-9ac1-493f-86c2-035f818f910a-trusted-ca\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:52:13.671292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.671263 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/670a601a-9ac1-493f-86c2-035f818f910a-installation-pull-secrets\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:52:13.671292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.671277 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/670a601a-9ac1-493f-86c2-035f818f910a-image-registry-private-configuration\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:52:13.671292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.671292 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/670a601a-9ac1-493f-86c2-035f818f910a-ca-trust-extracted\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:52:13.671684 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.671306 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-bound-sa-token\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:52:13.671684 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.671319 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/670a601a-9ac1-493f-86c2-035f818f910a-registry-tls\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:52:13.671684 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:13.671330 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/670a601a-9ac1-493f-86c2-035f818f910a-registry-certificates\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:52:14.130887 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:14.130854 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:14.142441 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:14.142406 2554 generic.go:356] "Generic (PLEG): container finished" podID="670a601a-9ac1-493f-86c2-035f818f910a" containerID="bafb16bcb3d913c8fca507b278bc746236a8ddc7d834081f82d17bc1fa3e02c0" exitCode=0 Jul 09 16:52:14.142596 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:14.142460 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77f7495649-j27jg" Jul 09 16:52:14.142596 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:14.142502 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77f7495649-j27jg" event={"ID":"670a601a-9ac1-493f-86c2-035f818f910a","Type":"ContainerDied","Data":"bafb16bcb3d913c8fca507b278bc746236a8ddc7d834081f82d17bc1fa3e02c0"} Jul 09 16:52:14.142596 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:14.142579 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77f7495649-j27jg" event={"ID":"670a601a-9ac1-493f-86c2-035f818f910a","Type":"ContainerDied","Data":"0106dcb0e88c01cb140c7e4ba6cfcaf9e515ee84a39c442a04eb7adda906f89c"} Jul 09 16:52:14.142728 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:14.142617 2554 scope.go:117] "RemoveContainer" containerID="bafb16bcb3d913c8fca507b278bc746236a8ddc7d834081f82d17bc1fa3e02c0" Jul 09 16:52:14.153760 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:14.153741 2554 scope.go:117] "RemoveContainer" containerID="bafb16bcb3d913c8fca507b278bc746236a8ddc7d834081f82d17bc1fa3e02c0" Jul 09 16:52:14.154109 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:52:14.154080 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bafb16bcb3d913c8fca507b278bc746236a8ddc7d834081f82d17bc1fa3e02c0\": container with ID starting with bafb16bcb3d913c8fca507b278bc746236a8ddc7d834081f82d17bc1fa3e02c0 not found: ID does not exist" containerID="bafb16bcb3d913c8fca507b278bc746236a8ddc7d834081f82d17bc1fa3e02c0" Jul 09 16:52:14.154213 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:14.154119 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bafb16bcb3d913c8fca507b278bc746236a8ddc7d834081f82d17bc1fa3e02c0"} err="failed to get container status \"bafb16bcb3d913c8fca507b278bc746236a8ddc7d834081f82d17bc1fa3e02c0\": rpc error: code = NotFound desc = could not find container \"bafb16bcb3d913c8fca507b278bc746236a8ddc7d834081f82d17bc1fa3e02c0\": container with ID starting with bafb16bcb3d913c8fca507b278bc746236a8ddc7d834081f82d17bc1fa3e02c0 not found: ID does not exist" Jul 09 16:52:14.168379 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:14.168336 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77f7495649-j27jg"] Jul 09 16:52:14.171281 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:14.171260 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77f7495649-j27jg"] Jul 09 16:52:14.196403 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:14.196352 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:15.547920 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:15.547887 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="670a601a-9ac1-493f-86c2-035f818f910a" path="/var/lib/kubelet/pods/670a601a-9ac1-493f-86c2-035f818f910a/volumes" Jul 09 16:52:15.627031 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:15.626987 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:15.726846 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:15.726747 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:17.317609 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.317575 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dd4d7667b-mtlbk"] Jul 09 16:52:17.318606 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.318578 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="670a601a-9ac1-493f-86c2-035f818f910a" containerName="registry" Jul 09 16:52:17.318754 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.318736 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="670a601a-9ac1-493f-86c2-035f818f910a" containerName="registry" Jul 09 16:52:17.318880 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.318866 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="670a601a-9ac1-493f-86c2-035f818f910a" containerName="registry" Jul 09 16:52:17.415814 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.415776 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd4d7667b-mtlbk"] Jul 09 16:52:17.415814 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.415813 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.425579 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.425556 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 16:52:17.500795 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.500758 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-console-config\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.500980 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.500801 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-service-ca\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.500980 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.500831 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-oauth-serving-cert\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.500980 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.500940 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmdm9\" (UniqueName: \"kubernetes.io/projected/11932672-faba-48f2-8d1e-89205a0acf83-kube-api-access-tmdm9\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.501129 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.500991 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-trusted-ca-bundle\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.501129 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.501080 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11932672-faba-48f2-8d1e-89205a0acf83-console-oauth-config\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.501210 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.501133 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11932672-faba-48f2-8d1e-89205a0acf83-console-serving-cert\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.601648 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.601572 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-console-config\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.601648 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.601625 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-service-ca\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.601884 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.601662 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-oauth-serving-cert\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.601884 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.601707 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmdm9\" (UniqueName: \"kubernetes.io/projected/11932672-faba-48f2-8d1e-89205a0acf83-kube-api-access-tmdm9\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.601884 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.601753 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-trusted-ca-bundle\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.601884 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.601803 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11932672-faba-48f2-8d1e-89205a0acf83-console-oauth-config\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.601884 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.601851 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11932672-faba-48f2-8d1e-89205a0acf83-console-serving-cert\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.602411 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.602378 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-console-config\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.603094 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.603063 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-oauth-serving-cert\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.603222 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.603190 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-trusted-ca-bundle\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.603527 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.603503 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-service-ca\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.604652 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.604628 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11932672-faba-48f2-8d1e-89205a0acf83-console-serving-cert\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.604951 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.604932 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11932672-faba-48f2-8d1e-89205a0acf83-console-oauth-config\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.611566 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.611544 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmdm9\" (UniqueName: \"kubernetes.io/projected/11932672-faba-48f2-8d1e-89205a0acf83-kube-api-access-tmdm9\") pod \"console-7dd4d7667b-mtlbk\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.728149 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.728117 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:17.913881 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:17.913850 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd4d7667b-mtlbk"] Jul 09 16:52:17.917527 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:52:17.917496 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11932672_faba_48f2_8d1e_89205a0acf83.slice/crio-fad013ad02d30a29cc0b54d499a1dc99aeab4fdddd5319ec16a5e9f370e9efd6 WatchSource:0}: Error finding container fad013ad02d30a29cc0b54d499a1dc99aeab4fdddd5319ec16a5e9f370e9efd6: Status 404 returned error can't find the container with id fad013ad02d30a29cc0b54d499a1dc99aeab4fdddd5319ec16a5e9f370e9efd6 Jul 09 16:52:18.140508 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:18.140470 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:18.167681 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:18.167603 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd4d7667b-mtlbk" event={"ID":"11932672-faba-48f2-8d1e-89205a0acf83","Type":"ContainerStarted","Data":"cb65128f28409020a8452285d5721497d0de7a188a4b744ccfde3dde898f1344"} Jul 09 16:52:18.167681 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:18.167651 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd4d7667b-mtlbk" event={"ID":"11932672-faba-48f2-8d1e-89205a0acf83","Type":"ContainerStarted","Data":"fad013ad02d30a29cc0b54d499a1dc99aeab4fdddd5319ec16a5e9f370e9efd6"} Jul 09 16:52:18.191933 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:18.191877 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dd4d7667b-mtlbk" podStartSLOduration=1.191856054 podStartE2EDuration="1.191856054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:18.189218613 +0000 UTC m=+107.231993887" watchObservedRunningTime="2026-07-09 16:52:18.191856054 +0000 UTC m=+107.234631304" Jul 09 16:52:18.240168 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:18.240138 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:20.462263 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:20.462222 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:20.515522 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:20.515484 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:22.172223 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:22.172184 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:22.230646 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:22.230615 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:27.134276 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:27.134236 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:27.238624 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:27.238589 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:27.728274 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:27.728243 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:27.728501 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:27.728303 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:27.733501 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:27.733477 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:28.214144 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:28.214117 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:52:28.372894 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:28.372852 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:28.470077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:28.470003 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:28.570796 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:28.570739 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:28.633530 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:28.633495 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:30.402085 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:30.402041 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" podUID="fd1f503d-7acd-472b-ba6f-d528fd1b2830" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 09 16:52:32.400531 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.400488 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-545d474cdc-svhrd" podUID="81713a97-06a5-42c9-8fb2-8f78bd827d92" containerName="console" containerID="cri-o://8689bee5f5a09963b58e310f47d80fd84c4e925d60921e46caa0a182c075930b" gracePeriod=15 Jul 09 16:52:32.685946 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.685916 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:52:32.732622 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.732583 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-service-ca\") pod \"81713a97-06a5-42c9-8fb2-8f78bd827d92\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " Jul 09 16:52:32.732622 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.732622 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56czc\" (UniqueName: \"kubernetes.io/projected/81713a97-06a5-42c9-8fb2-8f78bd827d92-kube-api-access-56czc\") pod \"81713a97-06a5-42c9-8fb2-8f78bd827d92\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " Jul 09 16:52:32.732842 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.732679 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-config\") pod \"81713a97-06a5-42c9-8fb2-8f78bd827d92\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " Jul 09 16:52:32.732842 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.732708 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-oauth-serving-cert\") pod \"81713a97-06a5-42c9-8fb2-8f78bd827d92\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " Jul 09 16:52:32.732953 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.732871 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-oauth-config\") pod \"81713a97-06a5-42c9-8fb2-8f78bd827d92\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " Jul 09 16:52:32.732953 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.732919 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-serving-cert\") pod \"81713a97-06a5-42c9-8fb2-8f78bd827d92\" (UID: \"81713a97-06a5-42c9-8fb2-8f78bd827d92\") " Jul 09 16:52:32.733114 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.733011 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-service-ca" (OuterVolumeSpecName: "service-ca") pod "81713a97-06a5-42c9-8fb2-8f78bd827d92" (UID: "81713a97-06a5-42c9-8fb2-8f78bd827d92"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:52:32.733167 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.733133 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "81713a97-06a5-42c9-8fb2-8f78bd827d92" (UID: "81713a97-06a5-42c9-8fb2-8f78bd827d92"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:52:32.733218 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.733132 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-config" (OuterVolumeSpecName: "console-config") pod "81713a97-06a5-42c9-8fb2-8f78bd827d92" (UID: "81713a97-06a5-42c9-8fb2-8f78bd827d92"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:52:32.733267 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.733254 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-service-ca\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:52:32.733318 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.733276 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-config\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:52:32.733318 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.733291 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81713a97-06a5-42c9-8fb2-8f78bd827d92-oauth-serving-cert\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:52:32.735065 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.735041 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "81713a97-06a5-42c9-8fb2-8f78bd827d92" (UID: "81713a97-06a5-42c9-8fb2-8f78bd827d92"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:52:32.735316 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.735296 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81713a97-06a5-42c9-8fb2-8f78bd827d92-kube-api-access-56czc" (OuterVolumeSpecName: "kube-api-access-56czc") pod "81713a97-06a5-42c9-8fb2-8f78bd827d92" (UID: "81713a97-06a5-42c9-8fb2-8f78bd827d92"). InnerVolumeSpecName "kube-api-access-56czc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:52:32.735316 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.735303 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "81713a97-06a5-42c9-8fb2-8f78bd827d92" (UID: "81713a97-06a5-42c9-8fb2-8f78bd827d92"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:52:32.834019 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.833984 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-oauth-config\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:52:32.834019 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.834012 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81713a97-06a5-42c9-8fb2-8f78bd827d92-console-serving-cert\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:52:32.834019 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:32.834021 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56czc\" (UniqueName: \"kubernetes.io/projected/81713a97-06a5-42c9-8fb2-8f78bd827d92-kube-api-access-56czc\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:52:33.236440 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:33.234796 2554 generic.go:356] "Generic (PLEG): container finished" podID="81713a97-06a5-42c9-8fb2-8f78bd827d92" containerID="8689bee5f5a09963b58e310f47d80fd84c4e925d60921e46caa0a182c075930b" exitCode=0 Jul 09 16:52:33.236440 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:33.234892 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545d474cdc-svhrd" event={"ID":"81713a97-06a5-42c9-8fb2-8f78bd827d92","Type":"ContainerDied","Data":"8689bee5f5a09963b58e310f47d80fd84c4e925d60921e46caa0a182c075930b"} Jul 09 16:52:33.236440 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:33.234979 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545d474cdc-svhrd" event={"ID":"81713a97-06a5-42c9-8fb2-8f78bd827d92","Type":"ContainerDied","Data":"e52144bf29ee198444608f8d2581bac9e430f9bd5beb60280915fd9d112995d4"} Jul 09 16:52:33.236440 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:33.235008 2554 scope.go:117] "RemoveContainer" containerID="8689bee5f5a09963b58e310f47d80fd84c4e925d60921e46caa0a182c075930b" Jul 09 16:52:33.236440 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:33.235212 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545d474cdc-svhrd" Jul 09 16:52:33.244745 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:33.244726 2554 scope.go:117] "RemoveContainer" containerID="8689bee5f5a09963b58e310f47d80fd84c4e925d60921e46caa0a182c075930b" Jul 09 16:52:33.244987 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:52:33.244966 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8689bee5f5a09963b58e310f47d80fd84c4e925d60921e46caa0a182c075930b\": container with ID starting with 8689bee5f5a09963b58e310f47d80fd84c4e925d60921e46caa0a182c075930b not found: ID does not exist" containerID="8689bee5f5a09963b58e310f47d80fd84c4e925d60921e46caa0a182c075930b" Jul 09 16:52:33.245054 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:33.244992 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8689bee5f5a09963b58e310f47d80fd84c4e925d60921e46caa0a182c075930b"} err="failed to get container status \"8689bee5f5a09963b58e310f47d80fd84c4e925d60921e46caa0a182c075930b\": rpc error: code = NotFound desc = could not find container \"8689bee5f5a09963b58e310f47d80fd84c4e925d60921e46caa0a182c075930b\": container with ID starting with 8689bee5f5a09963b58e310f47d80fd84c4e925d60921e46caa0a182c075930b not found: ID does not exist" Jul 09 16:52:33.257796 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:33.257769 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-545d474cdc-svhrd"] Jul 09 16:52:33.261104 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:33.261082 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-545d474cdc-svhrd"] Jul 09 16:52:33.539245 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:33.539149 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81713a97-06a5-42c9-8fb2-8f78bd827d92" path="/var/lib/kubelet/pods/81713a97-06a5-42c9-8fb2-8f78bd827d92/volumes" Jul 09 16:52:35.457172 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:35.457142 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:35.557679 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:35.557634 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:40.401471 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:40.401428 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" podUID="fd1f503d-7acd-472b-ba6f-d528fd1b2830" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 09 16:52:44.159634 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:44.159585 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:44.260548 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:44.260482 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:44.317899 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:44.317869 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:50.306199 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:50.306166 2554 generic.go:356] "Generic (PLEG): container finished" podID="86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1" containerID="b1927b8650b93a8738ea356b267300b4f1241520975e2d76aa8550d6c1d0c653" exitCode=0 Jul 09 16:52:50.306582 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:50.306235 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" event={"ID":"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1","Type":"ContainerDied","Data":"b1927b8650b93a8738ea356b267300b4f1241520975e2d76aa8550d6c1d0c653"} Jul 09 16:52:50.306655 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:50.306603 2554 scope.go:117] "RemoveContainer" containerID="b1927b8650b93a8738ea356b267300b4f1241520975e2d76aa8550d6c1d0c653" Jul 09 16:52:50.402355 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:50.402316 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" podUID="fd1f503d-7acd-472b-ba6f-d528fd1b2830" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 09 16:52:50.402497 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:50.402412 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" Jul 09 16:52:50.402922 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:50.402903 2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"a6895793ca84b62a0c014580efef2430f9971df84c2a10d683b130fb95ae2475"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 09 16:52:50.403014 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:50.402944 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" podUID="fd1f503d-7acd-472b-ba6f-d528fd1b2830" containerName="service-proxy" containerID="cri-o://a6895793ca84b62a0c014580efef2430f9971df84c2a10d683b130fb95ae2475" gracePeriod=30 Jul 09 16:52:51.312914 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:51.312876 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-mzdjr" event={"ID":"86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1","Type":"ContainerStarted","Data":"7540901c0fe6758d6e3c78cdd5574e594b1cdcab5d72a4b74423adeb203635ff"} Jul 09 16:52:51.315093 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:51.315062 2554 generic.go:356] "Generic (PLEG): container finished" podID="fd1f503d-7acd-472b-ba6f-d528fd1b2830" containerID="a6895793ca84b62a0c014580efef2430f9971df84c2a10d683b130fb95ae2475" exitCode=2 Jul 09 16:52:51.315213 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:51.315128 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" event={"ID":"fd1f503d-7acd-472b-ba6f-d528fd1b2830","Type":"ContainerDied","Data":"a6895793ca84b62a0c014580efef2430f9971df84c2a10d683b130fb95ae2475"} Jul 09 16:52:51.315213 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:51.315168 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68fbf996f5-jbfqb" event={"ID":"fd1f503d-7acd-472b-ba6f-d528fd1b2830","Type":"ContainerStarted","Data":"7d43fb47258c8be8a99d2e819aaa6ef3d45e5e2d2a917b40230c817ab0df92ac"} Jul 09 16:52:51.316628 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:51.316609 2554 generic.go:356] "Generic (PLEG): container finished" podID="1876b077-aa7e-412c-9d33-b579aa0da20e" containerID="cfd5ce60115924b136adf45838be11dca497798d56500d4419ea61d5338c3ce7" exitCode=0 Jul 09 16:52:51.316723 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:51.316655 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" event={"ID":"1876b077-aa7e-412c-9d33-b579aa0da20e","Type":"ContainerDied","Data":"cfd5ce60115924b136adf45838be11dca497798d56500d4419ea61d5338c3ce7"} Jul 09 16:52:51.316878 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:51.316866 2554 scope.go:117] "RemoveContainer" containerID="cfd5ce60115924b136adf45838be11dca497798d56500d4419ea61d5338c3ce7" Jul 09 16:52:52.322079 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:52.322040 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qmt54" event={"ID":"1876b077-aa7e-412c-9d33-b579aa0da20e","Type":"ContainerStarted","Data":"5f0dc5a58be618482898b6e3d43aa0cb05839c63f1600e82cf1a12047a707335"} Jul 09 16:52:55.336913 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:55.336872 2554 generic.go:356] "Generic (PLEG): container finished" podID="6ecd3511-8dcc-4892-b7f3-bde3024a65c8" containerID="682cef5b6f58496bea30603b6cb6a1a552ec23c5bbdc375af1bba4b85abe4c37" exitCode=0 Jul 09 16:52:55.337266 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:55.336945 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" event={"ID":"6ecd3511-8dcc-4892-b7f3-bde3024a65c8","Type":"ContainerDied","Data":"682cef5b6f58496bea30603b6cb6a1a552ec23c5bbdc375af1bba4b85abe4c37"} Jul 09 16:52:55.337266 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:55.337257 2554 scope.go:117] "RemoveContainer" containerID="682cef5b6f58496bea30603b6cb6a1a552ec23c5bbdc375af1bba4b85abe4c37" Jul 09 16:52:56.346267 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:52:56.346223 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-v5hks" event={"ID":"6ecd3511-8dcc-4892-b7f3-bde3024a65c8","Type":"ContainerStarted","Data":"0ce66e39da66c338fe8027f30ee0451c273e5e5201fdadb3e6fc4639abf35620"} Jul 09 16:53:18.652705 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:53:18.652662 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:18.763077 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:53:18.763045 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:25.614041 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:53:25.613936 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:25.673105 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:53:25.673071 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:30.655546 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:53:30.655508 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:30.757327 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:53:30.757295 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:35.454333 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:53:35.454284 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:35.553167 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:53:35.553132 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:36.826640 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:53:36.826608 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dd4d7667b-mtlbk"] Jul 09 16:53:36.921593 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:53:36.921556 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:37.022570 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:53:37.022539 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:37.075585 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:53:37.075550 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:56.595533 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:53:56.595465 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:54:01.847195 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:01.847152 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dd4d7667b-mtlbk" podUID="11932672-faba-48f2-8d1e-89205a0acf83" containerName="console" containerID="cri-o://cb65128f28409020a8452285d5721497d0de7a188a4b744ccfde3dde898f1344" gracePeriod=15 Jul 09 16:54:02.098163 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.098114 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:54:02.169062 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.169032 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-console-config\") pod \"11932672-faba-48f2-8d1e-89205a0acf83\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " Jul 09 16:54:02.169235 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.169072 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-oauth-serving-cert\") pod \"11932672-faba-48f2-8d1e-89205a0acf83\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " Jul 09 16:54:02.169235 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.169094 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11932672-faba-48f2-8d1e-89205a0acf83-console-oauth-config\") pod \"11932672-faba-48f2-8d1e-89205a0acf83\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " Jul 09 16:54:02.169235 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.169109 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-trusted-ca-bundle\") pod \"11932672-faba-48f2-8d1e-89205a0acf83\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " Jul 09 16:54:02.169235 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.169131 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmdm9\" (UniqueName: \"kubernetes.io/projected/11932672-faba-48f2-8d1e-89205a0acf83-kube-api-access-tmdm9\") pod \"11932672-faba-48f2-8d1e-89205a0acf83\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " Jul 09 16:54:02.169235 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.169151 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11932672-faba-48f2-8d1e-89205a0acf83-console-serving-cert\") pod \"11932672-faba-48f2-8d1e-89205a0acf83\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " Jul 09 16:54:02.169235 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.169206 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-service-ca\") pod \"11932672-faba-48f2-8d1e-89205a0acf83\" (UID: \"11932672-faba-48f2-8d1e-89205a0acf83\") " Jul 09 16:54:02.169575 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.169494 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-console-config" (OuterVolumeSpecName: "console-config") pod "11932672-faba-48f2-8d1e-89205a0acf83" (UID: "11932672-faba-48f2-8d1e-89205a0acf83"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:54:02.169575 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.169514 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "11932672-faba-48f2-8d1e-89205a0acf83" (UID: "11932672-faba-48f2-8d1e-89205a0acf83"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:54:02.169663 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.169598 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "11932672-faba-48f2-8d1e-89205a0acf83" (UID: "11932672-faba-48f2-8d1e-89205a0acf83"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:54:02.169777 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.169748 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-service-ca" (OuterVolumeSpecName: "service-ca") pod "11932672-faba-48f2-8d1e-89205a0acf83" (UID: "11932672-faba-48f2-8d1e-89205a0acf83"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:54:02.171171 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.171140 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11932672-faba-48f2-8d1e-89205a0acf83-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "11932672-faba-48f2-8d1e-89205a0acf83" (UID: "11932672-faba-48f2-8d1e-89205a0acf83"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:54:02.171265 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.171241 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11932672-faba-48f2-8d1e-89205a0acf83-kube-api-access-tmdm9" (OuterVolumeSpecName: "kube-api-access-tmdm9") pod "11932672-faba-48f2-8d1e-89205a0acf83" (UID: "11932672-faba-48f2-8d1e-89205a0acf83"). InnerVolumeSpecName "kube-api-access-tmdm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:54:02.171323 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.171298 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11932672-faba-48f2-8d1e-89205a0acf83-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "11932672-faba-48f2-8d1e-89205a0acf83" (UID: "11932672-faba-48f2-8d1e-89205a0acf83"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:54:02.270531 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.270503 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-console-config\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:54:02.270531 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.270525 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-oauth-serving-cert\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:54:02.270531 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.270534 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11932672-faba-48f2-8d1e-89205a0acf83-console-oauth-config\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:54:02.270711 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.270543 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-trusted-ca-bundle\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:54:02.270711 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.270551 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmdm9\" (UniqueName: \"kubernetes.io/projected/11932672-faba-48f2-8d1e-89205a0acf83-kube-api-access-tmdm9\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:54:02.270711 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.270559 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11932672-faba-48f2-8d1e-89205a0acf83-console-serving-cert\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:54:02.270711 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.270567 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11932672-faba-48f2-8d1e-89205a0acf83-service-ca\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:54:02.621328 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.621295 2554 generic.go:356] "Generic (PLEG): container finished" podID="11932672-faba-48f2-8d1e-89205a0acf83" containerID="cb65128f28409020a8452285d5721497d0de7a188a4b744ccfde3dde898f1344" exitCode=0 Jul 09 16:54:02.621525 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.621338 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd4d7667b-mtlbk" event={"ID":"11932672-faba-48f2-8d1e-89205a0acf83","Type":"ContainerDied","Data":"cb65128f28409020a8452285d5721497d0de7a188a4b744ccfde3dde898f1344"} Jul 09 16:54:02.621525 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.621347 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd4d7667b-mtlbk" Jul 09 16:54:02.621525 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.621390 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd4d7667b-mtlbk" event={"ID":"11932672-faba-48f2-8d1e-89205a0acf83","Type":"ContainerDied","Data":"fad013ad02d30a29cc0b54d499a1dc99aeab4fdddd5319ec16a5e9f370e9efd6"} Jul 09 16:54:02.621525 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.621412 2554 scope.go:117] "RemoveContainer" containerID="cb65128f28409020a8452285d5721497d0de7a188a4b744ccfde3dde898f1344" Jul 09 16:54:02.630337 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.630318 2554 scope.go:117] "RemoveContainer" containerID="cb65128f28409020a8452285d5721497d0de7a188a4b744ccfde3dde898f1344" Jul 09 16:54:02.630609 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:54:02.630587 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb65128f28409020a8452285d5721497d0de7a188a4b744ccfde3dde898f1344\": container with ID starting with cb65128f28409020a8452285d5721497d0de7a188a4b744ccfde3dde898f1344 not found: ID does not exist" containerID="cb65128f28409020a8452285d5721497d0de7a188a4b744ccfde3dde898f1344" Jul 09 16:54:02.630699 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.630614 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb65128f28409020a8452285d5721497d0de7a188a4b744ccfde3dde898f1344"} err="failed to get container status \"cb65128f28409020a8452285d5721497d0de7a188a4b744ccfde3dde898f1344\": rpc error: code = NotFound desc = could not find container \"cb65128f28409020a8452285d5721497d0de7a188a4b744ccfde3dde898f1344\": container with ID starting with cb65128f28409020a8452285d5721497d0de7a188a4b744ccfde3dde898f1344 not found: ID does not exist" Jul 09 16:54:02.645578 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.645555 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dd4d7667b-mtlbk"] Jul 09 16:54:02.649402 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:02.649381 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dd4d7667b-mtlbk"] Jul 09 16:54:03.539311 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:03.539274 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11932672-faba-48f2-8d1e-89205a0acf83" path="/var/lib/kubelet/pods/11932672-faba-48f2-8d1e-89205a0acf83/volumes" Jul 09 16:54:16.827008 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:16.826974 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:54:16.923040 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:16.923010 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:54:20.962041 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:20.962008 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:54:21.062933 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:21.062901 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:54:58.831552 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:58.831466 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:54:59.840769 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:54:59.840715 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:02.424355 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:02.424319 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:02.860131 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:02.860039 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:07.017139 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:07.017092 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:07.070009 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:07.069974 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:09.466976 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:09.466915 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:09.619221 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:09.619143 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:11.822201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:11.822166 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:12.022073 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:12.022031 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:19.035112 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:19.035044 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:22.898184 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:22.898142 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:22.999854 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:22.999815 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:25.069857 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:25.069823 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:25.167509 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:25.167465 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:31.392667 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:31.392635 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 16:55:31.400012 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:31.399968 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 16:55:31.402757 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:31.402733 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 16:55:35.017447 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:35.017411 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:35.076860 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:35.076832 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:42.978142 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:42.978110 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:43.081379 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:43.081330 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:45.146743 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:45.146707 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:49.393999 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:49.393963 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:49.479473 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:49.479440 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:59.535113 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:59.535076 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:59.635057 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:55:59.635021 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:00.187492 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.187446 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:00.403733 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.403700 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:00.540446 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.540322 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w"] Jul 09 16:56:00.540822 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.540694 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11932672-faba-48f2-8d1e-89205a0acf83" containerName="console" Jul 09 16:56:00.540822 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.540711 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="11932672-faba-48f2-8d1e-89205a0acf83" containerName="console" Jul 09 16:56:00.540822 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.540737 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81713a97-06a5-42c9-8fb2-8f78bd827d92" containerName="console" Jul 09 16:56:00.540822 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.540743 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="81713a97-06a5-42c9-8fb2-8f78bd827d92" containerName="console" Jul 09 16:56:00.540822 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.540795 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="11932672-faba-48f2-8d1e-89205a0acf83" containerName="console" Jul 09 16:56:00.540822 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.540805 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="81713a97-06a5-42c9-8fb2-8f78bd827d92" containerName="console" Jul 09 16:56:00.543741 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.543725 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.546546 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.546529 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sh896\"" Jul 09 16:56:00.546691 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.546569 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 16:56:00.546859 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.546841 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 16:56:00.546931 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.546884 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 16:56:00.546989 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.546978 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 16:56:00.562729 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.562707 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w"] Jul 09 16:56:00.626930 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.626893 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02cf5953-c877-4978-87f0-ab5d76535b14-webhook-cert\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.627092 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.626966 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnhzt\" (UniqueName: \"kubernetes.io/projected/02cf5953-c877-4978-87f0-ab5d76535b14-kube-api-access-vnhzt\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.627092 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.626995 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/02cf5953-c877-4978-87f0-ab5d76535b14-manifests\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.627092 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.627023 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/02cf5953-c877-4978-87f0-ab5d76535b14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.627092 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.627044 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02cf5953-c877-4978-87f0-ab5d76535b14-tmp\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.728311 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.728275 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02cf5953-c877-4978-87f0-ab5d76535b14-webhook-cert\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.728495 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.728327 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnhzt\" (UniqueName: \"kubernetes.io/projected/02cf5953-c877-4978-87f0-ab5d76535b14-kube-api-access-vnhzt\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.728495 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.728346 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/02cf5953-c877-4978-87f0-ab5d76535b14-manifests\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.728495 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.728392 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/02cf5953-c877-4978-87f0-ab5d76535b14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.728495 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.728449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02cf5953-c877-4978-87f0-ab5d76535b14-tmp\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.728883 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.728856 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/02cf5953-c877-4978-87f0-ab5d76535b14-manifests\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.730621 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.730598 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02cf5953-c877-4978-87f0-ab5d76535b14-tmp\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.730762 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.730739 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02cf5953-c877-4978-87f0-ab5d76535b14-webhook-cert\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.730879 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.730863 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/02cf5953-c877-4978-87f0-ab5d76535b14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.736261 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.736239 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnhzt\" (UniqueName: \"kubernetes.io/projected/02cf5953-c877-4978-87f0-ab5d76535b14-kube-api-access-vnhzt\") pod \"opendatahub-operator-controller-manager-789dddf866-44m2w\" (UID: \"02cf5953-c877-4978-87f0-ab5d76535b14\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.854520 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.854453 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:00.921317 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.921286 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:00.988010 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.987987 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w"] Jul 09 16:56:00.990337 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:56:00.990313 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02cf5953_c877_4978_87f0_ab5d76535b14.slice/crio-6ed6ee24ee3e950fee465934ff735d3b7e75620613056fc098c0e55057cfc122 WatchSource:0}: Error finding container 6ed6ee24ee3e950fee465934ff735d3b7e75620613056fc098c0e55057cfc122: Status 404 returned error can't find the container with id 6ed6ee24ee3e950fee465934ff735d3b7e75620613056fc098c0e55057cfc122 Jul 09 16:56:00.992056 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.992038 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:56:00.994561 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:00.994538 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:01.062712 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:01.062678 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:01.091157 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:01.091123 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" event={"ID":"02cf5953-c877-4978-87f0-ab5d76535b14","Type":"ContainerStarted","Data":"6ed6ee24ee3e950fee465934ff735d3b7e75620613056fc098c0e55057cfc122"} Jul 09 16:56:05.113314 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:05.113278 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" event={"ID":"02cf5953-c877-4978-87f0-ab5d76535b14","Type":"ContainerStarted","Data":"48c018c883ffb66af8b366d44ef64bb3096b816ca790097a4be88f389a2e5ea7"} Jul 09 16:56:06.119421 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:06.119385 2554 generic.go:356] "Generic (PLEG): container finished" podID="02cf5953-c877-4978-87f0-ab5d76535b14" containerID="48c018c883ffb66af8b366d44ef64bb3096b816ca790097a4be88f389a2e5ea7" exitCode=0 Jul 09 16:56:06.119804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:06.119463 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" event={"ID":"02cf5953-c877-4978-87f0-ab5d76535b14","Type":"ContainerDied","Data":"48c018c883ffb66af8b366d44ef64bb3096b816ca790097a4be88f389a2e5ea7"} Jul 09 16:56:07.126582 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:07.126543 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" event={"ID":"02cf5953-c877-4978-87f0-ab5d76535b14","Type":"ContainerStarted","Data":"2c6e2c8d58f14a4795f5d420aca0248d99b2988530249043a71987a2e8ad223d"} Jul 09 16:56:07.126975 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:07.126673 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:07.155713 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:07.155656 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" podStartSLOduration=2.407690379 podStartE2EDuration="7.155637306s" totalImagesPullingTime="3.662067802s" totalInitContainerRuntime="1.085879125s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:07.152526676 +0000 UTC m=+336.195301938" watchObservedRunningTime="2026-07-09 16:56:07.155637306 +0000 UTC m=+336.198412556" Jul 09 16:56:07.164333 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:07.164293 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:18.133623 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:18.133590 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-44m2w" Jul 09 16:56:20.011851 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.011815 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:20.140276 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.140239 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:20.510931 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.510889 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:20.540860 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.540825 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cc96589f5-gs57w"] Jul 09 16:56:20.554934 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.554907 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" Jul 09 16:56:20.559995 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.559854 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-v9qf2\"" Jul 09 16:56:20.560188 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.560172 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 16:56:20.560935 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.560915 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 16:56:20.571044 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.571022 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cc96589f5-gs57w"] Jul 09 16:56:20.588983 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.588955 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl4pj\" (UniqueName: \"kubernetes.io/projected/d575e9cd-a523-491d-8541-57cef5693c77-kube-api-access-pl4pj\") pod \"kube-auth-proxy-cc96589f5-gs57w\" (UID: \"d575e9cd-a523-491d-8541-57cef5693c77\") " pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" Jul 09 16:56:20.589092 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.589018 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d575e9cd-a523-491d-8541-57cef5693c77-tls-certs\") pod \"kube-auth-proxy-cc96589f5-gs57w\" (UID: \"d575e9cd-a523-491d-8541-57cef5693c77\") " pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" Jul 09 16:56:20.589608 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.589180 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d575e9cd-a523-491d-8541-57cef5693c77-tmp\") pod \"kube-auth-proxy-cc96589f5-gs57w\" (UID: \"d575e9cd-a523-491d-8541-57cef5693c77\") " pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" Jul 09 16:56:20.690605 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.690563 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d575e9cd-a523-491d-8541-57cef5693c77-tmp\") pod \"kube-auth-proxy-cc96589f5-gs57w\" (UID: \"d575e9cd-a523-491d-8541-57cef5693c77\") " pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" Jul 09 16:56:20.690792 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.690650 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl4pj\" (UniqueName: \"kubernetes.io/projected/d575e9cd-a523-491d-8541-57cef5693c77-kube-api-access-pl4pj\") pod \"kube-auth-proxy-cc96589f5-gs57w\" (UID: \"d575e9cd-a523-491d-8541-57cef5693c77\") " pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" Jul 09 16:56:20.690792 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.690684 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d575e9cd-a523-491d-8541-57cef5693c77-tls-certs\") pod \"kube-auth-proxy-cc96589f5-gs57w\" (UID: \"d575e9cd-a523-491d-8541-57cef5693c77\") " pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" Jul 09 16:56:20.690901 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:56:20.690814 2554 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 09 16:56:20.690901 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:56:20.690878 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d575e9cd-a523-491d-8541-57cef5693c77-tls-certs podName:d575e9cd-a523-491d-8541-57cef5693c77 nodeName:}" failed. No retries permitted until 2026-07-09 16:56:21.19086256 +0000 UTC m=+350.233637788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d575e9cd-a523-491d-8541-57cef5693c77-tls-certs") pod "kube-auth-proxy-cc96589f5-gs57w" (UID: "d575e9cd-a523-491d-8541-57cef5693c77") : secret "kube-auth-proxy-tls" not found Jul 09 16:56:20.692774 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.692751 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d575e9cd-a523-491d-8541-57cef5693c77-tmp\") pod \"kube-auth-proxy-cc96589f5-gs57w\" (UID: \"d575e9cd-a523-491d-8541-57cef5693c77\") " pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" Jul 09 16:56:20.713481 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.713459 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl4pj\" (UniqueName: \"kubernetes.io/projected/d575e9cd-a523-491d-8541-57cef5693c77-kube-api-access-pl4pj\") pod \"kube-auth-proxy-cc96589f5-gs57w\" (UID: \"d575e9cd-a523-491d-8541-57cef5693c77\") " pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" Jul 09 16:56:20.805275 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.805188 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4q8p5"] Jul 09 16:56:20.808851 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.808823 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4q8p5" Jul 09 16:56:20.814804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.814776 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 09 16:56:20.814930 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.814809 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-n9p9x\"" Jul 09 16:56:20.825827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.825801 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4q8p5"] Jul 09 16:56:20.871066 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.871032 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:20.892411 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.892383 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq68m\" (UniqueName: \"kubernetes.io/projected/191e58c8-307d-4e6e-bcfe-97fbc3d7801b-kube-api-access-nq68m\") pod \"odh-model-controller-7998c67dc4-4q8p5\" (UID: \"191e58c8-307d-4e6e-bcfe-97fbc3d7801b\") " pod="opendatahub/odh-model-controller-7998c67dc4-4q8p5" Jul 09 16:56:20.892520 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.892444 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/191e58c8-307d-4e6e-bcfe-97fbc3d7801b-cert\") pod \"odh-model-controller-7998c67dc4-4q8p5\" (UID: \"191e58c8-307d-4e6e-bcfe-97fbc3d7801b\") " pod="opendatahub/odh-model-controller-7998c67dc4-4q8p5" Jul 09 16:56:20.993327 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.993294 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/191e58c8-307d-4e6e-bcfe-97fbc3d7801b-cert\") pod \"odh-model-controller-7998c67dc4-4q8p5\" (UID: \"191e58c8-307d-4e6e-bcfe-97fbc3d7801b\") " pod="opendatahub/odh-model-controller-7998c67dc4-4q8p5" Jul 09 16:56:20.993533 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.993430 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq68m\" (UniqueName: \"kubernetes.io/projected/191e58c8-307d-4e6e-bcfe-97fbc3d7801b-kube-api-access-nq68m\") pod \"odh-model-controller-7998c67dc4-4q8p5\" (UID: \"191e58c8-307d-4e6e-bcfe-97fbc3d7801b\") " pod="opendatahub/odh-model-controller-7998c67dc4-4q8p5" Jul 09 16:56:20.993533 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:56:20.993473 2554 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 09 16:56:20.993633 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:56:20.993537 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/191e58c8-307d-4e6e-bcfe-97fbc3d7801b-cert podName:191e58c8-307d-4e6e-bcfe-97fbc3d7801b nodeName:}" failed. No retries permitted until 2026-07-09 16:56:21.493522658 +0000 UTC m=+350.536297907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/191e58c8-307d-4e6e-bcfe-97fbc3d7801b-cert") pod "odh-model-controller-7998c67dc4-4q8p5" (UID: "191e58c8-307d-4e6e-bcfe-97fbc3d7801b") : secret "odh-model-controller-webhook-cert" not found Jul 09 16:56:20.994193 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:20.994152 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:21.018263 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:21.018229 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq68m\" (UniqueName: \"kubernetes.io/projected/191e58c8-307d-4e6e-bcfe-97fbc3d7801b-kube-api-access-nq68m\") pod \"odh-model-controller-7998c67dc4-4q8p5\" (UID: \"191e58c8-307d-4e6e-bcfe-97fbc3d7801b\") " pod="opendatahub/odh-model-controller-7998c67dc4-4q8p5" Jul 09 16:56:21.096122 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:21.096030 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:21.195572 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:21.195527 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d575e9cd-a523-491d-8541-57cef5693c77-tls-certs\") pod \"kube-auth-proxy-cc96589f5-gs57w\" (UID: \"d575e9cd-a523-491d-8541-57cef5693c77\") " pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" Jul 09 16:56:21.197876 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:21.197846 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d575e9cd-a523-491d-8541-57cef5693c77-tls-certs\") pod \"kube-auth-proxy-cc96589f5-gs57w\" (UID: \"d575e9cd-a523-491d-8541-57cef5693c77\") " pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" Jul 09 16:56:21.237251 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:21.237219 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:21.310327 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:21.310291 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:21.464776 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:21.464741 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" Jul 09 16:56:21.498659 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:21.498616 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/191e58c8-307d-4e6e-bcfe-97fbc3d7801b-cert\") pod \"odh-model-controller-7998c67dc4-4q8p5\" (UID: \"191e58c8-307d-4e6e-bcfe-97fbc3d7801b\") " pod="opendatahub/odh-model-controller-7998c67dc4-4q8p5" Jul 09 16:56:21.500944 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:21.500919 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/191e58c8-307d-4e6e-bcfe-97fbc3d7801b-cert\") pod \"odh-model-controller-7998c67dc4-4q8p5\" (UID: \"191e58c8-307d-4e6e-bcfe-97fbc3d7801b\") " pod="opendatahub/odh-model-controller-7998c67dc4-4q8p5" Jul 09 16:56:21.628984 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:21.628956 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cc96589f5-gs57w"] Jul 09 16:56:21.631852 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:56:21.631823 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd575e9cd_a523_491d_8541_57cef5693c77.slice/crio-0dda9ebd7d09230e3dec0f8ac5fd6f609255519c6a3d419d179d564ece050230 WatchSource:0}: Error finding container 0dda9ebd7d09230e3dec0f8ac5fd6f609255519c6a3d419d179d564ece050230: Status 404 returned error can't find the container with id 0dda9ebd7d09230e3dec0f8ac5fd6f609255519c6a3d419d179d564ece050230 Jul 09 16:56:21.722260 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:21.722167 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4q8p5" Jul 09 16:56:21.885397 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:21.884356 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4q8p5"] Jul 09 16:56:21.888547 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:56:21.888517 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod191e58c8_307d_4e6e_bcfe_97fbc3d7801b.slice/crio-30be78d0aaf684dc1288e94360a1dd34e69082c245452770eca1ec1bdff4d783 WatchSource:0}: Error finding container 30be78d0aaf684dc1288e94360a1dd34e69082c245452770eca1ec1bdff4d783: Status 404 returned error can't find the container with id 30be78d0aaf684dc1288e94360a1dd34e69082c245452770eca1ec1bdff4d783 Jul 09 16:56:21.984191 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:21.984110 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:22.194047 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.194011 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4q8p5" event={"ID":"191e58c8-307d-4e6e-bcfe-97fbc3d7801b","Type":"ContainerStarted","Data":"30be78d0aaf684dc1288e94360a1dd34e69082c245452770eca1ec1bdff4d783"} Jul 09 16:56:22.195235 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.195200 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" event={"ID":"d575e9cd-a523-491d-8541-57cef5693c77","Type":"ContainerStarted","Data":"0dda9ebd7d09230e3dec0f8ac5fd6f609255519c6a3d419d179d564ece050230"} Jul 09 16:56:22.351506 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.351421 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:22.353105 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.353075 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8"] Jul 09 16:56:22.357018 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.356994 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.359972 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.359943 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 16:56:22.360084 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.359992 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pnpqz\"" Jul 09 16:56:22.360159 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.360131 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 16:56:22.360215 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.360175 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 16:56:22.360215 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.360195 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 16:56:22.371646 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.371590 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8"] Jul 09 16:56:22.408201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.407831 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.408201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.407877 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b261b55-638c-47bb-95b8-0629efd1224e-istio-token\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.408201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.407912 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2b261b55-638c-47bb-95b8-0629efd1224e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.408201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.407964 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b261b55-638c-47bb-95b8-0629efd1224e-local-certs\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.408201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.407991 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd6cw\" (UniqueName: \"kubernetes.io/projected/2b261b55-638c-47bb-95b8-0629efd1224e-kube-api-access-dd6cw\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.408201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.408052 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.408201 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.408084 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-cacerts\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.455402 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.455336 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:22.508860 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.508825 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.509035 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.508871 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b261b55-638c-47bb-95b8-0629efd1224e-istio-token\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.509035 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.508904 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2b261b55-638c-47bb-95b8-0629efd1224e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.509035 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.508954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b261b55-638c-47bb-95b8-0629efd1224e-local-certs\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.509035 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.508981 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd6cw\" (UniqueName: \"kubernetes.io/projected/2b261b55-638c-47bb-95b8-0629efd1224e-kube-api-access-dd6cw\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.509244 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.509049 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.509244 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.509086 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-cacerts\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.509711 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.509677 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2b261b55-638c-47bb-95b8-0629efd1224e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.512288 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.512223 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.512288 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.512257 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.512639 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.512617 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-cacerts\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.513659 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.513636 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b261b55-638c-47bb-95b8-0629efd1224e-local-certs\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.518554 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.518458 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b261b55-638c-47bb-95b8-0629efd1224e-istio-token\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.519558 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.519535 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd6cw\" (UniqueName: \"kubernetes.io/projected/2b261b55-638c-47bb-95b8-0629efd1224e-kube-api-access-dd6cw\") pod \"istiod-openshift-gateway-7574459656-lq8w8\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.577510 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.577446 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:22.669300 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.669225 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:22.863402 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:22.863301 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8"] Jul 09 16:56:22.866128 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:56:22.866096 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b261b55_638c_47bb_95b8_0629efd1224e.slice/crio-22aa9640e05bfec773c124e8e32f5ad3ef4dfa23f99119e728e731f54711b1d7 WatchSource:0}: Error finding container 22aa9640e05bfec773c124e8e32f5ad3ef4dfa23f99119e728e731f54711b1d7: Status 404 returned error can't find the container with id 22aa9640e05bfec773c124e8e32f5ad3ef4dfa23f99119e728e731f54711b1d7 Jul 09 16:56:23.099544 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:23.099427 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:23.203473 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:23.203393 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" event={"ID":"2b261b55-638c-47bb-95b8-0629efd1224e","Type":"ContainerStarted","Data":"22aa9640e05bfec773c124e8e32f5ad3ef4dfa23f99119e728e731f54711b1d7"} Jul 09 16:56:23.478124 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:23.478080 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:25.542562 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:25.542520 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:25.600339 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:25.600298 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:26.975322 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:26.975167 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 16:56:26.975322 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:26.975236 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 16:56:27.229855 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:27.229749 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" event={"ID":"2b261b55-638c-47bb-95b8-0629efd1224e","Type":"ContainerStarted","Data":"1c8d57cee334df60111c2b3bca50793eef87c87b0e72f6b64cb3facc9ac19526"} Jul 09 16:56:27.230019 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:27.229859 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:27.231595 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:27.231561 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4q8p5" event={"ID":"191e58c8-307d-4e6e-bcfe-97fbc3d7801b","Type":"ContainerStarted","Data":"4e175f0b49fb8d7255697150f09f435ee0b2f3e11a8e5adeab2ac3d367bc3ec6"} Jul 09 16:56:27.231757 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:27.231620 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4q8p5" Jul 09 16:56:27.233149 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:27.233111 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" event={"ID":"d575e9cd-a523-491d-8541-57cef5693c77","Type":"ContainerStarted","Data":"9e2cbe279ad5576b68760049c799de94bf8186bfcef09eac1106baf75d47d911"} Jul 09 16:56:27.262178 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:27.262130 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" podStartSLOduration=1.155577432 podStartE2EDuration="5.262114649s" totalImagesPullingTime="4.106537217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:27.25927256 +0000 UTC m=+356.302047794" watchObservedRunningTime="2026-07-09 16:56:27.262114649 +0000 UTC m=+356.304889899" Jul 09 16:56:27.283400 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:27.283342 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cc96589f5-gs57w" podStartSLOduration=2.014903475 podStartE2EDuration="7.283328174s" totalImagesPullingTime="5.268424699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:27.281768707 +0000 UTC m=+356.324543971" watchObservedRunningTime="2026-07-09 16:56:27.283328174 +0000 UTC m=+356.326103424" Jul 09 16:56:27.318399 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:27.315732 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4q8p5" podStartSLOduration=2.291280317 podStartE2EDuration="7.31570817s" totalImagesPullingTime="5.024427853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:27.312239375 +0000 UTC m=+356.355014626" watchObservedRunningTime="2026-07-09 16:56:27.31570817 +0000 UTC m=+356.358483421" Jul 09 16:56:27.481137 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:27.481017 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:27.598781 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:27.598740 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:28.240076 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:28.240042 2554 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-lq8w8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 16:56:28.240534 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:28.240096 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" podUID="2b261b55-638c-47bb-95b8-0629efd1224e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 16:56:28.707905 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:28.707867 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:29.019663 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:29.019586 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:29.117831 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:29.117791 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:31.239338 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:31.239303 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:32.957061 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:32.957025 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:33.092028 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:33.091987 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:33.315132 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:33.315041 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:33.449716 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:33.449686 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:34.290259 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:34.290220 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:34.389225 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:34.389191 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:36.683563 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:36.683523 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8"] Jul 09 16:56:36.684123 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:36.683736 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" podUID="2b261b55-638c-47bb-95b8-0629efd1224e" containerName="discovery" containerID="cri-o://1c8d57cee334df60111c2b3bca50793eef87c87b0e72f6b64cb3facc9ac19526" gracePeriod=30 Jul 09 16:56:36.935827 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:36.935772 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:37.040544 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.040512 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-cacerts\") pod \"2b261b55-638c-47bb-95b8-0629efd1224e\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " Jul 09 16:56:37.040718 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.040550 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-istio-csr-dns-cert\") pod \"2b261b55-638c-47bb-95b8-0629efd1224e\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " Jul 09 16:56:37.040718 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.040569 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd6cw\" (UniqueName: \"kubernetes.io/projected/2b261b55-638c-47bb-95b8-0629efd1224e-kube-api-access-dd6cw\") pod \"2b261b55-638c-47bb-95b8-0629efd1224e\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " Jul 09 16:56:37.040837 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.040752 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b261b55-638c-47bb-95b8-0629efd1224e-istio-token\") pod \"2b261b55-638c-47bb-95b8-0629efd1224e\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " Jul 09 16:56:37.040837 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.040785 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b261b55-638c-47bb-95b8-0629efd1224e-local-certs\") pod \"2b261b55-638c-47bb-95b8-0629efd1224e\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " Jul 09 16:56:37.040837 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.040817 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2b261b55-638c-47bb-95b8-0629efd1224e-istio-csr-ca-configmap\") pod \"2b261b55-638c-47bb-95b8-0629efd1224e\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " Jul 09 16:56:37.040994 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.040851 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-istio-kubeconfig\") pod \"2b261b55-638c-47bb-95b8-0629efd1224e\" (UID: \"2b261b55-638c-47bb-95b8-0629efd1224e\") " Jul 09 16:56:37.041271 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.041232 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b261b55-638c-47bb-95b8-0629efd1224e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "2b261b55-638c-47bb-95b8-0629efd1224e" (UID: "2b261b55-638c-47bb-95b8-0629efd1224e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:56:37.042931 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.042899 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b261b55-638c-47bb-95b8-0629efd1224e-kube-api-access-dd6cw" (OuterVolumeSpecName: "kube-api-access-dd6cw") pod "2b261b55-638c-47bb-95b8-0629efd1224e" (UID: "2b261b55-638c-47bb-95b8-0629efd1224e"). InnerVolumeSpecName "kube-api-access-dd6cw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:56:37.043037 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.043008 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b261b55-638c-47bb-95b8-0629efd1224e-istio-token" (OuterVolumeSpecName: "istio-token") pod "2b261b55-638c-47bb-95b8-0629efd1224e" (UID: "2b261b55-638c-47bb-95b8-0629efd1224e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:56:37.043321 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.043297 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-cacerts" (OuterVolumeSpecName: "cacerts") pod "2b261b55-638c-47bb-95b8-0629efd1224e" (UID: "2b261b55-638c-47bb-95b8-0629efd1224e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:56:37.043321 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.043309 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b261b55-638c-47bb-95b8-0629efd1224e-local-certs" (OuterVolumeSpecName: "local-certs") pod "2b261b55-638c-47bb-95b8-0629efd1224e" (UID: "2b261b55-638c-47bb-95b8-0629efd1224e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:56:37.043450 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.043316 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "2b261b55-638c-47bb-95b8-0629efd1224e" (UID: "2b261b55-638c-47bb-95b8-0629efd1224e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:56:37.043450 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.043332 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "2b261b55-638c-47bb-95b8-0629efd1224e" (UID: "2b261b55-638c-47bb-95b8-0629efd1224e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:56:37.141677 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.141643 2554 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-cacerts\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:56:37.141677 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.141670 2554 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-istio-csr-dns-cert\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:56:37.141677 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.141681 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd6cw\" (UniqueName: \"kubernetes.io/projected/2b261b55-638c-47bb-95b8-0629efd1224e-kube-api-access-dd6cw\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:56:37.141965 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.141691 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b261b55-638c-47bb-95b8-0629efd1224e-istio-token\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:56:37.141965 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.141700 2554 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b261b55-638c-47bb-95b8-0629efd1224e-local-certs\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:56:37.141965 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.141708 2554 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2b261b55-638c-47bb-95b8-0629efd1224e-istio-csr-ca-configmap\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:56:37.141965 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.141716 2554 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2b261b55-638c-47bb-95b8-0629efd1224e-istio-kubeconfig\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:56:37.286122 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.286026 2554 generic.go:356] "Generic (PLEG): container finished" podID="2b261b55-638c-47bb-95b8-0629efd1224e" containerID="1c8d57cee334df60111c2b3bca50793eef87c87b0e72f6b64cb3facc9ac19526" exitCode=0 Jul 09 16:56:37.286122 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.286087 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" Jul 09 16:56:37.286354 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.286114 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" event={"ID":"2b261b55-638c-47bb-95b8-0629efd1224e","Type":"ContainerDied","Data":"1c8d57cee334df60111c2b3bca50793eef87c87b0e72f6b64cb3facc9ac19526"} Jul 09 16:56:37.286354 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.286201 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8" event={"ID":"2b261b55-638c-47bb-95b8-0629efd1224e","Type":"ContainerDied","Data":"22aa9640e05bfec773c124e8e32f5ad3ef4dfa23f99119e728e731f54711b1d7"} Jul 09 16:56:37.286354 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.286231 2554 scope.go:117] "RemoveContainer" containerID="1c8d57cee334df60111c2b3bca50793eef87c87b0e72f6b64cb3facc9ac19526" Jul 09 16:56:37.295070 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.295052 2554 scope.go:117] "RemoveContainer" containerID="1c8d57cee334df60111c2b3bca50793eef87c87b0e72f6b64cb3facc9ac19526" Jul 09 16:56:37.295314 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:56:37.295291 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c8d57cee334df60111c2b3bca50793eef87c87b0e72f6b64cb3facc9ac19526\": container with ID starting with 1c8d57cee334df60111c2b3bca50793eef87c87b0e72f6b64cb3facc9ac19526 not found: ID does not exist" containerID="1c8d57cee334df60111c2b3bca50793eef87c87b0e72f6b64cb3facc9ac19526" Jul 09 16:56:37.295400 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.295327 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c8d57cee334df60111c2b3bca50793eef87c87b0e72f6b64cb3facc9ac19526"} err="failed to get container status \"1c8d57cee334df60111c2b3bca50793eef87c87b0e72f6b64cb3facc9ac19526\": rpc error: code = NotFound desc = could not find container \"1c8d57cee334df60111c2b3bca50793eef87c87b0e72f6b64cb3facc9ac19526\": container with ID starting with 1c8d57cee334df60111c2b3bca50793eef87c87b0e72f6b64cb3facc9ac19526 not found: ID does not exist" Jul 09 16:56:37.307575 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.307553 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8"] Jul 09 16:56:37.313442 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.313408 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lq8w8"] Jul 09 16:56:37.539825 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:37.539739 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b261b55-638c-47bb-95b8-0629efd1224e" path="/var/lib/kubelet/pods/2b261b55-638c-47bb-95b8-0629efd1224e/volumes" Jul 09 16:56:38.240041 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:56:38.240011 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4q8p5" Jul 09 16:57:19.222156 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.222120 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5867d4d7c7-7wpjz"] Jul 09 16:57:19.222729 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.222674 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b261b55-638c-47bb-95b8-0629efd1224e" containerName="discovery" Jul 09 16:57:19.222729 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.222691 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b261b55-638c-47bb-95b8-0629efd1224e" containerName="discovery" Jul 09 16:57:19.222864 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.222796 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b261b55-638c-47bb-95b8-0629efd1224e" containerName="discovery" Jul 09 16:57:19.231393 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.231350 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.234455 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.234122 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 16:57:19.234455 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.234204 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 16:57:19.234455 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.234246 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 16:57:19.235647 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.235543 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 16:57:19.235647 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.235599 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 16:57:19.235805 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.235708 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tnbw7\"" Jul 09 16:57:19.240548 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.240527 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 16:57:19.241435 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.241400 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5867d4d7c7-7wpjz"] Jul 09 16:57:19.267972 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.267946 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e8bf54-7f9d-42fc-8f52-e379deb11dff-trusted-ca-bundle\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.268084 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.267980 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwzrm\" (UniqueName: \"kubernetes.io/projected/15e8bf54-7f9d-42fc-8f52-e379deb11dff-kube-api-access-gwzrm\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.268084 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.268015 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15e8bf54-7f9d-42fc-8f52-e379deb11dff-oauth-serving-cert\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.268084 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.268067 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15e8bf54-7f9d-42fc-8f52-e379deb11dff-console-config\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.268251 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.268105 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15e8bf54-7f9d-42fc-8f52-e379deb11dff-service-ca\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.268251 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.268183 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15e8bf54-7f9d-42fc-8f52-e379deb11dff-console-serving-cert\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.268251 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.268238 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15e8bf54-7f9d-42fc-8f52-e379deb11dff-console-oauth-config\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.284381 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.284333 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:57:19.368786 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.368761 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15e8bf54-7f9d-42fc-8f52-e379deb11dff-console-config\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.368933 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.368814 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15e8bf54-7f9d-42fc-8f52-e379deb11dff-service-ca\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.368933 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.368844 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15e8bf54-7f9d-42fc-8f52-e379deb11dff-console-serving-cert\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.368933 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.368883 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15e8bf54-7f9d-42fc-8f52-e379deb11dff-console-oauth-config\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.368933 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.368915 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e8bf54-7f9d-42fc-8f52-e379deb11dff-trusted-ca-bundle\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.369151 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.368941 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzrm\" (UniqueName: \"kubernetes.io/projected/15e8bf54-7f9d-42fc-8f52-e379deb11dff-kube-api-access-gwzrm\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.369151 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.368983 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15e8bf54-7f9d-42fc-8f52-e379deb11dff-oauth-serving-cert\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.369605 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.369581 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15e8bf54-7f9d-42fc-8f52-e379deb11dff-console-config\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.369704 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.369636 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15e8bf54-7f9d-42fc-8f52-e379deb11dff-service-ca\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.369811 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.369787 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e8bf54-7f9d-42fc-8f52-e379deb11dff-trusted-ca-bundle\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.369974 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.369860 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15e8bf54-7f9d-42fc-8f52-e379deb11dff-oauth-serving-cert\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.371532 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.371510 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15e8bf54-7f9d-42fc-8f52-e379deb11dff-console-oauth-config\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.371609 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.371554 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15e8bf54-7f9d-42fc-8f52-e379deb11dff-console-serving-cert\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.377146 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.377127 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwzrm\" (UniqueName: \"kubernetes.io/projected/15e8bf54-7f9d-42fc-8f52-e379deb11dff-kube-api-access-gwzrm\") pod \"console-5867d4d7c7-7wpjz\" (UID: \"15e8bf54-7f9d-42fc-8f52-e379deb11dff\") " pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.384984 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.384959 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:57:19.543118 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.543053 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:19.672994 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:19.672970 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5867d4d7c7-7wpjz"] Jul 09 16:57:19.675614 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:57:19.675576 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e8bf54_7f9d_42fc_8f52_e379deb11dff.slice/crio-201b91a5bcfb65b6313b119bdeb61dc3424c33a04c78dc7f0c18f1b003258bb7 WatchSource:0}: Error finding container 201b91a5bcfb65b6313b119bdeb61dc3424c33a04c78dc7f0c18f1b003258bb7: Status 404 returned error can't find the container with id 201b91a5bcfb65b6313b119bdeb61dc3424c33a04c78dc7f0c18f1b003258bb7 Jul 09 16:57:20.477821 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:20.477788 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5867d4d7c7-7wpjz" event={"ID":"15e8bf54-7f9d-42fc-8f52-e379deb11dff","Type":"ContainerStarted","Data":"8d975adf1a51c28390b0d0cc47ddf53353864e17c8136bbf5e9e25c05a17784c"} Jul 09 16:57:20.478183 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:20.477866 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5867d4d7c7-7wpjz" event={"ID":"15e8bf54-7f9d-42fc-8f52-e379deb11dff","Type":"ContainerStarted","Data":"201b91a5bcfb65b6313b119bdeb61dc3424c33a04c78dc7f0c18f1b003258bb7"} Jul 09 16:57:21.414653 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:21.414613 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:57:21.515960 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:21.515924 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:57:21.595835 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:21.595783 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5867d4d7c7-7wpjz" podStartSLOduration=2.595767844 podStartE2EDuration="2.595767844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:57:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:57:20.495317243 +0000 UTC m=+409.538092493" watchObservedRunningTime="2026-07-09 16:57:21.595767844 +0000 UTC m=+410.638543093" Jul 09 16:57:21.596445 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:21.596424 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nrjrh"] Jul 09 16:57:21.599784 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:21.599764 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nrjrh" Jul 09 16:57:21.602901 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:21.602878 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bdktj\"" Jul 09 16:57:21.603554 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:21.603539 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 16:57:21.604399 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:21.604382 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 16:57:21.620466 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:21.620445 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nrjrh"] Jul 09 16:57:21.670252 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:21.670175 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:57:21.686340 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:21.686312 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj56t\" (UniqueName: \"kubernetes.io/projected/24bd2005-3d25-40bf-ba7b-cdfb64a7d538-kube-api-access-sj56t\") pod \"kuadrant-operator-catalog-nrjrh\" (UID: \"24bd2005-3d25-40bf-ba7b-cdfb64a7d538\") " pod="kuadrant-system/kuadrant-operator-catalog-nrjrh" Jul 09 16:57:21.787360 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:21.787324 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj56t\" (UniqueName: \"kubernetes.io/projected/24bd2005-3d25-40bf-ba7b-cdfb64a7d538-kube-api-access-sj56t\") pod \"kuadrant-operator-catalog-nrjrh\" (UID: \"24bd2005-3d25-40bf-ba7b-cdfb64a7d538\") " pod="kuadrant-system/kuadrant-operator-catalog-nrjrh" Jul 09 16:57:21.795324 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:21.795300 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj56t\" (UniqueName: \"kubernetes.io/projected/24bd2005-3d25-40bf-ba7b-cdfb64a7d538-kube-api-access-sj56t\") pod \"kuadrant-operator-catalog-nrjrh\" (UID: \"24bd2005-3d25-40bf-ba7b-cdfb64a7d538\") " pod="kuadrant-system/kuadrant-operator-catalog-nrjrh" Jul 09 16:57:21.910056 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:21.910031 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nrjrh" Jul 09 16:57:22.034137 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:22.034111 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nrjrh"] Jul 09 16:57:22.036284 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:57:22.036247 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24bd2005_3d25_40bf_ba7b_cdfb64a7d538.slice/crio-36ac446b197f580e23a1465005abac4989e8f3fd25aed23481ebfbab371a6b7b WatchSource:0}: Error finding container 36ac446b197f580e23a1465005abac4989e8f3fd25aed23481ebfbab371a6b7b: Status 404 returned error can't find the container with id 36ac446b197f580e23a1465005abac4989e8f3fd25aed23481ebfbab371a6b7b Jul 09 16:57:22.487980 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:22.487935 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nrjrh" event={"ID":"24bd2005-3d25-40bf-ba7b-cdfb64a7d538","Type":"ContainerStarted","Data":"36ac446b197f580e23a1465005abac4989e8f3fd25aed23481ebfbab371a6b7b"} Jul 09 16:57:24.498641 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:24.498598 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nrjrh" event={"ID":"24bd2005-3d25-40bf-ba7b-cdfb64a7d538","Type":"ContainerStarted","Data":"0a08f8e890d0f0ee90c695b5e6bd628d04ca41897460354312c03fa2839be1be"} Jul 09 16:57:24.514254 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:24.514206 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nrjrh" podStartSLOduration=1.197795814 podStartE2EDuration="3.514190187s" totalImagesPullingTime="2.316394373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:57:24.512639924 +0000 UTC m=+413.555415175" watchObservedRunningTime="2026-07-09 16:57:24.514190187 +0000 UTC m=+413.556965437" Jul 09 16:57:29.544647 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:29.544611 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:29.545120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:29.544661 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:29.548072 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:29.548050 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:30.527388 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:30.527349 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5867d4d7c7-7wpjz" Jul 09 16:57:30.681319 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:30.681287 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:57:30.782144 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:30.782059 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:57:30.837812 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:30.837783 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:57:31.910606 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:31.910575 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-nrjrh" Jul 09 16:57:31.911047 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:31.910657 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-nrjrh" Jul 09 16:57:31.933169 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:31.933148 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-nrjrh" Jul 09 16:57:32.554403 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:32.554357 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-nrjrh" Jul 09 16:57:48.302622 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:48.302584 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:57:50.919816 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:50.919778 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mwm7q"] Jul 09 16:57:50.924499 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:50.924479 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mwm7q" Jul 09 16:57:50.927304 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:50.927271 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 09 16:57:50.927435 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:50.927302 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bswzm\"" Jul 09 16:57:50.935429 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:50.935408 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mwm7q"] Jul 09 16:57:51.034994 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:51.034963 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jdws\" (UniqueName: \"kubernetes.io/projected/3d7d6387-ac95-4482-b02b-1be43105f3d5-kube-api-access-4jdws\") pod \"dns-operator-controller-manager-864dd78c4c-mwm7q\" (UID: \"3d7d6387-ac95-4482-b02b-1be43105f3d5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mwm7q" Jul 09 16:57:51.135563 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:51.135528 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jdws\" (UniqueName: \"kubernetes.io/projected/3d7d6387-ac95-4482-b02b-1be43105f3d5-kube-api-access-4jdws\") pod \"dns-operator-controller-manager-864dd78c4c-mwm7q\" (UID: \"3d7d6387-ac95-4482-b02b-1be43105f3d5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mwm7q" Jul 09 16:57:51.154684 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:51.154657 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jdws\" (UniqueName: \"kubernetes.io/projected/3d7d6387-ac95-4482-b02b-1be43105f3d5-kube-api-access-4jdws\") pod \"dns-operator-controller-manager-864dd78c4c-mwm7q\" (UID: \"3d7d6387-ac95-4482-b02b-1be43105f3d5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mwm7q" Jul 09 16:57:51.234610 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:51.234544 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mwm7q" Jul 09 16:57:51.367418 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:51.367384 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mwm7q"] Jul 09 16:57:51.370558 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:57:51.370522 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7d6387_ac95_4482_b02b_1be43105f3d5.slice/crio-746e6328b8945abe857da3afc1906fa5654abd1e5317ec20fe965e8f7d998412 WatchSource:0}: Error finding container 746e6328b8945abe857da3afc1906fa5654abd1e5317ec20fe965e8f7d998412: Status 404 returned error can't find the container with id 746e6328b8945abe857da3afc1906fa5654abd1e5317ec20fe965e8f7d998412 Jul 09 16:57:51.611454 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:51.611361 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mwm7q" event={"ID":"3d7d6387-ac95-4482-b02b-1be43105f3d5","Type":"ContainerStarted","Data":"746e6328b8945abe857da3afc1906fa5654abd1e5317ec20fe965e8f7d998412"} Jul 09 16:57:52.482016 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:52.481981 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:57:53.622881 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:53.622844 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mwm7q" event={"ID":"3d7d6387-ac95-4482-b02b-1be43105f3d5","Type":"ContainerStarted","Data":"2500142174c4385ed77b573306523f34908ecd75070dce0e47a06b5d2254c516"} Jul 09 16:57:53.623179 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:53.622930 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mwm7q" Jul 09 16:57:53.640203 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:53.640159 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mwm7q" podStartSLOduration=1.489193805 podStartE2EDuration="3.64014638s" totalImagesPullingTime="2.150952575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:57:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:57:53.639586187 +0000 UTC m=+442.682361438" watchObservedRunningTime="2026-07-09 16:57:53.64014638 +0000 UTC m=+442.682921629" Jul 09 16:57:54.409908 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:54.409867 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z"] Jul 09 16:57:54.413305 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:54.413283 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:57:54.416359 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:54.416339 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qdkd2\"" Jul 09 16:57:54.422985 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:54.422959 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z"] Jul 09 16:57:54.565744 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:54.565714 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7j6f\" (UniqueName: \"kubernetes.io/projected/4cf68ef2-8ce6-4025-a141-3ad189f6d6e0-kube-api-access-m7j6f\") pod \"limitador-operator-controller-manager-859d7b78bd-vdr7z\" (UID: \"4cf68ef2-8ce6-4025-a141-3ad189f6d6e0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:57:54.666524 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:54.666443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7j6f\" (UniqueName: \"kubernetes.io/projected/4cf68ef2-8ce6-4025-a141-3ad189f6d6e0-kube-api-access-m7j6f\") pod \"limitador-operator-controller-manager-859d7b78bd-vdr7z\" (UID: \"4cf68ef2-8ce6-4025-a141-3ad189f6d6e0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:57:54.676757 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:54.676737 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7j6f\" (UniqueName: \"kubernetes.io/projected/4cf68ef2-8ce6-4025-a141-3ad189f6d6e0-kube-api-access-m7j6f\") pod \"limitador-operator-controller-manager-859d7b78bd-vdr7z\" (UID: \"4cf68ef2-8ce6-4025-a141-3ad189f6d6e0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:57:54.724453 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:54.724425 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:57:54.852565 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:54.852541 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z"] Jul 09 16:57:54.854403 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:57:54.854340 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf68ef2_8ce6_4025_a141_3ad189f6d6e0.slice/crio-24d06b4b59d26abeb8db09bb82bd80974bffbe5fb9d7fc5f8160b412c50f5031 WatchSource:0}: Error finding container 24d06b4b59d26abeb8db09bb82bd80974bffbe5fb9d7fc5f8160b412c50f5031: Status 404 returned error can't find the container with id 24d06b4b59d26abeb8db09bb82bd80974bffbe5fb9d7fc5f8160b412c50f5031 Jul 09 16:57:54.949266 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:54.949190 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:57:55.096510 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:55.096474 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:57:55.633247 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:55.633209 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" event={"ID":"4cf68ef2-8ce6-4025-a141-3ad189f6d6e0","Type":"ContainerStarted","Data":"24d06b4b59d26abeb8db09bb82bd80974bffbe5fb9d7fc5f8160b412c50f5031"} Jul 09 16:57:56.334031 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:56.333993 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:57:57.644849 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:57.644812 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" event={"ID":"4cf68ef2-8ce6-4025-a141-3ad189f6d6e0","Type":"ContainerStarted","Data":"d2936d3cb95439fef427fdd861783cfa70f33baa74e03ab858462f062001a1d4"} Jul 09 16:57:57.645292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:57.644889 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:57:57.667040 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:57.666993 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" podStartSLOduration=1.807879968 podStartE2EDuration="3.66697955s" totalImagesPullingTime="1.859099582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:57:57.665642047 +0000 UTC m=+446.708417299" watchObservedRunningTime="2026-07-09 16:57:57.66697955 +0000 UTC m=+446.709754867" Jul 09 16:57:59.294594 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:59.294557 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4"] Jul 09 16:57:59.297961 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:59.297945 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" Jul 09 16:57:59.303050 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:59.303029 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2jhst\"" Jul 09 16:57:59.312990 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:59.312968 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4"] Jul 09 16:57:59.405566 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:59.405526 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpb5w\" (UniqueName: \"kubernetes.io/projected/7269fd66-0963-40b0-86cd-3ef0fe243050-kube-api-access-zpb5w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4tsl4\" (UID: \"7269fd66-0963-40b0-86cd-3ef0fe243050\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" Jul 09 16:57:59.405697 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:59.405595 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7269fd66-0963-40b0-86cd-3ef0fe243050-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4tsl4\" (UID: \"7269fd66-0963-40b0-86cd-3ef0fe243050\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" Jul 09 16:57:59.495308 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:59.495281 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:57:59.506295 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:59.506268 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7269fd66-0963-40b0-86cd-3ef0fe243050-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4tsl4\" (UID: \"7269fd66-0963-40b0-86cd-3ef0fe243050\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" Jul 09 16:57:59.506458 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:59.506335 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpb5w\" (UniqueName: \"kubernetes.io/projected/7269fd66-0963-40b0-86cd-3ef0fe243050-kube-api-access-zpb5w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4tsl4\" (UID: \"7269fd66-0963-40b0-86cd-3ef0fe243050\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" Jul 09 16:57:59.506593 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:59.506573 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7269fd66-0963-40b0-86cd-3ef0fe243050-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4tsl4\" (UID: \"7269fd66-0963-40b0-86cd-3ef0fe243050\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" Jul 09 16:57:59.515639 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:59.515620 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpb5w\" (UniqueName: \"kubernetes.io/projected/7269fd66-0963-40b0-86cd-3ef0fe243050-kube-api-access-zpb5w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4tsl4\" (UID: \"7269fd66-0963-40b0-86cd-3ef0fe243050\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" Jul 09 16:57:59.607315 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:59.607250 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" Jul 09 16:57:59.748597 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:59.748572 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4"] Jul 09 16:57:59.750524 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:57:59.750495 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7269fd66_0963_40b0_86cd_3ef0fe243050.slice/crio-0fb0eadf783ae71358daf4cead05743181c5934fdf06a9ebaf824f4e66917061 WatchSource:0}: Error finding container 0fb0eadf783ae71358daf4cead05743181c5934fdf06a9ebaf824f4e66917061: Status 404 returned error can't find the container with id 0fb0eadf783ae71358daf4cead05743181c5934fdf06a9ebaf824f4e66917061 Jul 09 16:57:59.906400 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:57:59.906333 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:00.156698 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:00.156613 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:00.660247 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:00.660215 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" event={"ID":"7269fd66-0963-40b0-86cd-3ef0fe243050","Type":"ContainerStarted","Data":"0fb0eadf783ae71358daf4cead05743181c5934fdf06a9ebaf824f4e66917061"} Jul 09 16:58:02.491604 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:02.491568 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d4n8v"] Jul 09 16:58:02.494977 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:02.494960 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4n8v" Jul 09 16:58:02.497773 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:02.497751 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5m9vg\"" Jul 09 16:58:02.513841 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:02.513818 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d4n8v"] Jul 09 16:58:02.634534 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:02.634502 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kttqg\" (UniqueName: \"kubernetes.io/projected/c50db898-6890-4c10-9585-115d59cbb02b-kube-api-access-kttqg\") pod \"authorino-operator-75cc8d5cb7-d4n8v\" (UID: \"c50db898-6890-4c10-9585-115d59cbb02b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4n8v" Jul 09 16:58:02.735570 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:02.735535 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kttqg\" (UniqueName: \"kubernetes.io/projected/c50db898-6890-4c10-9585-115d59cbb02b-kube-api-access-kttqg\") pod \"authorino-operator-75cc8d5cb7-d4n8v\" (UID: \"c50db898-6890-4c10-9585-115d59cbb02b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4n8v" Jul 09 16:58:02.745191 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:02.745115 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kttqg\" (UniqueName: \"kubernetes.io/projected/c50db898-6890-4c10-9585-115d59cbb02b-kube-api-access-kttqg\") pod \"authorino-operator-75cc8d5cb7-d4n8v\" (UID: \"c50db898-6890-4c10-9585-115d59cbb02b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4n8v" Jul 09 16:58:02.805126 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:02.805090 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4n8v" Jul 09 16:58:02.926792 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:02.926697 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:02.955246 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:02.955212 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d4n8v"] Jul 09 16:58:02.957261 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:58:02.957236 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc50db898_6890_4c10_9585_115d59cbb02b.slice/crio-481c9c5c0bf95b7810f04a5d3f70f78888373f7d11ba2e56b85e9baa93338b74 WatchSource:0}: Error finding container 481c9c5c0bf95b7810f04a5d3f70f78888373f7d11ba2e56b85e9baa93338b74: Status 404 returned error can't find the container with id 481c9c5c0bf95b7810f04a5d3f70f78888373f7d11ba2e56b85e9baa93338b74 Jul 09 16:58:03.677810 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:03.677775 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4n8v" event={"ID":"c50db898-6890-4c10-9585-115d59cbb02b","Type":"ContainerStarted","Data":"481c9c5c0bf95b7810f04a5d3f70f78888373f7d11ba2e56b85e9baa93338b74"} Jul 09 16:58:04.315956 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:04.315840 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:04.457936 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:04.457898 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:04.630172 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:04.630141 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mwm7q" Jul 09 16:58:06.694694 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:06.694659 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4n8v" event={"ID":"c50db898-6890-4c10-9585-115d59cbb02b","Type":"ContainerStarted","Data":"e59346146b047a062703b6ee3d50dd11a33f8fba8fa1bdd0ee6795e4a2522555"} Jul 09 16:58:06.695120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:06.694723 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4n8v" Jul 09 16:58:06.696214 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:06.696195 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" event={"ID":"7269fd66-0963-40b0-86cd-3ef0fe243050","Type":"ContainerStarted","Data":"c65441f63b17d44dfb09f1371d8addd789571906e6a5255edbeeb82115d2c6bb"} Jul 09 16:58:06.696353 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:06.696343 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" Jul 09 16:58:06.714180 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:06.714139 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4n8v" podStartSLOduration=1.720403527 podStartE2EDuration="4.714126158s" totalImagesPullingTime="2.993722631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:58:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:06.712507575 +0000 UTC m=+455.755282826" watchObservedRunningTime="2026-07-09 16:58:06.714126158 +0000 UTC m=+455.756901407" Jul 09 16:58:06.736780 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:06.736729 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" podStartSLOduration=1.573879646 podStartE2EDuration="7.736714521s" totalImagesPullingTime="6.162834875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:06.734576461 +0000 UTC m=+455.777351710" watchObservedRunningTime="2026-07-09 16:58:06.736714521 +0000 UTC m=+455.779489771" Jul 09 16:58:08.105357 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:08.105313 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:08.209704 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:08.209672 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:08.651512 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:08.651484 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:58:08.719287 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:08.719252 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:09.119907 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:09.119817 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:11.510732 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:11.510699 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:11.608176 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:11.608140 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:17.702350 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:17.702320 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" Jul 09 16:58:17.702808 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:17.702459 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4n8v" Jul 09 16:58:19.508924 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.508886 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4"] Jul 09 16:58:19.509333 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.509067 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" podUID="7269fd66-0963-40b0-86cd-3ef0fe243050" containerName="manager" containerID="cri-o://c65441f63b17d44dfb09f1371d8addd789571906e6a5255edbeeb82115d2c6bb" gracePeriod=2 Jul 09 16:58:19.521468 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.521441 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4"] Jul 09 16:58:19.541108 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.541083 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z"] Jul 09 16:58:19.541281 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.541261 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" podUID="4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" containerName="manager" containerID="cri-o://d2936d3cb95439fef427fdd861783cfa70f33baa74e03ab858462f062001a1d4" gracePeriod=2 Jul 09 16:58:19.548187 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.548164 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4"] Jul 09 16:58:19.548770 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.548696 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7269fd66-0963-40b0-86cd-3ef0fe243050" containerName="manager" Jul 09 16:58:19.548770 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.548720 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7269fd66-0963-40b0-86cd-3ef0fe243050" containerName="manager" Jul 09 16:58:19.548920 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.548820 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7269fd66-0963-40b0-86cd-3ef0fe243050" containerName="manager" Jul 09 16:58:19.552335 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.552316 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z"] Jul 09 16:58:19.552435 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.552411 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" Jul 09 16:58:19.555114 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:58:19.555085 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vdr7z\" is forbidden: User \"system:node:ip-10-0-132-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-57.ec2.internal' and this object" podUID="4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:58:19.570066 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.570041 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4"] Jul 09 16:58:19.572501 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.572479 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rrwtm"] Jul 09 16:58:19.572832 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.572818 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" containerName="manager" Jul 09 16:58:19.572832 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.572831 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" containerName="manager" Jul 09 16:58:19.572964 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.572887 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" containerName="manager" Jul 09 16:58:19.576012 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.575979 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rrwtm" Jul 09 16:58:19.579896 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.579871 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3800ea90-23a7-4de3-8d3f-34e1506d7760-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mg7v4\" (UID: \"3800ea90-23a7-4de3-8d3f-34e1506d7760\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" Jul 09 16:58:19.579998 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.579900 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4sf2\" (UniqueName: \"kubernetes.io/projected/3800ea90-23a7-4de3-8d3f-34e1506d7760-kube-api-access-n4sf2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mg7v4\" (UID: \"3800ea90-23a7-4de3-8d3f-34e1506d7760\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" Jul 09 16:58:19.592900 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:58:19.592866 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vdr7z\" is forbidden: User \"system:node:ip-10-0-132-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-57.ec2.internal' and this object" podUID="4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:58:19.593732 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.593709 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rrwtm"] Jul 09 16:58:19.681650 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.681610 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3800ea90-23a7-4de3-8d3f-34e1506d7760-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mg7v4\" (UID: \"3800ea90-23a7-4de3-8d3f-34e1506d7760\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" Jul 09 16:58:19.681788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.681659 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4sf2\" (UniqueName: \"kubernetes.io/projected/3800ea90-23a7-4de3-8d3f-34e1506d7760-kube-api-access-n4sf2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mg7v4\" (UID: \"3800ea90-23a7-4de3-8d3f-34e1506d7760\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" Jul 09 16:58:19.681788 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.681698 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x576q\" (UniqueName: \"kubernetes.io/projected/7c25ce23-165d-42a6-9112-5da2682c3df5-kube-api-access-x576q\") pod \"limitador-operator-controller-manager-859d7b78bd-rrwtm\" (UID: \"7c25ce23-165d-42a6-9112-5da2682c3df5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rrwtm" Jul 09 16:58:19.681995 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.681971 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3800ea90-23a7-4de3-8d3f-34e1506d7760-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mg7v4\" (UID: \"3800ea90-23a7-4de3-8d3f-34e1506d7760\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" Jul 09 16:58:19.691590 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.691561 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4sf2\" (UniqueName: \"kubernetes.io/projected/3800ea90-23a7-4de3-8d3f-34e1506d7760-kube-api-access-n4sf2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mg7v4\" (UID: \"3800ea90-23a7-4de3-8d3f-34e1506d7760\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" Jul 09 16:58:19.763163 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.763101 2554 generic.go:356] "Generic (PLEG): container finished" podID="4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" containerID="d2936d3cb95439fef427fdd861783cfa70f33baa74e03ab858462f062001a1d4" exitCode=0 Jul 09 16:58:19.764607 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.764577 2554 generic.go:356] "Generic (PLEG): container finished" podID="7269fd66-0963-40b0-86cd-3ef0fe243050" containerID="c65441f63b17d44dfb09f1371d8addd789571906e6a5255edbeeb82115d2c6bb" exitCode=0 Jul 09 16:58:19.769011 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.768987 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb"] Jul 09 16:58:19.773270 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.773250 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" Jul 09 16:58:19.776040 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:58:19.776015 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vdr7z\" is forbidden: User \"system:node:ip-10-0-132-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-57.ec2.internal' and this object" podUID="4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:58:19.781496 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.781478 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" Jul 09 16:58:19.782121 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.782101 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x576q\" (UniqueName: \"kubernetes.io/projected/7c25ce23-165d-42a6-9112-5da2682c3df5-kube-api-access-x576q\") pod \"limitador-operator-controller-manager-859d7b78bd-rrwtm\" (UID: \"7c25ce23-165d-42a6-9112-5da2682c3df5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rrwtm" Jul 09 16:58:19.800503 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.800478 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb"] Jul 09 16:58:19.804078 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.804052 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x576q\" (UniqueName: \"kubernetes.io/projected/7c25ce23-165d-42a6-9112-5da2682c3df5-kube-api-access-x576q\") pod \"limitador-operator-controller-manager-859d7b78bd-rrwtm\" (UID: \"7c25ce23-165d-42a6-9112-5da2682c3df5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rrwtm" Jul 09 16:58:19.809736 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.809711 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:58:19.837449 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:58:19.837418 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vdr7z\" is forbidden: User \"system:node:ip-10-0-132-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-57.ec2.internal' and this object" podUID="4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:58:19.885325 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.885289 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7j6f\" (UniqueName: \"kubernetes.io/projected/4cf68ef2-8ce6-4025-a141-3ad189f6d6e0-kube-api-access-m7j6f\") pod \"4cf68ef2-8ce6-4025-a141-3ad189f6d6e0\" (UID: \"4cf68ef2-8ce6-4025-a141-3ad189f6d6e0\") " Jul 09 16:58:19.885508 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.885345 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7269fd66-0963-40b0-86cd-3ef0fe243050-extensions-socket-volume\") pod \"7269fd66-0963-40b0-86cd-3ef0fe243050\" (UID: \"7269fd66-0963-40b0-86cd-3ef0fe243050\") " Jul 09 16:58:19.885508 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.885453 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpb5w\" (UniqueName: \"kubernetes.io/projected/7269fd66-0963-40b0-86cd-3ef0fe243050-kube-api-access-zpb5w\") pod \"7269fd66-0963-40b0-86cd-3ef0fe243050\" (UID: \"7269fd66-0963-40b0-86cd-3ef0fe243050\") " Jul 09 16:58:19.886413 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.886352 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73bf48cc-9f6a-4644-a42f-3be27d6531c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w7qmb\" (UID: \"73bf48cc-9f6a-4644-a42f-3be27d6531c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" Jul 09 16:58:19.886524 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.886462 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7269fd66-0963-40b0-86cd-3ef0fe243050-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7269fd66-0963-40b0-86cd-3ef0fe243050" (UID: "7269fd66-0963-40b0-86cd-3ef0fe243050"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:58:19.886524 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.886474 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z5h8\" (UniqueName: \"kubernetes.io/projected/73bf48cc-9f6a-4644-a42f-3be27d6531c6-kube-api-access-6z5h8\") pod \"kuadrant-operator-controller-manager-86878c769f-w7qmb\" (UID: \"73bf48cc-9f6a-4644-a42f-3be27d6531c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" Jul 09 16:58:19.886636 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.886610 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7269fd66-0963-40b0-86cd-3ef0fe243050-extensions-socket-volume\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:58:19.887996 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.887973 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7269fd66-0963-40b0-86cd-3ef0fe243050-kube-api-access-zpb5w" (OuterVolumeSpecName: "kube-api-access-zpb5w") pod "7269fd66-0963-40b0-86cd-3ef0fe243050" (UID: "7269fd66-0963-40b0-86cd-3ef0fe243050"). InnerVolumeSpecName "kube-api-access-zpb5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:58:19.888096 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.888066 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cf68ef2-8ce6-4025-a141-3ad189f6d6e0-kube-api-access-m7j6f" (OuterVolumeSpecName: "kube-api-access-m7j6f") pod "4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" (UID: "4cf68ef2-8ce6-4025-a141-3ad189f6d6e0"). InnerVolumeSpecName "kube-api-access-m7j6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:58:19.941210 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.941179 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" Jul 09 16:58:19.957073 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.957050 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rrwtm" Jul 09 16:58:19.967502 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.967468 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:19.987537 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.987507 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73bf48cc-9f6a-4644-a42f-3be27d6531c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w7qmb\" (UID: \"73bf48cc-9f6a-4644-a42f-3be27d6531c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" Jul 09 16:58:19.987677 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.987580 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z5h8\" (UniqueName: \"kubernetes.io/projected/73bf48cc-9f6a-4644-a42f-3be27d6531c6-kube-api-access-6z5h8\") pod \"kuadrant-operator-controller-manager-86878c769f-w7qmb\" (UID: \"73bf48cc-9f6a-4644-a42f-3be27d6531c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" Jul 09 16:58:19.987677 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.987672 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpb5w\" (UniqueName: \"kubernetes.io/projected/7269fd66-0963-40b0-86cd-3ef0fe243050-kube-api-access-zpb5w\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:58:19.987802 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.987690 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7j6f\" (UniqueName: \"kubernetes.io/projected/4cf68ef2-8ce6-4025-a141-3ad189f6d6e0-kube-api-access-m7j6f\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:58:19.987978 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:19.987953 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73bf48cc-9f6a-4644-a42f-3be27d6531c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w7qmb\" (UID: \"73bf48cc-9f6a-4644-a42f-3be27d6531c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" Jul 09 16:58:20.003810 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.003748 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z5h8\" (UniqueName: \"kubernetes.io/projected/73bf48cc-9f6a-4644-a42f-3be27d6531c6-kube-api-access-6z5h8\") pod \"kuadrant-operator-controller-manager-86878c769f-w7qmb\" (UID: \"73bf48cc-9f6a-4644-a42f-3be27d6531c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" Jul 09 16:58:20.061104 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.061074 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:20.087412 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.087381 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" Jul 09 16:58:20.101283 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.101260 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4"] Jul 09 16:58:20.102287 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:58:20.102264 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3800ea90_23a7_4de3_8d3f_34e1506d7760.slice/crio-2181c7fba3f28ae0de0e829c065c2560ba917ff7f1ff5c0fa2d89acc3e1fbcbe WatchSource:0}: Error finding container 2181c7fba3f28ae0de0e829c065c2560ba917ff7f1ff5c0fa2d89acc3e1fbcbe: Status 404 returned error can't find the container with id 2181c7fba3f28ae0de0e829c065c2560ba917ff7f1ff5c0fa2d89acc3e1fbcbe Jul 09 16:58:20.126969 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.125737 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rrwtm"] Jul 09 16:58:20.127540 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:58:20.127316 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c25ce23_165d_42a6_9112_5da2682c3df5.slice/crio-2c432d7ec6084a1f356b531a69e6b2850d0ac101222797029f096e18d53992e6 WatchSource:0}: Error finding container 2c432d7ec6084a1f356b531a69e6b2850d0ac101222797029f096e18d53992e6: Status 404 returned error can't find the container with id 2c432d7ec6084a1f356b531a69e6b2850d0ac101222797029f096e18d53992e6 Jul 09 16:58:20.258938 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.258913 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb"] Jul 09 16:58:20.260912 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:58:20.260889 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73bf48cc_9f6a_4644_a42f_3be27d6531c6.slice/crio-284e5238a48be24951d96c4321e73e5aed1e542e8bb802926ba92872ed64c9b2 WatchSource:0}: Error finding container 284e5238a48be24951d96c4321e73e5aed1e542e8bb802926ba92872ed64c9b2: Status 404 returned error can't find the container with id 284e5238a48be24951d96c4321e73e5aed1e542e8bb802926ba92872ed64c9b2 Jul 09 16:58:20.693707 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.693668 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:20.771662 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.771628 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4tsl4" Jul 09 16:58:20.771843 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.771642 2554 scope.go:117] "RemoveContainer" containerID="c65441f63b17d44dfb09f1371d8addd789571906e6a5255edbeeb82115d2c6bb" Jul 09 16:58:20.773342 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.773316 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rrwtm" event={"ID":"7c25ce23-165d-42a6-9112-5da2682c3df5","Type":"ContainerStarted","Data":"8d25850c1c57db4c16acaef272f3e0929779f5d4134a579c654ed70fdb6bd6cd"} Jul 09 16:58:20.773480 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.773386 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rrwtm" Jul 09 16:58:20.773480 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.773414 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rrwtm" event={"ID":"7c25ce23-165d-42a6-9112-5da2682c3df5","Type":"ContainerStarted","Data":"2c432d7ec6084a1f356b531a69e6b2850d0ac101222797029f096e18d53992e6"} Jul 09 16:58:20.774472 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:58:20.774443 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vdr7z\" is forbidden: User \"system:node:ip-10-0-132-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-57.ec2.internal' and this object" podUID="4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:58:20.775160 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.775140 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" event={"ID":"3800ea90-23a7-4de3-8d3f-34e1506d7760","Type":"ContainerStarted","Data":"b9f51bfffc545f7010eee6bb40be79f693e1b631c155e159486da7031fc5cfda"} Jul 09 16:58:20.775260 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.775189 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" Jul 09 16:58:20.775260 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.775214 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" event={"ID":"3800ea90-23a7-4de3-8d3f-34e1506d7760","Type":"ContainerStarted","Data":"2181c7fba3f28ae0de0e829c065c2560ba917ff7f1ff5c0fa2d89acc3e1fbcbe"} Jul 09 16:58:20.776799 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:58:20.776765 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vdr7z\" is forbidden: User \"system:node:ip-10-0-132-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-57.ec2.internal' and this object" podUID="4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:58:20.776899 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.776832 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" event={"ID":"73bf48cc-9f6a-4644-a42f-3be27d6531c6","Type":"ContainerStarted","Data":"ca8d8e2fb9a0862fa10f2d4dca2328266e75dd10e37e4c20a5f67f41c71c7ccd"} Jul 09 16:58:20.776899 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.776870 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" event={"ID":"73bf48cc-9f6a-4644-a42f-3be27d6531c6","Type":"ContainerStarted","Data":"284e5238a48be24951d96c4321e73e5aed1e542e8bb802926ba92872ed64c9b2"} Jul 09 16:58:20.776899 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.776897 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" Jul 09 16:58:20.778292 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.778275 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:58:20.781830 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.781808 2554 scope.go:117] "RemoveContainer" containerID="d2936d3cb95439fef427fdd861783cfa70f33baa74e03ab858462f062001a1d4" Jul 09 16:58:20.796581 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.796522 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rrwtm" podStartSLOduration=1.7965084930000002 podStartE2EDuration="1.796508493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:20.794298534 +0000 UTC m=+469.837073783" watchObservedRunningTime="2026-07-09 16:58:20.796508493 +0000 UTC m=+469.839283745" Jul 09 16:58:20.796700 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:58:20.796639 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vdr7z\" is forbidden: User \"system:node:ip-10-0-132-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-57.ec2.internal' and this object" podUID="4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:58:20.824252 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.824206 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" podStartSLOduration=1.824192169 podStartE2EDuration="1.824192169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:20.82204607 +0000 UTC m=+469.864821320" watchObservedRunningTime="2026-07-09 16:58:20.824192169 +0000 UTC m=+469.866967419" Jul 09 16:58:20.845091 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:20.845042 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" podStartSLOduration=1.84502799 podStartE2EDuration="1.84502799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:20.843628549 +0000 UTC m=+469.886403799" watchObservedRunningTime="2026-07-09 16:58:20.84502799 +0000 UTC m=+469.887803240" Jul 09 16:58:21.538855 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:58:21.538823 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vdr7z\" is forbidden: User \"system:node:ip-10-0-132-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-57.ec2.internal' and this object" podUID="4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdr7z" Jul 09 16:58:21.540483 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:21.540460 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cf68ef2-8ce6-4025-a141-3ad189f6d6e0" path="/var/lib/kubelet/pods/4cf68ef2-8ce6-4025-a141-3ad189f6d6e0/volumes" Jul 09 16:58:21.540819 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:21.540807 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7269fd66-0963-40b0-86cd-3ef0fe243050" path="/var/lib/kubelet/pods/7269fd66-0963-40b0-86cd-3ef0fe243050/volumes" Jul 09 16:58:22.527888 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:22.527848 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:22.644510 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:22.644474 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:24.064495 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:24.064456 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:24.171798 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:24.171760 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:25.424607 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:25.424572 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:25.525285 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:25.525245 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:29.020523 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:29.020482 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:29.113599 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:29.113563 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:31.787566 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:31.787488 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rrwtm" Jul 09 16:58:31.787566 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:31.787566 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" Jul 09 16:58:31.788128 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:31.788103 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" Jul 09 16:58:31.891964 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:31.891933 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4"] Jul 09 16:58:31.892113 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:31.892088 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" podUID="3800ea90-23a7-4de3-8d3f-34e1506d7760" containerName="manager" containerID="cri-o://b9f51bfffc545f7010eee6bb40be79f693e1b631c155e159486da7031fc5cfda" gracePeriod=10 Jul 09 16:58:32.139023 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.139000 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" Jul 09 16:58:32.191519 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.191490 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3800ea90-23a7-4de3-8d3f-34e1506d7760-extensions-socket-volume\") pod \"3800ea90-23a7-4de3-8d3f-34e1506d7760\" (UID: \"3800ea90-23a7-4de3-8d3f-34e1506d7760\") " Jul 09 16:58:32.191712 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.191691 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4sf2\" (UniqueName: \"kubernetes.io/projected/3800ea90-23a7-4de3-8d3f-34e1506d7760-kube-api-access-n4sf2\") pod \"3800ea90-23a7-4de3-8d3f-34e1506d7760\" (UID: \"3800ea90-23a7-4de3-8d3f-34e1506d7760\") " Jul 09 16:58:32.192053 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.192028 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3800ea90-23a7-4de3-8d3f-34e1506d7760-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3800ea90-23a7-4de3-8d3f-34e1506d7760" (UID: "3800ea90-23a7-4de3-8d3f-34e1506d7760"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:58:32.192173 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.192154 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3800ea90-23a7-4de3-8d3f-34e1506d7760-extensions-socket-volume\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:58:32.194638 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.194608 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3800ea90-23a7-4de3-8d3f-34e1506d7760-kube-api-access-n4sf2" (OuterVolumeSpecName: "kube-api-access-n4sf2") pod "3800ea90-23a7-4de3-8d3f-34e1506d7760" (UID: "3800ea90-23a7-4de3-8d3f-34e1506d7760"). InnerVolumeSpecName "kube-api-access-n4sf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:58:32.293411 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.293359 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4sf2\" (UniqueName: \"kubernetes.io/projected/3800ea90-23a7-4de3-8d3f-34e1506d7760-kube-api-access-n4sf2\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:58:32.844040 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.844008 2554 generic.go:356] "Generic (PLEG): container finished" podID="3800ea90-23a7-4de3-8d3f-34e1506d7760" containerID="b9f51bfffc545f7010eee6bb40be79f693e1b631c155e159486da7031fc5cfda" exitCode=0 Jul 09 16:58:32.844485 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.844053 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" Jul 09 16:58:32.844485 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.844085 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" event={"ID":"3800ea90-23a7-4de3-8d3f-34e1506d7760","Type":"ContainerDied","Data":"b9f51bfffc545f7010eee6bb40be79f693e1b631c155e159486da7031fc5cfda"} Jul 09 16:58:32.844485 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.844138 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4" event={"ID":"3800ea90-23a7-4de3-8d3f-34e1506d7760","Type":"ContainerDied","Data":"2181c7fba3f28ae0de0e829c065c2560ba917ff7f1ff5c0fa2d89acc3e1fbcbe"} Jul 09 16:58:32.844485 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.844160 2554 scope.go:117] "RemoveContainer" containerID="b9f51bfffc545f7010eee6bb40be79f693e1b631c155e159486da7031fc5cfda" Jul 09 16:58:32.854213 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.854195 2554 scope.go:117] "RemoveContainer" containerID="b9f51bfffc545f7010eee6bb40be79f693e1b631c155e159486da7031fc5cfda" Jul 09 16:58:32.854504 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:58:32.854462 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9f51bfffc545f7010eee6bb40be79f693e1b631c155e159486da7031fc5cfda\": container with ID starting with b9f51bfffc545f7010eee6bb40be79f693e1b631c155e159486da7031fc5cfda not found: ID does not exist" containerID="b9f51bfffc545f7010eee6bb40be79f693e1b631c155e159486da7031fc5cfda" Jul 09 16:58:32.854560 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.854513 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f51bfffc545f7010eee6bb40be79f693e1b631c155e159486da7031fc5cfda"} err="failed to get container status \"b9f51bfffc545f7010eee6bb40be79f693e1b631c155e159486da7031fc5cfda\": rpc error: code = NotFound desc = could not find container \"b9f51bfffc545f7010eee6bb40be79f693e1b631c155e159486da7031fc5cfda\": container with ID starting with b9f51bfffc545f7010eee6bb40be79f693e1b631c155e159486da7031fc5cfda not found: ID does not exist" Jul 09 16:58:32.870677 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.870653 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4"] Jul 09 16:58:32.879162 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:32.879139 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mg7v4"] Jul 09 16:58:33.540101 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:33.540066 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3800ea90-23a7-4de3-8d3f-34e1506d7760" path="/var/lib/kubelet/pods/3800ea90-23a7-4de3-8d3f-34e1506d7760/volumes" Jul 09 16:58:35.597200 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:35.597159 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:37.941030 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:37.940995 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:38.042914 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:38.042880 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:40.614745 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:40.614712 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:40.711578 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:40.711519 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:42.760279 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:42.760245 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:43.624251 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:43.624218 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:43.724852 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:43.724813 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:47.224854 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:47.224802 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:47.290263 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:47.290233 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:48.255280 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:48.255250 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:48.442381 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:48.442325 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:50.225558 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.225524 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:50.225980 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.225894 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2xcqg"] Jul 09 16:58:50.226258 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.226245 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3800ea90-23a7-4de3-8d3f-34e1506d7760" containerName="manager" Jul 09 16:58:50.226311 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.226259 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3800ea90-23a7-4de3-8d3f-34e1506d7760" containerName="manager" Jul 09 16:58:50.226344 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.226330 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3800ea90-23a7-4de3-8d3f-34e1506d7760" containerName="manager" Jul 09 16:58:50.232237 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.232216 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" Jul 09 16:58:50.234878 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.234856 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7ms9p\"" Jul 09 16:58:50.235000 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.234901 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 16:58:50.238599 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.238582 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2xcqg"] Jul 09 16:58:50.319860 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.319828 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2xcqg"] Jul 09 16:58:50.322120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.322093 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:50.348992 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.348964 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/096a57a4-846f-45b5-94d3-02e16beaa8cc-config-file\") pod \"limitador-limitador-64c94fd64f-2xcqg\" (UID: \"096a57a4-846f-45b5-94d3-02e16beaa8cc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" Jul 09 16:58:50.349117 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.349042 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lwjz\" (UniqueName: \"kubernetes.io/projected/096a57a4-846f-45b5-94d3-02e16beaa8cc-kube-api-access-4lwjz\") pod \"limitador-limitador-64c94fd64f-2xcqg\" (UID: \"096a57a4-846f-45b5-94d3-02e16beaa8cc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" Jul 09 16:58:50.394740 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.394706 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:50.450217 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.450193 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lwjz\" (UniqueName: \"kubernetes.io/projected/096a57a4-846f-45b5-94d3-02e16beaa8cc-kube-api-access-4lwjz\") pod \"limitador-limitador-64c94fd64f-2xcqg\" (UID: \"096a57a4-846f-45b5-94d3-02e16beaa8cc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" Jul 09 16:58:50.450353 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.450241 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/096a57a4-846f-45b5-94d3-02e16beaa8cc-config-file\") pod \"limitador-limitador-64c94fd64f-2xcqg\" (UID: \"096a57a4-846f-45b5-94d3-02e16beaa8cc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" Jul 09 16:58:50.450894 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.450875 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/096a57a4-846f-45b5-94d3-02e16beaa8cc-config-file\") pod \"limitador-limitador-64c94fd64f-2xcqg\" (UID: \"096a57a4-846f-45b5-94d3-02e16beaa8cc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" Jul 09 16:58:50.458807 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.458786 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lwjz\" (UniqueName: \"kubernetes.io/projected/096a57a4-846f-45b5-94d3-02e16beaa8cc-kube-api-access-4lwjz\") pod \"limitador-limitador-64c94fd64f-2xcqg\" (UID: \"096a57a4-846f-45b5-94d3-02e16beaa8cc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" Jul 09 16:58:50.544215 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.544142 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" Jul 09 16:58:50.684966 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.684944 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2xcqg"] Jul 09 16:58:50.687445 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:58:50.687393 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod096a57a4_846f_45b5_94d3_02e16beaa8cc.slice/crio-e701ee2c67f3f43fc09e4bda31a7365daf03b1f6adb4c528eb12593883cc8773 WatchSource:0}: Error finding container e701ee2c67f3f43fc09e4bda31a7365daf03b1f6adb4c528eb12593883cc8773: Status 404 returned error can't find the container with id e701ee2c67f3f43fc09e4bda31a7365daf03b1f6adb4c528eb12593883cc8773 Jul 09 16:58:50.928920 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:50.928884 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" event={"ID":"096a57a4-846f-45b5-94d3-02e16beaa8cc","Type":"ContainerStarted","Data":"e701ee2c67f3f43fc09e4bda31a7365daf03b1f6adb4c528eb12593883cc8773"} Jul 09 16:58:51.138649 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:51.138615 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:51.197854 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:51.197765 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:53.946850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:53.946813 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" event={"ID":"096a57a4-846f-45b5-94d3-02e16beaa8cc","Type":"ContainerStarted","Data":"24b794cadfa3955632018fbbe03f499fa191981c81cdfc342f245e1da7ba1160"} Jul 09 16:58:53.947216 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:53.946897 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" Jul 09 16:58:53.964756 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:53.964713 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" podStartSLOduration=1.2320402910000001 podStartE2EDuration="3.964697469s" totalImagesPullingTime="2.732657178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:53.962294591 +0000 UTC m=+503.005069841" watchObservedRunningTime="2026-07-09 16:58:53.964697469 +0000 UTC m=+503.007472719" Jul 09 16:58:57.017211 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:57.017169 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:57.070591 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:57.070531 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:57.214670 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:57.214638 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:58:57.286485 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:58:57.286404 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:03.667260 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:03.667220 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:04.953205 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:04.953173 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" Jul 09 16:59:06.968689 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:06.968648 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2xcqg"] Jul 09 16:59:06.969130 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:06.968971 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" podUID="096a57a4-846f-45b5-94d3-02e16beaa8cc" containerName="limitador" containerID="cri-o://24b794cadfa3955632018fbbe03f499fa191981c81cdfc342f245e1da7ba1160" gracePeriod=30 Jul 09 16:59:07.528852 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:07.528793 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" Jul 09 16:59:07.600377 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:07.600347 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lwjz\" (UniqueName: \"kubernetes.io/projected/096a57a4-846f-45b5-94d3-02e16beaa8cc-kube-api-access-4lwjz\") pod \"096a57a4-846f-45b5-94d3-02e16beaa8cc\" (UID: \"096a57a4-846f-45b5-94d3-02e16beaa8cc\") " Jul 09 16:59:07.600546 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:07.600477 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/096a57a4-846f-45b5-94d3-02e16beaa8cc-config-file\") pod \"096a57a4-846f-45b5-94d3-02e16beaa8cc\" (UID: \"096a57a4-846f-45b5-94d3-02e16beaa8cc\") " Jul 09 16:59:07.600839 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:07.600817 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/096a57a4-846f-45b5-94d3-02e16beaa8cc-config-file" (OuterVolumeSpecName: "config-file") pod "096a57a4-846f-45b5-94d3-02e16beaa8cc" (UID: "096a57a4-846f-45b5-94d3-02e16beaa8cc"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:59:07.602451 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:07.602428 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/096a57a4-846f-45b5-94d3-02e16beaa8cc-kube-api-access-4lwjz" (OuterVolumeSpecName: "kube-api-access-4lwjz") pod "096a57a4-846f-45b5-94d3-02e16beaa8cc" (UID: "096a57a4-846f-45b5-94d3-02e16beaa8cc"). InnerVolumeSpecName "kube-api-access-4lwjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:59:07.701735 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:07.701696 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lwjz\" (UniqueName: \"kubernetes.io/projected/096a57a4-846f-45b5-94d3-02e16beaa8cc-kube-api-access-4lwjz\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:59:07.701735 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:07.701735 2554 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/096a57a4-846f-45b5-94d3-02e16beaa8cc-config-file\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:59:08.015275 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:08.015232 2554 generic.go:356] "Generic (PLEG): container finished" podID="096a57a4-846f-45b5-94d3-02e16beaa8cc" containerID="24b794cadfa3955632018fbbe03f499fa191981c81cdfc342f245e1da7ba1160" exitCode=0 Jul 09 16:59:08.015808 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:08.015284 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" Jul 09 16:59:08.015808 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:08.015312 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" event={"ID":"096a57a4-846f-45b5-94d3-02e16beaa8cc","Type":"ContainerDied","Data":"24b794cadfa3955632018fbbe03f499fa191981c81cdfc342f245e1da7ba1160"} Jul 09 16:59:08.015808 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:08.015386 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2xcqg" event={"ID":"096a57a4-846f-45b5-94d3-02e16beaa8cc","Type":"ContainerDied","Data":"e701ee2c67f3f43fc09e4bda31a7365daf03b1f6adb4c528eb12593883cc8773"} Jul 09 16:59:08.015808 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:08.015404 2554 scope.go:117] "RemoveContainer" containerID="24b794cadfa3955632018fbbe03f499fa191981c81cdfc342f245e1da7ba1160" Jul 09 16:59:08.025382 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:08.025349 2554 scope.go:117] "RemoveContainer" containerID="24b794cadfa3955632018fbbe03f499fa191981c81cdfc342f245e1da7ba1160" Jul 09 16:59:08.025605 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:59:08.025584 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24b794cadfa3955632018fbbe03f499fa191981c81cdfc342f245e1da7ba1160\": container with ID starting with 24b794cadfa3955632018fbbe03f499fa191981c81cdfc342f245e1da7ba1160 not found: ID does not exist" containerID="24b794cadfa3955632018fbbe03f499fa191981c81cdfc342f245e1da7ba1160" Jul 09 16:59:08.025646 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:08.025621 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24b794cadfa3955632018fbbe03f499fa191981c81cdfc342f245e1da7ba1160"} err="failed to get container status \"24b794cadfa3955632018fbbe03f499fa191981c81cdfc342f245e1da7ba1160\": rpc error: code = NotFound desc = could not find container \"24b794cadfa3955632018fbbe03f499fa191981c81cdfc342f245e1da7ba1160\": container with ID starting with 24b794cadfa3955632018fbbe03f499fa191981c81cdfc342f245e1da7ba1160 not found: ID does not exist" Jul 09 16:59:08.037691 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:08.037666 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2xcqg"] Jul 09 16:59:08.040921 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:08.040902 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2xcqg"] Jul 09 16:59:09.539719 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:09.539682 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="096a57a4-846f-45b5-94d3-02e16beaa8cc" path="/var/lib/kubelet/pods/096a57a4-846f-45b5-94d3-02e16beaa8cc/volumes" Jul 09 16:59:11.467699 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.467648 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:11.584796 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.584757 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:11.903850 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.903821 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb"] Jul 09 16:59:11.904270 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.904249 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="096a57a4-846f-45b5-94d3-02e16beaa8cc" containerName="limitador" Jul 09 16:59:11.904270 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.904270 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="096a57a4-846f-45b5-94d3-02e16beaa8cc" containerName="limitador" Jul 09 16:59:11.904416 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.904401 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="096a57a4-846f-45b5-94d3-02e16beaa8cc" containerName="limitador" Jul 09 16:59:11.908915 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.908893 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb" Jul 09 16:59:11.911734 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.911691 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-bbxhn\"" Jul 09 16:59:11.911868 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.911691 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 09 16:59:11.911868 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.911775 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 16:59:11.912028 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.912011 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 16:59:11.917248 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.917220 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb"] Jul 09 16:59:11.935921 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.935892 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/70de4996-7cb6-4dc0-bd52-b7f373c52148-data\") pod \"postgres-69fb4594cf-fhqlb\" (UID: \"70de4996-7cb6-4dc0-bd52-b7f373c52148\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb" Jul 09 16:59:11.936033 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.935961 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mxmj\" (UniqueName: \"kubernetes.io/projected/70de4996-7cb6-4dc0-bd52-b7f373c52148-kube-api-access-7mxmj\") pod \"postgres-69fb4594cf-fhqlb\" (UID: \"70de4996-7cb6-4dc0-bd52-b7f373c52148\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb" Jul 09 16:59:11.942488 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:11.942388 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:12.036998 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:12.036971 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mxmj\" (UniqueName: \"kubernetes.io/projected/70de4996-7cb6-4dc0-bd52-b7f373c52148-kube-api-access-7mxmj\") pod \"postgres-69fb4594cf-fhqlb\" (UID: \"70de4996-7cb6-4dc0-bd52-b7f373c52148\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb" Jul 09 16:59:12.037254 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:12.037234 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/70de4996-7cb6-4dc0-bd52-b7f373c52148-data\") pod \"postgres-69fb4594cf-fhqlb\" (UID: \"70de4996-7cb6-4dc0-bd52-b7f373c52148\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb" Jul 09 16:59:12.037579 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:12.037563 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/70de4996-7cb6-4dc0-bd52-b7f373c52148-data\") pod \"postgres-69fb4594cf-fhqlb\" (UID: \"70de4996-7cb6-4dc0-bd52-b7f373c52148\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb" Jul 09 16:59:12.045441 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:12.045424 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mxmj\" (UniqueName: \"kubernetes.io/projected/70de4996-7cb6-4dc0-bd52-b7f373c52148-kube-api-access-7mxmj\") pod \"postgres-69fb4594cf-fhqlb\" (UID: \"70de4996-7cb6-4dc0-bd52-b7f373c52148\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb" Jul 09 16:59:12.222435 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:12.222335 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb" Jul 09 16:59:12.359971 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:12.359943 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb"] Jul 09 16:59:12.361904 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:59:12.361877 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70de4996_7cb6_4dc0_bd52_b7f373c52148.slice/crio-230e09a02ea55985225b420c393ce012e258d859d943452c27fa8a40a26ef4d5 WatchSource:0}: Error finding container 230e09a02ea55985225b420c393ce012e258d859d943452c27fa8a40a26ef4d5: Status 404 returned error can't find the container with id 230e09a02ea55985225b420c393ce012e258d859d943452c27fa8a40a26ef4d5 Jul 09 16:59:13.040910 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:13.040878 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb" event={"ID":"70de4996-7cb6-4dc0-bd52-b7f373c52148","Type":"ContainerStarted","Data":"230e09a02ea55985225b420c393ce012e258d859d943452c27fa8a40a26ef4d5"} Jul 09 16:59:18.069667 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:18.069631 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb" event={"ID":"70de4996-7cb6-4dc0-bd52-b7f373c52148","Type":"ContainerStarted","Data":"ad1857f016ec9b69cdc10f1a066281eda8c44aafd2c320a9e270a92026a34a5e"} Jul 09 16:59:18.070021 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:18.069710 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb" Jul 09 16:59:18.086741 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:18.086700 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb" podStartSLOduration=2.219154634 podStartE2EDuration="7.086688393s" totalImagesPullingTime="4.867533759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:59:18.085347385 +0000 UTC m=+527.128122634" watchObservedRunningTime="2026-07-09 16:59:18.086688393 +0000 UTC m=+527.129463643" Jul 09 16:59:24.105521 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:24.105445 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fhqlb" Jul 09 16:59:24.404784 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:24.404745 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:24.600358 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:24.600315 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:30.335004 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.334968 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:30.336874 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.336848 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9978fc6dd-8w622"] Jul 09 16:59:30.361669 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.361635 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9978fc6dd-8w622"] Jul 09 16:59:30.361822 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.361756 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9978fc6dd-8w622" Jul 09 16:59:30.364576 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.364555 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-klqnd\"" Jul 09 16:59:30.364700 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.364619 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 09 16:59:30.364700 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.364561 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 09 16:59:30.426218 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.426184 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:30.495219 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.495187 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:30.499702 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.499679 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66d8c97569-xl5p5"] Jul 09 16:59:30.501860 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.501839 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjq5g\" (UniqueName: \"kubernetes.io/projected/77c14675-59f8-4666-8b9b-9896b026fe28-kube-api-access-pjq5g\") pod \"maas-controller-9978fc6dd-8w622\" (UID: \"77c14675-59f8-4666-8b9b-9896b026fe28\") " pod="opendatahub/maas-controller-9978fc6dd-8w622" Jul 09 16:59:30.501982 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.501882 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77c14675-59f8-4666-8b9b-9896b026fe28-webhook-cert\") pod \"maas-controller-9978fc6dd-8w622\" (UID: \"77c14675-59f8-4666-8b9b-9896b026fe28\") " pod="opendatahub/maas-controller-9978fc6dd-8w622" Jul 09 16:59:30.503221 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.503205 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66d8c97569-xl5p5" Jul 09 16:59:30.512580 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.512554 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66d8c97569-xl5p5"] Jul 09 16:59:30.603199 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.603122 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjq5g\" (UniqueName: \"kubernetes.io/projected/77c14675-59f8-4666-8b9b-9896b026fe28-kube-api-access-pjq5g\") pod \"maas-controller-9978fc6dd-8w622\" (UID: \"77c14675-59f8-4666-8b9b-9896b026fe28\") " pod="opendatahub/maas-controller-9978fc6dd-8w622" Jul 09 16:59:30.603199 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.603157 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jzcj\" (UniqueName: \"kubernetes.io/projected/1bb8fa88-702e-46dd-8d93-8e70928dba9f-kube-api-access-2jzcj\") pod \"maas-controller-66d8c97569-xl5p5\" (UID: \"1bb8fa88-702e-46dd-8d93-8e70928dba9f\") " pod="opendatahub/maas-controller-66d8c97569-xl5p5" Jul 09 16:59:30.603199 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.603190 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77c14675-59f8-4666-8b9b-9896b026fe28-webhook-cert\") pod \"maas-controller-9978fc6dd-8w622\" (UID: \"77c14675-59f8-4666-8b9b-9896b026fe28\") " pod="opendatahub/maas-controller-9978fc6dd-8w622" Jul 09 16:59:30.603472 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.603324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bb8fa88-702e-46dd-8d93-8e70928dba9f-webhook-cert\") pod \"maas-controller-66d8c97569-xl5p5\" (UID: \"1bb8fa88-702e-46dd-8d93-8e70928dba9f\") " pod="opendatahub/maas-controller-66d8c97569-xl5p5" Jul 09 16:59:30.605526 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.605502 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77c14675-59f8-4666-8b9b-9896b026fe28-webhook-cert\") pod \"maas-controller-9978fc6dd-8w622\" (UID: \"77c14675-59f8-4666-8b9b-9896b026fe28\") " pod="opendatahub/maas-controller-9978fc6dd-8w622" Jul 09 16:59:30.609212 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.609177 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:30.611111 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.611094 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjq5g\" (UniqueName: \"kubernetes.io/projected/77c14675-59f8-4666-8b9b-9896b026fe28-kube-api-access-pjq5g\") pod \"maas-controller-9978fc6dd-8w622\" (UID: \"77c14675-59f8-4666-8b9b-9896b026fe28\") " pod="opendatahub/maas-controller-9978fc6dd-8w622" Jul 09 16:59:30.674064 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.674037 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9978fc6dd-8w622" Jul 09 16:59:30.704057 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.704028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jzcj\" (UniqueName: \"kubernetes.io/projected/1bb8fa88-702e-46dd-8d93-8e70928dba9f-kube-api-access-2jzcj\") pod \"maas-controller-66d8c97569-xl5p5\" (UID: \"1bb8fa88-702e-46dd-8d93-8e70928dba9f\") " pod="opendatahub/maas-controller-66d8c97569-xl5p5" Jul 09 16:59:30.704168 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.704136 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bb8fa88-702e-46dd-8d93-8e70928dba9f-webhook-cert\") pod \"maas-controller-66d8c97569-xl5p5\" (UID: \"1bb8fa88-702e-46dd-8d93-8e70928dba9f\") " pod="opendatahub/maas-controller-66d8c97569-xl5p5" Jul 09 16:59:30.706274 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.706251 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bb8fa88-702e-46dd-8d93-8e70928dba9f-webhook-cert\") pod \"maas-controller-66d8c97569-xl5p5\" (UID: \"1bb8fa88-702e-46dd-8d93-8e70928dba9f\") " pod="opendatahub/maas-controller-66d8c97569-xl5p5" Jul 09 16:59:30.712792 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.712773 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jzcj\" (UniqueName: \"kubernetes.io/projected/1bb8fa88-702e-46dd-8d93-8e70928dba9f-kube-api-access-2jzcj\") pod \"maas-controller-66d8c97569-xl5p5\" (UID: \"1bb8fa88-702e-46dd-8d93-8e70928dba9f\") " pod="opendatahub/maas-controller-66d8c97569-xl5p5" Jul 09 16:59:30.806120 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.806091 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9978fc6dd-8w622"] Jul 09 16:59:30.807235 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:59:30.807205 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c14675_59f8_4666_8b9b_9896b026fe28.slice/crio-8fb4effaebfd8b16699cccc67d6957237be9ec970aa6287516ade8b78dc3f513 WatchSource:0}: Error finding container 8fb4effaebfd8b16699cccc67d6957237be9ec970aa6287516ade8b78dc3f513: Status 404 returned error can't find the container with id 8fb4effaebfd8b16699cccc67d6957237be9ec970aa6287516ade8b78dc3f513 Jul 09 16:59:30.814436 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.814416 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66d8c97569-xl5p5" Jul 09 16:59:30.944267 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:30.944240 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66d8c97569-xl5p5"] Jul 09 16:59:30.946247 ip-10-0-132-57 kubenswrapper[2554]: W0709 16:59:30.946219 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb8fa88_702e_46dd_8d93_8e70928dba9f.slice/crio-550b00f83168c72de54045f17ed29874ebe598b8a42e60e796370c9b9697454b WatchSource:0}: Error finding container 550b00f83168c72de54045f17ed29874ebe598b8a42e60e796370c9b9697454b: Status 404 returned error can't find the container with id 550b00f83168c72de54045f17ed29874ebe598b8a42e60e796370c9b9697454b Jul 09 16:59:31.140692 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:31.140660 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9978fc6dd-8w622" event={"ID":"77c14675-59f8-4666-8b9b-9896b026fe28","Type":"ContainerStarted","Data":"8fb4effaebfd8b16699cccc67d6957237be9ec970aa6287516ade8b78dc3f513"} Jul 09 16:59:31.141880 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:31.141858 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66d8c97569-xl5p5" event={"ID":"1bb8fa88-702e-46dd-8d93-8e70928dba9f","Type":"ContainerStarted","Data":"550b00f83168c72de54045f17ed29874ebe598b8a42e60e796370c9b9697454b"} Jul 09 16:59:33.684296 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:33.684266 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 09 16:59:33.914130 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:33.914088 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:34.009156 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:34.009073 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:34.161177 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:34.161142 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9978fc6dd-8w622" event={"ID":"77c14675-59f8-4666-8b9b-9896b026fe28","Type":"ContainerStarted","Data":"85b918d8f0c6de4ff6064b5d38b60120829999d84f77c943d2030e3fbc08454f"} Jul 09 16:59:34.161357 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:34.161216 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9978fc6dd-8w622" Jul 09 16:59:34.162652 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:34.162634 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66d8c97569-xl5p5" event={"ID":"1bb8fa88-702e-46dd-8d93-8e70928dba9f","Type":"ContainerStarted","Data":"16a9faac375f83389ed864382cb0a893c3c30bb83948b7e6c2811a1033ce5cbc"} Jul 09 16:59:34.162779 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:34.162764 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66d8c97569-xl5p5" Jul 09 16:59:34.178804 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:34.178754 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9978fc6dd-8w622" podStartSLOduration=1.298882634 podStartE2EDuration="4.178742181s" totalImagesPullingTime="2.879859547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:59:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:59:34.177467169 +0000 UTC m=+543.220242421" watchObservedRunningTime="2026-07-09 16:59:34.178742181 +0000 UTC m=+543.221517431" Jul 09 16:59:34.202387 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:34.202327 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-66d8c97569-xl5p5" podStartSLOduration=1.468465876 podStartE2EDuration="4.202314651s" totalImagesPullingTime="2.733848775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:59:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:59:34.199559213 +0000 UTC m=+543.242334463" watchObservedRunningTime="2026-07-09 16:59:34.202314651 +0000 UTC m=+543.245089901" Jul 09 16:59:34.422246 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:34.422219 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:34.522167 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:34.522136 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:45.172306 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:45.172254 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66d8c97569-xl5p5" Jul 09 16:59:45.172702 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:45.172433 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9978fc6dd-8w622" Jul 09 16:59:45.230717 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:45.230683 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9978fc6dd-8w622"] Jul 09 16:59:45.230915 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:45.230875 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9978fc6dd-8w622" podUID="77c14675-59f8-4666-8b9b-9896b026fe28" containerName="manager" containerID="cri-o://85b918d8f0c6de4ff6064b5d38b60120829999d84f77c943d2030e3fbc08454f" gracePeriod=30 Jul 09 16:59:45.478010 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:45.477981 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9978fc6dd-8w622" Jul 09 16:59:45.627111 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:45.627083 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjq5g\" (UniqueName: \"kubernetes.io/projected/77c14675-59f8-4666-8b9b-9896b026fe28-kube-api-access-pjq5g\") pod \"77c14675-59f8-4666-8b9b-9896b026fe28\" (UID: \"77c14675-59f8-4666-8b9b-9896b026fe28\") " Jul 09 16:59:45.627111 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:45.627113 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77c14675-59f8-4666-8b9b-9896b026fe28-webhook-cert\") pod \"77c14675-59f8-4666-8b9b-9896b026fe28\" (UID: \"77c14675-59f8-4666-8b9b-9896b026fe28\") " Jul 09 16:59:45.629253 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:45.629227 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77c14675-59f8-4666-8b9b-9896b026fe28-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "77c14675-59f8-4666-8b9b-9896b026fe28" (UID: "77c14675-59f8-4666-8b9b-9896b026fe28"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:59:45.629354 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:45.629259 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77c14675-59f8-4666-8b9b-9896b026fe28-kube-api-access-pjq5g" (OuterVolumeSpecName: "kube-api-access-pjq5g") pod "77c14675-59f8-4666-8b9b-9896b026fe28" (UID: "77c14675-59f8-4666-8b9b-9896b026fe28"). InnerVolumeSpecName "kube-api-access-pjq5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:59:45.728394 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:45.728295 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjq5g\" (UniqueName: \"kubernetes.io/projected/77c14675-59f8-4666-8b9b-9896b026fe28-kube-api-access-pjq5g\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:59:45.728394 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:45.728323 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77c14675-59f8-4666-8b9b-9896b026fe28-webhook-cert\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 16:59:46.222725 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:46.222692 2554 generic.go:356] "Generic (PLEG): container finished" podID="77c14675-59f8-4666-8b9b-9896b026fe28" containerID="85b918d8f0c6de4ff6064b5d38b60120829999d84f77c943d2030e3fbc08454f" exitCode=0 Jul 09 16:59:46.223105 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:46.222739 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9978fc6dd-8w622" Jul 09 16:59:46.223105 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:46.222781 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9978fc6dd-8w622" event={"ID":"77c14675-59f8-4666-8b9b-9896b026fe28","Type":"ContainerDied","Data":"85b918d8f0c6de4ff6064b5d38b60120829999d84f77c943d2030e3fbc08454f"} Jul 09 16:59:46.223105 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:46.222837 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9978fc6dd-8w622" event={"ID":"77c14675-59f8-4666-8b9b-9896b026fe28","Type":"ContainerDied","Data":"8fb4effaebfd8b16699cccc67d6957237be9ec970aa6287516ade8b78dc3f513"} Jul 09 16:59:46.223105 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:46.222865 2554 scope.go:117] "RemoveContainer" containerID="85b918d8f0c6de4ff6064b5d38b60120829999d84f77c943d2030e3fbc08454f" Jul 09 16:59:46.232434 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:46.232237 2554 scope.go:117] "RemoveContainer" containerID="85b918d8f0c6de4ff6064b5d38b60120829999d84f77c943d2030e3fbc08454f" Jul 09 16:59:46.232520 ip-10-0-132-57 kubenswrapper[2554]: E0709 16:59:46.232500 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85b918d8f0c6de4ff6064b5d38b60120829999d84f77c943d2030e3fbc08454f\": container with ID starting with 85b918d8f0c6de4ff6064b5d38b60120829999d84f77c943d2030e3fbc08454f not found: ID does not exist" containerID="85b918d8f0c6de4ff6064b5d38b60120829999d84f77c943d2030e3fbc08454f" Jul 09 16:59:46.232558 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:46.232530 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b918d8f0c6de4ff6064b5d38b60120829999d84f77c943d2030e3fbc08454f"} err="failed to get container status \"85b918d8f0c6de4ff6064b5d38b60120829999d84f77c943d2030e3fbc08454f\": rpc error: code = NotFound desc = could not find container \"85b918d8f0c6de4ff6064b5d38b60120829999d84f77c943d2030e3fbc08454f\": container with ID starting with 85b918d8f0c6de4ff6064b5d38b60120829999d84f77c943d2030e3fbc08454f not found: ID does not exist" Jul 09 16:59:46.245478 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:46.245454 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9978fc6dd-8w622"] Jul 09 16:59:46.249590 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:46.249569 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9978fc6dd-8w622"] Jul 09 16:59:47.539828 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:47.539795 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77c14675-59f8-4666-8b9b-9896b026fe28" path="/var/lib/kubelet/pods/77c14675-59f8-4666-8b9b-9896b026fe28/volumes" Jul 09 16:59:57.355997 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:57.355956 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 16:59:57.411043 ip-10-0-132-57 kubenswrapper[2554]: I0709 16:59:57.411011 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:06.298514 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.298478 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:06.807537 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.807493 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:06.870314 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.870276 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-66574c666d-9x56k"] Jul 09 17:00:06.870744 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.870729 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c14675-59f8-4666-8b9b-9896b026fe28" containerName="manager" Jul 09 17:00:06.870744 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.870745 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c14675-59f8-4666-8b9b-9896b026fe28" containerName="manager" Jul 09 17:00:06.870859 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.870821 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="77c14675-59f8-4666-8b9b-9896b026fe28" containerName="manager" Jul 09 17:00:06.876089 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.876066 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" Jul 09 17:00:06.878984 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.878960 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 09 17:00:06.879095 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.878972 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-whstr\"" Jul 09 17:00:06.886626 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.886594 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-66574c666d-9x56k"] Jul 09 17:00:06.893267 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.893240 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b7bea53-2681-4e90-806b-86fca95c17ca-openshift-service-ca\") pod \"maas-api-66574c666d-9x56k\" (UID: \"5b7bea53-2681-4e90-806b-86fca95c17ca\") " pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" Jul 09 17:00:06.893404 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.893287 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfhgt\" (UniqueName: \"kubernetes.io/projected/5b7bea53-2681-4e90-806b-86fca95c17ca-kube-api-access-xfhgt\") pod \"maas-api-66574c666d-9x56k\" (UID: \"5b7bea53-2681-4e90-806b-86fca95c17ca\") " pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" Jul 09 17:00:06.893404 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.893309 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b7bea53-2681-4e90-806b-86fca95c17ca-maas-api-tls\") pod \"maas-api-66574c666d-9x56k\" (UID: \"5b7bea53-2681-4e90-806b-86fca95c17ca\") " pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" Jul 09 17:00:06.994572 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.994535 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfhgt\" (UniqueName: \"kubernetes.io/projected/5b7bea53-2681-4e90-806b-86fca95c17ca-kube-api-access-xfhgt\") pod \"maas-api-66574c666d-9x56k\" (UID: \"5b7bea53-2681-4e90-806b-86fca95c17ca\") " pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" Jul 09 17:00:06.994765 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.994581 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b7bea53-2681-4e90-806b-86fca95c17ca-maas-api-tls\") pod \"maas-api-66574c666d-9x56k\" (UID: \"5b7bea53-2681-4e90-806b-86fca95c17ca\") " pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" Jul 09 17:00:06.994765 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.994687 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b7bea53-2681-4e90-806b-86fca95c17ca-openshift-service-ca\") pod \"maas-api-66574c666d-9x56k\" (UID: \"5b7bea53-2681-4e90-806b-86fca95c17ca\") " pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" Jul 09 17:00:06.995317 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.995294 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b7bea53-2681-4e90-806b-86fca95c17ca-openshift-service-ca\") pod \"maas-api-66574c666d-9x56k\" (UID: \"5b7bea53-2681-4e90-806b-86fca95c17ca\") " pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" Jul 09 17:00:06.997146 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:06.997122 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b7bea53-2681-4e90-806b-86fca95c17ca-maas-api-tls\") pod \"maas-api-66574c666d-9x56k\" (UID: \"5b7bea53-2681-4e90-806b-86fca95c17ca\") " pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" Jul 09 17:00:07.003408 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.003389 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfhgt\" (UniqueName: \"kubernetes.io/projected/5b7bea53-2681-4e90-806b-86fca95c17ca-kube-api-access-xfhgt\") pod \"maas-api-66574c666d-9x56k\" (UID: \"5b7bea53-2681-4e90-806b-86fca95c17ca\") " pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" Jul 09 17:00:07.037234 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.037203 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:07.187815 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.187781 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" Jul 09 17:00:07.229102 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.229070 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:07.344913 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.344302 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-j7fk7"] Jul 09 17:00:07.350279 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.350252 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-j7fk7" Jul 09 17:00:07.354028 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.353614 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-l6sqb\"" Jul 09 17:00:07.354028 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.353916 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 09 17:00:07.356692 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.356665 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-j7fk7"] Jul 09 17:00:07.379529 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.379498 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-66574c666d-9x56k"] Jul 09 17:00:07.382322 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:00:07.382288 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7bea53_2681_4e90_806b_86fca95c17ca.slice/crio-973cfb9273770cf4aca9768383e7f0300e9f77000fa4409f26c53f7d595be206 WatchSource:0}: Error finding container 973cfb9273770cf4aca9768383e7f0300e9f77000fa4409f26c53f7d595be206: Status 404 returned error can't find the container with id 973cfb9273770cf4aca9768383e7f0300e9f77000fa4409f26c53f7d595be206 Jul 09 17:00:07.398468 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.398440 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lhv4\" (UniqueName: \"kubernetes.io/projected/b04c49dc-05e4-4c15-a771-29fe9c60c188-kube-api-access-2lhv4\") pod \"payload-pre-processing-7964457696-j7fk7\" (UID: \"b04c49dc-05e4-4c15-a771-29fe9c60c188\") " pod="openshift-ingress/payload-pre-processing-7964457696-j7fk7" Jul 09 17:00:07.398609 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.398493 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b04c49dc-05e4-4c15-a771-29fe9c60c188-plugins-config-volume\") pod \"payload-pre-processing-7964457696-j7fk7\" (UID: \"b04c49dc-05e4-4c15-a771-29fe9c60c188\") " pod="openshift-ingress/payload-pre-processing-7964457696-j7fk7" Jul 09 17:00:07.500077 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.499972 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b04c49dc-05e4-4c15-a771-29fe9c60c188-plugins-config-volume\") pod \"payload-pre-processing-7964457696-j7fk7\" (UID: \"b04c49dc-05e4-4c15-a771-29fe9c60c188\") " pod="openshift-ingress/payload-pre-processing-7964457696-j7fk7" Jul 09 17:00:07.500236 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.500090 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lhv4\" (UniqueName: \"kubernetes.io/projected/b04c49dc-05e4-4c15-a771-29fe9c60c188-kube-api-access-2lhv4\") pod \"payload-pre-processing-7964457696-j7fk7\" (UID: \"b04c49dc-05e4-4c15-a771-29fe9c60c188\") " pod="openshift-ingress/payload-pre-processing-7964457696-j7fk7" Jul 09 17:00:07.500965 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.500941 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b04c49dc-05e4-4c15-a771-29fe9c60c188-plugins-config-volume\") pod \"payload-pre-processing-7964457696-j7fk7\" (UID: \"b04c49dc-05e4-4c15-a771-29fe9c60c188\") " pod="openshift-ingress/payload-pre-processing-7964457696-j7fk7" Jul 09 17:00:07.508748 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.508720 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lhv4\" (UniqueName: \"kubernetes.io/projected/b04c49dc-05e4-4c15-a771-29fe9c60c188-kube-api-access-2lhv4\") pod \"payload-pre-processing-7964457696-j7fk7\" (UID: \"b04c49dc-05e4-4c15-a771-29fe9c60c188\") " pod="openshift-ingress/payload-pre-processing-7964457696-j7fk7" Jul 09 17:00:07.665362 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.665324 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-j7fk7" Jul 09 17:00:07.804829 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.804803 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-j7fk7"] Jul 09 17:00:07.807435 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:00:07.807405 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04c49dc_05e4_4c15_a771_29fe9c60c188.slice/crio-b15e82cb012682b2d23a4c5c44717fbdce54ba8e64382716b5693568c8d14d2a WatchSource:0}: Error finding container b15e82cb012682b2d23a4c5c44717fbdce54ba8e64382716b5693568c8d14d2a: Status 404 returned error can't find the container with id b15e82cb012682b2d23a4c5c44717fbdce54ba8e64382716b5693568c8d14d2a Jul 09 17:00:07.861662 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:07.861625 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:08.335338 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:08.335304 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-j7fk7" event={"ID":"b04c49dc-05e4-4c15-a771-29fe9c60c188","Type":"ContainerStarted","Data":"b15e82cb012682b2d23a4c5c44717fbdce54ba8e64382716b5693568c8d14d2a"} Jul 09 17:00:08.336415 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:08.336390 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" event={"ID":"5b7bea53-2681-4e90-806b-86fca95c17ca","Type":"ContainerStarted","Data":"973cfb9273770cf4aca9768383e7f0300e9f77000fa4409f26c53f7d595be206"} Jul 09 17:00:09.343002 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:09.342967 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" event={"ID":"5b7bea53-2681-4e90-806b-86fca95c17ca","Type":"ContainerStarted","Data":"53769d4585fd730fefe0fc468bd73d6fa1029b7fe6c4ad22377bd19397905199"} Jul 09 17:00:09.343402 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:09.343107 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" Jul 09 17:00:09.361707 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:09.361653 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" podStartSLOduration=1.6007974109999998 podStartE2EDuration="3.361631634s" totalImagesPullingTime="1.760834223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:00:09.359171352 +0000 UTC m=+578.401946603" watchObservedRunningTime="2026-07-09 17:00:09.361631634 +0000 UTC m=+578.404406885" Jul 09 17:00:10.349164 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:10.349066 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-j7fk7" event={"ID":"b04c49dc-05e4-4c15-a771-29fe9c60c188","Type":"ContainerStarted","Data":"e2e28f260dde5c255440028648f24afa0ab15589dc2b47408b6d36b6beae1676"} Jul 09 17:00:10.349580 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:10.349287 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-j7fk7" Jul 09 17:00:10.368110 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:10.368062 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-j7fk7" podStartSLOduration=1.225566833 podStartE2EDuration="3.368042045s" totalImagesPullingTime="2.142475212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:00:10.365536318 +0000 UTC m=+579.408311569" watchObservedRunningTime="2026-07-09 17:00:10.368042045 +0000 UTC m=+579.410817295" Jul 09 17:00:15.354681 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:15.354652 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-66574c666d-9x56k" Jul 09 17:00:16.825923 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:16.825880 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:16.925157 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:16.925114 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:20.041691 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:20.041657 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:20.142409 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:20.142341 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:21.356952 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:21.356924 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-j7fk7" Jul 09 17:00:24.141951 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.141918 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm"] Jul 09 17:00:24.149772 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.148499 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.156702 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.156670 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 17:00:24.156904 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.156796 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 17:00:24.156904 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.156901 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sl724\"" Jul 09 17:00:24.157299 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.157271 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 09 17:00:24.163248 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.163216 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm"] Jul 09 17:00:24.176065 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.176028 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:24.249498 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.249462 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/892a4a9d-33e7-46b9-a480-5a51b938f6f2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.249498 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.249495 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/892a4a9d-33e7-46b9-a480-5a51b938f6f2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.249713 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.249523 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/892a4a9d-33e7-46b9-a480-5a51b938f6f2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.249713 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.249613 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/892a4a9d-33e7-46b9-a480-5a51b938f6f2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.249713 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.249659 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/892a4a9d-33e7-46b9-a480-5a51b938f6f2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.249850 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.249727 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjw6v\" (UniqueName: \"kubernetes.io/projected/892a4a9d-33e7-46b9-a480-5a51b938f6f2-kube-api-access-tjw6v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.350930 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.350875 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjw6v\" (UniqueName: \"kubernetes.io/projected/892a4a9d-33e7-46b9-a480-5a51b938f6f2-kube-api-access-tjw6v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.351114 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.351029 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/892a4a9d-33e7-46b9-a480-5a51b938f6f2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.351114 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.351056 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/892a4a9d-33e7-46b9-a480-5a51b938f6f2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.351114 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.351081 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/892a4a9d-33e7-46b9-a480-5a51b938f6f2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.351242 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.351125 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/892a4a9d-33e7-46b9-a480-5a51b938f6f2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.351242 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.351150 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/892a4a9d-33e7-46b9-a480-5a51b938f6f2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.351566 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.351540 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/892a4a9d-33e7-46b9-a480-5a51b938f6f2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.351566 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.351559 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/892a4a9d-33e7-46b9-a480-5a51b938f6f2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.351693 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.351582 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/892a4a9d-33e7-46b9-a480-5a51b938f6f2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.353442 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.353422 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/892a4a9d-33e7-46b9-a480-5a51b938f6f2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.353683 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.353668 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/892a4a9d-33e7-46b9-a480-5a51b938f6f2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.359018 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.358995 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjw6v\" (UniqueName: \"kubernetes.io/projected/892a4a9d-33e7-46b9-a480-5a51b938f6f2-kube-api-access-tjw6v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm\" (UID: \"892a4a9d-33e7-46b9-a480-5a51b938f6f2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.473079 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.472976 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:24.615668 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:24.615641 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm"] Jul 09 17:00:24.618042 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:00:24.618012 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod892a4a9d_33e7_46b9_a480_5a51b938f6f2.slice/crio-41d11c6452fe76b67474999eea7e68116e4e16d75ccd39355b23fc69331bc548 WatchSource:0}: Error finding container 41d11c6452fe76b67474999eea7e68116e4e16d75ccd39355b23fc69331bc548: Status 404 returned error can't find the container with id 41d11c6452fe76b67474999eea7e68116e4e16d75ccd39355b23fc69331bc548 Jul 09 17:00:25.423271 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:25.423228 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" event={"ID":"892a4a9d-33e7-46b9-a480-5a51b938f6f2","Type":"ContainerStarted","Data":"41d11c6452fe76b67474999eea7e68116e4e16d75ccd39355b23fc69331bc548"} Jul 09 17:00:29.378201 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:29.378150 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:31.429203 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:31.429175 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:00:31.431196 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:31.431171 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:00:38.872651 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:38.872603 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:41.507038 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:41.506995 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" event={"ID":"892a4a9d-33e7-46b9-a480-5a51b938f6f2","Type":"ContainerStarted","Data":"99aabe437767fba49f2cdf8ccfc74483013de603a4cd8d19bc9f35ee14197cc2"} Jul 09 17:00:41.526558 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:41.526511 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" podStartSLOduration=1.681495121 podStartE2EDuration="17.526494708s" totalImagesPullingTime="15.844999587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:00:41.525287318 +0000 UTC m=+610.568062558" watchObservedRunningTime="2026-07-09 17:00:41.526494708 +0000 UTC m=+610.569269957" Jul 09 17:00:44.473933 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:44.473897 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:44.474318 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:44.473974 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:44.486452 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:44.486428 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:44.533807 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:44.533782 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm" Jul 09 17:00:53.647428 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.647338 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9"] Jul 09 17:00:53.652724 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.652704 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.655297 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.655275 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 09 17:00:53.662358 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.662335 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9"] Jul 09 17:00:53.677175 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.677143 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:53.815438 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.815403 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzc6g\" (UniqueName: \"kubernetes.io/projected/3bf61948-9e28-44ab-9598-60b379bcfee9-kube-api-access-tzc6g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.815592 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.815490 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf61948-9e28-44ab-9598-60b379bcfee9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.815592 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.815532 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf61948-9e28-44ab-9598-60b379bcfee9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.815680 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.815615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf61948-9e28-44ab-9598-60b379bcfee9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.815680 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.815671 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf61948-9e28-44ab-9598-60b379bcfee9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.815762 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.815708 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf61948-9e28-44ab-9598-60b379bcfee9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.916171 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.916101 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf61948-9e28-44ab-9598-60b379bcfee9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.916171 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.916139 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf61948-9e28-44ab-9598-60b379bcfee9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.916333 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.916171 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf61948-9e28-44ab-9598-60b379bcfee9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.916333 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.916207 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf61948-9e28-44ab-9598-60b379bcfee9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.916333 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.916234 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf61948-9e28-44ab-9598-60b379bcfee9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.916333 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.916274 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzc6g\" (UniqueName: \"kubernetes.io/projected/3bf61948-9e28-44ab-9598-60b379bcfee9-kube-api-access-tzc6g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.916586 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.916559 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf61948-9e28-44ab-9598-60b379bcfee9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.916669 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.916648 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf61948-9e28-44ab-9598-60b379bcfee9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.916728 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.916676 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf61948-9e28-44ab-9598-60b379bcfee9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.918560 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.918539 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf61948-9e28-44ab-9598-60b379bcfee9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.918658 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.918640 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf61948-9e28-44ab-9598-60b379bcfee9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.924894 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.924868 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzc6g\" (UniqueName: \"kubernetes.io/projected/3bf61948-9e28-44ab-9598-60b379bcfee9-kube-api-access-tzc6g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9\" (UID: \"3bf61948-9e28-44ab-9598-60b379bcfee9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:53.964110 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:53.964083 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:00:54.103245 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:54.103139 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9"] Jul 09 17:00:54.106255 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:00:54.106227 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf61948_9e28_44ab_9598_60b379bcfee9.slice/crio-48d15ffe8d416682d636f00a5c0513a17cf70fce0c082c6d35931c940c85960f WatchSource:0}: Error finding container 48d15ffe8d416682d636f00a5c0513a17cf70fce0c082c6d35931c940c85960f: Status 404 returned error can't find the container with id 48d15ffe8d416682d636f00a5c0513a17cf70fce0c082c6d35931c940c85960f Jul 09 17:00:54.572685 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:54.572656 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" event={"ID":"3bf61948-9e28-44ab-9598-60b379bcfee9","Type":"ContainerStarted","Data":"48d15ffe8d416682d636f00a5c0513a17cf70fce0c082c6d35931c940c85960f"} Jul 09 17:00:55.579695 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:55.579608 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" event={"ID":"3bf61948-9e28-44ab-9598-60b379bcfee9","Type":"ContainerStarted","Data":"901812c9a4d5b8d37f3b802b44f4fbd37f49e555479ad2c6fd2ff533c12ac747"} Jul 09 17:00:55.604061 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:55.604002 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" podStartSLOduration=1.440147479 podStartE2EDuration="2.603982403s" totalImagesPullingTime="1.163834924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:00:55.60201646 +0000 UTC m=+624.644791747" watchObservedRunningTime="2026-07-09 17:00:55.603982403 +0000 UTC m=+624.646757654" Jul 09 17:00:58.944297 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:58.944266 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg"] Jul 09 17:00:58.947826 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:58.947806 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:58.950390 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:58.950348 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 17:00:58.957477 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:58.957450 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg"] Jul 09 17:00:59.029464 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.029429 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:00:59.064462 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.064428 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd92ab15-dab8-4728-9e53-41523e9e0c97-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.064604 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.064487 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4dvc\" (UniqueName: \"kubernetes.io/projected/cd92ab15-dab8-4728-9e53-41523e9e0c97-kube-api-access-g4dvc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.064604 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.064519 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd92ab15-dab8-4728-9e53-41523e9e0c97-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.064604 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.064546 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd92ab15-dab8-4728-9e53-41523e9e0c97-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.064735 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.064616 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd92ab15-dab8-4728-9e53-41523e9e0c97-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.064735 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.064642 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd92ab15-dab8-4728-9e53-41523e9e0c97-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.166151 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.166118 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd92ab15-dab8-4728-9e53-41523e9e0c97-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.166352 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.166167 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4dvc\" (UniqueName: \"kubernetes.io/projected/cd92ab15-dab8-4728-9e53-41523e9e0c97-kube-api-access-g4dvc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.166352 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.166187 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd92ab15-dab8-4728-9e53-41523e9e0c97-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.166352 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.166204 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd92ab15-dab8-4728-9e53-41523e9e0c97-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.166352 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.166242 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd92ab15-dab8-4728-9e53-41523e9e0c97-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.166352 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.166258 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd92ab15-dab8-4728-9e53-41523e9e0c97-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.166609 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.166587 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd92ab15-dab8-4728-9e53-41523e9e0c97-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.166682 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.166660 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd92ab15-dab8-4728-9e53-41523e9e0c97-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.166718 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.166686 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd92ab15-dab8-4728-9e53-41523e9e0c97-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.168337 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.168309 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd92ab15-dab8-4728-9e53-41523e9e0c97-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.168762 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.168742 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd92ab15-dab8-4728-9e53-41523e9e0c97-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.174988 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.174963 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4dvc\" (UniqueName: \"kubernetes.io/projected/cd92ab15-dab8-4728-9e53-41523e9e0c97-kube-api-access-g4dvc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gjrdg\" (UID: \"cd92ab15-dab8-4728-9e53-41523e9e0c97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.258155 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.258086 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:00:59.394589 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.394560 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg"] Jul 09 17:00:59.396567 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:00:59.396542 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd92ab15_dab8_4728_9e53_41523e9e0c97.slice/crio-123357b1375d26d7706392ca26b04eed2cdd66203e6f74d5909366ddbb1b1941 WatchSource:0}: Error finding container 123357b1375d26d7706392ca26b04eed2cdd66203e6f74d5909366ddbb1b1941: Status 404 returned error can't find the container with id 123357b1375d26d7706392ca26b04eed2cdd66203e6f74d5909366ddbb1b1941 Jul 09 17:00:59.601941 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:00:59.601856 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" event={"ID":"cd92ab15-dab8-4728-9e53-41523e9e0c97","Type":"ContainerStarted","Data":"123357b1375d26d7706392ca26b04eed2cdd66203e6f74d5909366ddbb1b1941"} Jul 09 17:01:03.964967 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:01:03.964932 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:01:03.965491 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:01:03.964998 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:01:03.977474 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:01:03.977453 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:01:04.640316 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:01:04.640284 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9" Jul 09 17:01:05.635902 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:01:05.635868 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" event={"ID":"cd92ab15-dab8-4728-9e53-41523e9e0c97","Type":"ContainerStarted","Data":"e1e778a05cbb17600a474d823ad5f2be1e1537b262244135eb223f2996b38e6a"} Jul 09 17:01:05.662892 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:01:05.662845 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" podStartSLOduration=1.895007192 podStartE2EDuration="7.662828315s" totalImagesPullingTime="5.767821123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:01:05.660516026 +0000 UTC m=+634.703291286" watchObservedRunningTime="2026-07-09 17:01:05.662828315 +0000 UTC m=+634.705603567" Jul 09 17:01:09.259126 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:01:09.259093 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:01:09.259526 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:01:09.259185 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:01:09.271408 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:01:09.271386 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:01:09.666694 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:01:09.666670 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gjrdg" Jul 09 17:01:16.183730 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:01:16.183681 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:02:05.278440 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:02:05.278403 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:02:05.376201 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:02:05.376161 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:02:06.443176 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:02:06.443134 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:02:06.547790 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:02:06.547743 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:03:26.806195 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:26.806151 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:03:26.920769 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:26.920733 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66d8c97569-xl5p5"] Jul 09 17:03:26.921010 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:26.920981 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-66d8c97569-xl5p5" podUID="1bb8fa88-702e-46dd-8d93-8e70928dba9f" containerName="manager" containerID="cri-o://16a9faac375f83389ed864382cb0a893c3c30bb83948b7e6c2811a1033ce5cbc" gracePeriod=30 Jul 09 17:03:27.182317 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.182288 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66d8c97569-xl5p5" Jul 09 17:03:27.309394 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.309338 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jzcj\" (UniqueName: \"kubernetes.io/projected/1bb8fa88-702e-46dd-8d93-8e70928dba9f-kube-api-access-2jzcj\") pod \"1bb8fa88-702e-46dd-8d93-8e70928dba9f\" (UID: \"1bb8fa88-702e-46dd-8d93-8e70928dba9f\") " Jul 09 17:03:27.309549 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.309415 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bb8fa88-702e-46dd-8d93-8e70928dba9f-webhook-cert\") pod \"1bb8fa88-702e-46dd-8d93-8e70928dba9f\" (UID: \"1bb8fa88-702e-46dd-8d93-8e70928dba9f\") " Jul 09 17:03:27.311453 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.311422 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb8fa88-702e-46dd-8d93-8e70928dba9f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1bb8fa88-702e-46dd-8d93-8e70928dba9f" (UID: "1bb8fa88-702e-46dd-8d93-8e70928dba9f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:03:27.311453 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.311437 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb8fa88-702e-46dd-8d93-8e70928dba9f-kube-api-access-2jzcj" (OuterVolumeSpecName: "kube-api-access-2jzcj") pod "1bb8fa88-702e-46dd-8d93-8e70928dba9f" (UID: "1bb8fa88-702e-46dd-8d93-8e70928dba9f"). InnerVolumeSpecName "kube-api-access-2jzcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:03:27.363114 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.363036 2554 generic.go:356] "Generic (PLEG): container finished" podID="1bb8fa88-702e-46dd-8d93-8e70928dba9f" containerID="16a9faac375f83389ed864382cb0a893c3c30bb83948b7e6c2811a1033ce5cbc" exitCode=0 Jul 09 17:03:27.363114 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.363077 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66d8c97569-xl5p5" Jul 09 17:03:27.363261 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.363122 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66d8c97569-xl5p5" event={"ID":"1bb8fa88-702e-46dd-8d93-8e70928dba9f","Type":"ContainerDied","Data":"16a9faac375f83389ed864382cb0a893c3c30bb83948b7e6c2811a1033ce5cbc"} Jul 09 17:03:27.363261 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.363180 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66d8c97569-xl5p5" event={"ID":"1bb8fa88-702e-46dd-8d93-8e70928dba9f","Type":"ContainerDied","Data":"550b00f83168c72de54045f17ed29874ebe598b8a42e60e796370c9b9697454b"} Jul 09 17:03:27.363261 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.363208 2554 scope.go:117] "RemoveContainer" containerID="16a9faac375f83389ed864382cb0a893c3c30bb83948b7e6c2811a1033ce5cbc" Jul 09 17:03:27.373223 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.373205 2554 scope.go:117] "RemoveContainer" containerID="16a9faac375f83389ed864382cb0a893c3c30bb83948b7e6c2811a1033ce5cbc" Jul 09 17:03:27.373511 ip-10-0-132-57 kubenswrapper[2554]: E0709 17:03:27.373477 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16a9faac375f83389ed864382cb0a893c3c30bb83948b7e6c2811a1033ce5cbc\": container with ID starting with 16a9faac375f83389ed864382cb0a893c3c30bb83948b7e6c2811a1033ce5cbc not found: ID does not exist" containerID="16a9faac375f83389ed864382cb0a893c3c30bb83948b7e6c2811a1033ce5cbc" Jul 09 17:03:27.373612 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.373520 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a9faac375f83389ed864382cb0a893c3c30bb83948b7e6c2811a1033ce5cbc"} err="failed to get container status \"16a9faac375f83389ed864382cb0a893c3c30bb83948b7e6c2811a1033ce5cbc\": rpc error: code = NotFound desc = could not find container \"16a9faac375f83389ed864382cb0a893c3c30bb83948b7e6c2811a1033ce5cbc\": container with ID starting with 16a9faac375f83389ed864382cb0a893c3c30bb83948b7e6c2811a1033ce5cbc not found: ID does not exist" Jul 09 17:03:27.385498 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.385471 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66d8c97569-xl5p5"] Jul 09 17:03:27.389741 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.389719 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-66d8c97569-xl5p5"] Jul 09 17:03:27.410809 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.410783 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jzcj\" (UniqueName: \"kubernetes.io/projected/1bb8fa88-702e-46dd-8d93-8e70928dba9f-kube-api-access-2jzcj\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:03:27.410809 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.410807 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bb8fa88-702e-46dd-8d93-8e70928dba9f-webhook-cert\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:03:27.539874 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:27.539842 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb8fa88-702e-46dd-8d93-8e70928dba9f" path="/var/lib/kubelet/pods/1bb8fa88-702e-46dd-8d93-8e70928dba9f/volumes" Jul 09 17:03:28.040906 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.040871 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:03:28.148957 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.148925 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66d8c97569-v5cdw"] Jul 09 17:03:28.149346 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.149324 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb8fa88-702e-46dd-8d93-8e70928dba9f" containerName="manager" Jul 09 17:03:28.149346 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.149338 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb8fa88-702e-46dd-8d93-8e70928dba9f" containerName="manager" Jul 09 17:03:28.149515 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.149451 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb8fa88-702e-46dd-8d93-8e70928dba9f" containerName="manager" Jul 09 17:03:28.153957 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.153937 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66d8c97569-v5cdw" Jul 09 17:03:28.156669 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.156650 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 09 17:03:28.158326 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.158306 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-klqnd\"" Jul 09 17:03:28.158467 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.158339 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 09 17:03:28.161453 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.161098 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66d8c97569-v5cdw"] Jul 09 17:03:28.217674 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.217640 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05749339-3006-4d9d-bd66-2f4e667b9ee5-webhook-cert\") pod \"maas-controller-66d8c97569-v5cdw\" (UID: \"05749339-3006-4d9d-bd66-2f4e667b9ee5\") " pod="opendatahub/maas-controller-66d8c97569-v5cdw" Jul 09 17:03:28.217829 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.217678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hknh2\" (UniqueName: \"kubernetes.io/projected/05749339-3006-4d9d-bd66-2f4e667b9ee5-kube-api-access-hknh2\") pod \"maas-controller-66d8c97569-v5cdw\" (UID: \"05749339-3006-4d9d-bd66-2f4e667b9ee5\") " pod="opendatahub/maas-controller-66d8c97569-v5cdw" Jul 09 17:03:28.319117 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.319046 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05749339-3006-4d9d-bd66-2f4e667b9ee5-webhook-cert\") pod \"maas-controller-66d8c97569-v5cdw\" (UID: \"05749339-3006-4d9d-bd66-2f4e667b9ee5\") " pod="opendatahub/maas-controller-66d8c97569-v5cdw" Jul 09 17:03:28.319117 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.319078 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hknh2\" (UniqueName: \"kubernetes.io/projected/05749339-3006-4d9d-bd66-2f4e667b9ee5-kube-api-access-hknh2\") pod \"maas-controller-66d8c97569-v5cdw\" (UID: \"05749339-3006-4d9d-bd66-2f4e667b9ee5\") " pod="opendatahub/maas-controller-66d8c97569-v5cdw" Jul 09 17:03:28.321525 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.321503 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05749339-3006-4d9d-bd66-2f4e667b9ee5-webhook-cert\") pod \"maas-controller-66d8c97569-v5cdw\" (UID: \"05749339-3006-4d9d-bd66-2f4e667b9ee5\") " pod="opendatahub/maas-controller-66d8c97569-v5cdw" Jul 09 17:03:28.326757 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.326726 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hknh2\" (UniqueName: \"kubernetes.io/projected/05749339-3006-4d9d-bd66-2f4e667b9ee5-kube-api-access-hknh2\") pod \"maas-controller-66d8c97569-v5cdw\" (UID: \"05749339-3006-4d9d-bd66-2f4e667b9ee5\") " pod="opendatahub/maas-controller-66d8c97569-v5cdw" Jul 09 17:03:28.465222 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.465191 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66d8c97569-v5cdw" Jul 09 17:03:28.605566 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.605534 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66d8c97569-v5cdw"] Jul 09 17:03:28.606416 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:03:28.606388 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05749339_3006_4d9d_bd66_2f4e667b9ee5.slice/crio-687528d0c01347c46a22bc48358a2da6eb5db27ec928886eafccc040affb5973 WatchSource:0}: Error finding container 687528d0c01347c46a22bc48358a2da6eb5db27ec928886eafccc040affb5973: Status 404 returned error can't find the container with id 687528d0c01347c46a22bc48358a2da6eb5db27ec928886eafccc040affb5973 Jul 09 17:03:28.607724 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:28.607707 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 17:03:29.375534 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:29.375457 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66d8c97569-v5cdw" event={"ID":"05749339-3006-4d9d-bd66-2f4e667b9ee5","Type":"ContainerStarted","Data":"6a5acd4659a39aabaca9e31aceed008b81e182d85194c9690fc2f93c96b3343b"} Jul 09 17:03:29.375534 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:29.375511 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66d8c97569-v5cdw" event={"ID":"05749339-3006-4d9d-bd66-2f4e667b9ee5","Type":"ContainerStarted","Data":"687528d0c01347c46a22bc48358a2da6eb5db27ec928886eafccc040affb5973"} Jul 09 17:03:29.375901 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:29.375599 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66d8c97569-v5cdw" Jul 09 17:03:29.393883 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:29.393838 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-66d8c97569-v5cdw" podStartSLOduration=0.89355352 podStartE2EDuration="1.393823725s" totalImagesPullingTime="500.270205ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:03:29.392538259 +0000 UTC m=+778.435313510" watchObservedRunningTime="2026-07-09 17:03:29.393823725 +0000 UTC m=+778.436598974" Jul 09 17:03:40.385620 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:03:40.385592 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66d8c97569-v5cdw" Jul 09 17:04:06.616477 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:04:06.616359 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:04:06.723842 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:04:06.723807 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:04:06.844881 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:04:06.844843 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:04:12.762824 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:04:12.762790 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:04:12.877680 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:04:12.877636 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:04:13.025480 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:04:13.025345 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:04:18.872249 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:04:18.872215 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:04:18.936588 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:04:18.936557 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:04:24.655023 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:04:24.654985 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:04:31.742515 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:04:31.742483 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:05:27.291627 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:05:27.291524 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:05:28.687804 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:05:28.687758 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:05:31.462596 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:05:31.462566 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:05:31.463644 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:05:31.463623 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:07:07.976804 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:07:07.976727 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:08:17.185398 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:17.185348 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb"] Jul 09 17:08:17.186076 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:17.185611 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" podUID="73bf48cc-9f6a-4644-a42f-3be27d6531c6" containerName="manager" containerID="cri-o://ca8d8e2fb9a0862fa10f2d4dca2328266e75dd10e37e4c20a5f67f41c71c7ccd" gracePeriod=10 Jul 09 17:08:20.834488 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:20.834459 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" Jul 09 17:08:20.859954 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:20.859912 2554 generic.go:356] "Generic (PLEG): container finished" podID="73bf48cc-9f6a-4644-a42f-3be27d6531c6" containerID="ca8d8e2fb9a0862fa10f2d4dca2328266e75dd10e37e4c20a5f67f41c71c7ccd" exitCode=0 Jul 09 17:08:20.860698 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:20.860181 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" Jul 09 17:08:20.860698 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:20.860200 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" event={"ID":"73bf48cc-9f6a-4644-a42f-3be27d6531c6","Type":"ContainerDied","Data":"ca8d8e2fb9a0862fa10f2d4dca2328266e75dd10e37e4c20a5f67f41c71c7ccd"} Jul 09 17:08:20.860871 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:20.860743 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb" event={"ID":"73bf48cc-9f6a-4644-a42f-3be27d6531c6","Type":"ContainerDied","Data":"284e5238a48be24951d96c4321e73e5aed1e542e8bb802926ba92872ed64c9b2"} Jul 09 17:08:20.860871 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:20.860782 2554 scope.go:117] "RemoveContainer" containerID="ca8d8e2fb9a0862fa10f2d4dca2328266e75dd10e37e4c20a5f67f41c71c7ccd" Jul 09 17:08:20.871755 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:20.871733 2554 scope.go:117] "RemoveContainer" containerID="ca8d8e2fb9a0862fa10f2d4dca2328266e75dd10e37e4c20a5f67f41c71c7ccd" Jul 09 17:08:20.872037 ip-10-0-132-57 kubenswrapper[2554]: E0709 17:08:20.872014 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca8d8e2fb9a0862fa10f2d4dca2328266e75dd10e37e4c20a5f67f41c71c7ccd\": container with ID starting with ca8d8e2fb9a0862fa10f2d4dca2328266e75dd10e37e4c20a5f67f41c71c7ccd not found: ID does not exist" containerID="ca8d8e2fb9a0862fa10f2d4dca2328266e75dd10e37e4c20a5f67f41c71c7ccd" Jul 09 17:08:20.872115 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:20.872052 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8d8e2fb9a0862fa10f2d4dca2328266e75dd10e37e4c20a5f67f41c71c7ccd"} err="failed to get container status \"ca8d8e2fb9a0862fa10f2d4dca2328266e75dd10e37e4c20a5f67f41c71c7ccd\": rpc error: code = NotFound desc = could not find container \"ca8d8e2fb9a0862fa10f2d4dca2328266e75dd10e37e4c20a5f67f41c71c7ccd\": container with ID starting with ca8d8e2fb9a0862fa10f2d4dca2328266e75dd10e37e4c20a5f67f41c71c7ccd not found: ID does not exist" Jul 09 17:08:21.001756 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:21.001693 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z5h8\" (UniqueName: \"kubernetes.io/projected/73bf48cc-9f6a-4644-a42f-3be27d6531c6-kube-api-access-6z5h8\") pod \"73bf48cc-9f6a-4644-a42f-3be27d6531c6\" (UID: \"73bf48cc-9f6a-4644-a42f-3be27d6531c6\") " Jul 09 17:08:21.001903 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:21.001744 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73bf48cc-9f6a-4644-a42f-3be27d6531c6-extensions-socket-volume\") pod \"73bf48cc-9f6a-4644-a42f-3be27d6531c6\" (UID: \"73bf48cc-9f6a-4644-a42f-3be27d6531c6\") " Jul 09 17:08:21.002145 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:21.002119 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73bf48cc-9f6a-4644-a42f-3be27d6531c6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "73bf48cc-9f6a-4644-a42f-3be27d6531c6" (UID: "73bf48cc-9f6a-4644-a42f-3be27d6531c6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:08:21.003670 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:21.003645 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73bf48cc-9f6a-4644-a42f-3be27d6531c6-kube-api-access-6z5h8" (OuterVolumeSpecName: "kube-api-access-6z5h8") pod "73bf48cc-9f6a-4644-a42f-3be27d6531c6" (UID: "73bf48cc-9f6a-4644-a42f-3be27d6531c6"). InnerVolumeSpecName "kube-api-access-6z5h8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:08:21.102752 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:21.102724 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z5h8\" (UniqueName: \"kubernetes.io/projected/73bf48cc-9f6a-4644-a42f-3be27d6531c6-kube-api-access-6z5h8\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:08:21.102752 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:21.102747 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73bf48cc-9f6a-4644-a42f-3be27d6531c6-extensions-socket-volume\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:08:21.182529 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:21.182503 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb"] Jul 09 17:08:21.185565 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:21.185532 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7qmb"] Jul 09 17:08:21.540462 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:08:21.540433 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73bf48cc-9f6a-4644-a42f-3be27d6531c6" path="/var/lib/kubelet/pods/73bf48cc-9f6a-4644-a42f-3be27d6531c6/volumes" Jul 09 17:09:04.191775 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:04.191739 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:09:18.389992 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.389954 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg"] Jul 09 17:09:18.390393 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.390353 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73bf48cc-9f6a-4644-a42f-3be27d6531c6" containerName="manager" Jul 09 17:09:18.390393 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.390378 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="73bf48cc-9f6a-4644-a42f-3be27d6531c6" containerName="manager" Jul 09 17:09:18.390536 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.390522 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="73bf48cc-9f6a-4644-a42f-3be27d6531c6" containerName="manager" Jul 09 17:09:18.393859 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.393839 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg" Jul 09 17:09:18.396410 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.396392 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2jhst\"" Jul 09 17:09:18.405429 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.405409 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg"] Jul 09 17:09:18.408882 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.408858 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frmql\" (UniqueName: \"kubernetes.io/projected/6f1f9222-2e68-4913-8a0d-c20769378177-kube-api-access-frmql\") pod \"kuadrant-operator-controller-manager-86878c769f-8v8tg\" (UID: \"6f1f9222-2e68-4913-8a0d-c20769378177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg" Jul 09 17:09:18.408998 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.408915 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f1f9222-2e68-4913-8a0d-c20769378177-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8v8tg\" (UID: \"6f1f9222-2e68-4913-8a0d-c20769378177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg" Jul 09 17:09:18.509746 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.509711 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frmql\" (UniqueName: \"kubernetes.io/projected/6f1f9222-2e68-4913-8a0d-c20769378177-kube-api-access-frmql\") pod \"kuadrant-operator-controller-manager-86878c769f-8v8tg\" (UID: \"6f1f9222-2e68-4913-8a0d-c20769378177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg" Jul 09 17:09:18.509870 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.509791 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f1f9222-2e68-4913-8a0d-c20769378177-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8v8tg\" (UID: \"6f1f9222-2e68-4913-8a0d-c20769378177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg" Jul 09 17:09:18.510159 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.510140 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f1f9222-2e68-4913-8a0d-c20769378177-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8v8tg\" (UID: \"6f1f9222-2e68-4913-8a0d-c20769378177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg" Jul 09 17:09:18.518428 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.518399 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frmql\" (UniqueName: \"kubernetes.io/projected/6f1f9222-2e68-4913-8a0d-c20769378177-kube-api-access-frmql\") pod \"kuadrant-operator-controller-manager-86878c769f-8v8tg\" (UID: \"6f1f9222-2e68-4913-8a0d-c20769378177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg" Jul 09 17:09:18.703760 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.703679 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg" Jul 09 17:09:18.848537 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:18.848509 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg"] Jul 09 17:09:18.849255 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:09:18.849232 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1f9222_2e68_4913_8a0d_c20769378177.slice/crio-e2ea385ae076876f65792313fc594dae2ccd9437b2ab893543193e6ad0956ab6 WatchSource:0}: Error finding container e2ea385ae076876f65792313fc594dae2ccd9437b2ab893543193e6ad0956ab6: Status 404 returned error can't find the container with id e2ea385ae076876f65792313fc594dae2ccd9437b2ab893543193e6ad0956ab6 Jul 09 17:09:19.157742 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:19.157711 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg" event={"ID":"6f1f9222-2e68-4913-8a0d-c20769378177","Type":"ContainerStarted","Data":"eed7855e208769ff8182ab01690e43978021236ceea00d68b991877cf646fbdd"} Jul 09 17:09:19.157898 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:19.157760 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg" event={"ID":"6f1f9222-2e68-4913-8a0d-c20769378177","Type":"ContainerStarted","Data":"e2ea385ae076876f65792313fc594dae2ccd9437b2ab893543193e6ad0956ab6"} Jul 09 17:09:19.157898 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:19.157800 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg" Jul 09 17:09:19.183715 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:19.183677 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg" podStartSLOduration=1.183662385 podStartE2EDuration="1.183662385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:09:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:19.182036052 +0000 UTC m=+1128.224811302" watchObservedRunningTime="2026-07-09 17:09:19.183662385 +0000 UTC m=+1128.226437634" Jul 09 17:09:30.164512 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:09:30.164482 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8v8tg" Jul 09 17:10:31.493507 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:10:31.493425 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:10:31.495898 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:10:31.495876 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:11:29.752897 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:11:29.752814 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:12:47.252395 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:12:47.252339 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:14:16.574207 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:14:16.574168 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:14:16.686777 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:14:16.686731 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:00.941437 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:00.941397 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:09.822117 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:09.822081 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:18.100500 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:18.100460 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:23.206733 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:23.206695 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:26.100940 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:26.100891 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:26.201989 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:26.201955 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:26.541265 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:26.541233 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:31.524832 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:31.524804 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:15:31.529503 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:31.529477 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:15:32.289656 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:32.289606 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:32.394200 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:32.394169 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:32.497956 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:32.497927 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:32.576692 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:32.576612 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:33.595165 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:33.595129 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:33.696863 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:33.696833 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:33.814517 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:33.814476 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:34.028155 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:34.028125 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:34.243747 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:34.243714 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:34.323617 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:34.323538 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:36.060674 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:36.060637 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:38.726425 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:38.726383 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:38.920251 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:38.920218 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:39.038154 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:39.038069 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:39.137875 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:39.137840 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:40.463026 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:40.462984 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:44.633181 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:44.633152 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:44.734624 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:44.734560 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:44.853890 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:44.853861 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:44.951856 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:44.951773 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:45.954456 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:45.954418 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:46.055960 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.055911 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:46.166078 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.166041 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq"] Jul 09 17:15:46.170702 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.170681 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:46.173324 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.173301 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a6f26a7e-serving-cert\"" Jul 09 17:15:46.181490 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.181468 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq"] Jul 09 17:15:46.203182 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.203152 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:46.293964 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.293896 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h47cd\" (UniqueName: \"kubernetes.io/projected/1aba71d0-bcc0-4345-8483-763f8328a53e-kube-api-access-h47cd\") pod \"maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq\" (UID: \"1aba71d0-bcc0-4345-8483-763f8328a53e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:46.293964 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.293957 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aba71d0-bcc0-4345-8483-763f8328a53e-openshift-service-ca\") pod \"maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq\" (UID: \"1aba71d0-bcc0-4345-8483-763f8328a53e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:46.294112 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.294028 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aba71d0-bcc0-4345-8483-763f8328a53e-maas-api-tls\") pod \"maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq\" (UID: \"1aba71d0-bcc0-4345-8483-763f8328a53e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:46.395044 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.395008 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aba71d0-bcc0-4345-8483-763f8328a53e-openshift-service-ca\") pod \"maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq\" (UID: \"1aba71d0-bcc0-4345-8483-763f8328a53e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:46.395196 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.395055 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aba71d0-bcc0-4345-8483-763f8328a53e-maas-api-tls\") pod \"maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq\" (UID: \"1aba71d0-bcc0-4345-8483-763f8328a53e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:46.395196 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.395097 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h47cd\" (UniqueName: \"kubernetes.io/projected/1aba71d0-bcc0-4345-8483-763f8328a53e-kube-api-access-h47cd\") pod \"maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq\" (UID: \"1aba71d0-bcc0-4345-8483-763f8328a53e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:46.395339 ip-10-0-132-57 kubenswrapper[2554]: E0709 17:15:46.395247 2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-serving-cert: secret "maas-api-e2e-ait-a6f26a7e-serving-cert" not found Jul 09 17:15:46.395339 ip-10-0-132-57 kubenswrapper[2554]: E0709 17:15:46.395337 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aba71d0-bcc0-4345-8483-763f8328a53e-maas-api-tls podName:1aba71d0-bcc0-4345-8483-763f8328a53e nodeName:}" failed. No retries permitted until 2026-07-09 17:15:46.895315406 +0000 UTC m=+1515.938090651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1aba71d0-bcc0-4345-8483-763f8328a53e-maas-api-tls") pod "maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" (UID: "1aba71d0-bcc0-4345-8483-763f8328a53e") : secret "maas-api-e2e-ait-a6f26a7e-serving-cert" not found Jul 09 17:15:46.395703 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.395682 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aba71d0-bcc0-4345-8483-763f8328a53e-openshift-service-ca\") pod \"maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq\" (UID: \"1aba71d0-bcc0-4345-8483-763f8328a53e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:46.411684 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.411657 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h47cd\" (UniqueName: \"kubernetes.io/projected/1aba71d0-bcc0-4345-8483-763f8328a53e-kube-api-access-h47cd\") pod \"maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq\" (UID: \"1aba71d0-bcc0-4345-8483-763f8328a53e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:46.608618 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.608504 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:46.711033 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.710996 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:46.900810 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.900781 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aba71d0-bcc0-4345-8483-763f8328a53e-maas-api-tls\") pod \"maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq\" (UID: \"1aba71d0-bcc0-4345-8483-763f8328a53e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:46.903465 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:46.903433 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aba71d0-bcc0-4345-8483-763f8328a53e-maas-api-tls\") pod \"maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq\" (UID: \"1aba71d0-bcc0-4345-8483-763f8328a53e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:47.086478 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:47.086447 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:47.226001 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:47.225974 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq"] Jul 09 17:15:47.228229 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:15:47.228201 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aba71d0_bcc0_4345_8483_763f8328a53e.slice/crio-a6e2ace1b3138ee2d0994e1c7f2dfda22f68a135c347287aaa5dd0e1e8009550 WatchSource:0}: Error finding container a6e2ace1b3138ee2d0994e1c7f2dfda22f68a135c347287aaa5dd0e1e8009550: Status 404 returned error can't find the container with id a6e2ace1b3138ee2d0994e1c7f2dfda22f68a135c347287aaa5dd0e1e8009550 Jul 09 17:15:47.229866 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:47.229850 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 17:15:48.172611 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:48.172570 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" event={"ID":"1aba71d0-bcc0-4345-8483-763f8328a53e","Type":"ContainerStarted","Data":"41f12af0ffcd5b393e17c6f0915ce911afec3547f05ec0c2553b0001063e7398"} Jul 09 17:15:48.172999 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:48.172638 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:48.172999 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:48.172668 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" event={"ID":"1aba71d0-bcc0-4345-8483-763f8328a53e","Type":"ContainerStarted","Data":"a6e2ace1b3138ee2d0994e1c7f2dfda22f68a135c347287aaa5dd0e1e8009550"} Jul 09 17:15:48.191096 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:48.191047 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" podStartSLOduration=1.835304624 podStartE2EDuration="2.191032323s" totalImagesPullingTime="355.727699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:15:48.189221788 +0000 UTC m=+1517.231997041" watchObservedRunningTime="2026-07-09 17:15:48.191032323 +0000 UTC m=+1517.233807572" Jul 09 17:15:48.393883 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:48.393838 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:51.201671 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:51.201635 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:51.603988 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:51.601998 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq"] Jul 09 17:15:51.603988 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:51.602272 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" podUID="1aba71d0-bcc0-4345-8483-763f8328a53e" containerName="maas-api" containerID="cri-o://41f12af0ffcd5b393e17c6f0915ce911afec3547f05ec0c2553b0001063e7398" gracePeriod=30 Jul 09 17:15:51.629819 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:51.629785 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:51.861566 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:51.861509 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:51.946027 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:51.945998 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aba71d0-bcc0-4345-8483-763f8328a53e-maas-api-tls\") pod \"1aba71d0-bcc0-4345-8483-763f8328a53e\" (UID: \"1aba71d0-bcc0-4345-8483-763f8328a53e\") " Jul 09 17:15:51.946173 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:51.946055 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h47cd\" (UniqueName: \"kubernetes.io/projected/1aba71d0-bcc0-4345-8483-763f8328a53e-kube-api-access-h47cd\") pod \"1aba71d0-bcc0-4345-8483-763f8328a53e\" (UID: \"1aba71d0-bcc0-4345-8483-763f8328a53e\") " Jul 09 17:15:51.946173 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:51.946078 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aba71d0-bcc0-4345-8483-763f8328a53e-openshift-service-ca\") pod \"1aba71d0-bcc0-4345-8483-763f8328a53e\" (UID: \"1aba71d0-bcc0-4345-8483-763f8328a53e\") " Jul 09 17:15:51.946491 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:51.946468 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aba71d0-bcc0-4345-8483-763f8328a53e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1aba71d0-bcc0-4345-8483-763f8328a53e" (UID: "1aba71d0-bcc0-4345-8483-763f8328a53e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:15:51.947987 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:51.947960 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aba71d0-bcc0-4345-8483-763f8328a53e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1aba71d0-bcc0-4345-8483-763f8328a53e" (UID: "1aba71d0-bcc0-4345-8483-763f8328a53e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:15:51.948072 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:51.948051 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aba71d0-bcc0-4345-8483-763f8328a53e-kube-api-access-h47cd" (OuterVolumeSpecName: "kube-api-access-h47cd") pod "1aba71d0-bcc0-4345-8483-763f8328a53e" (UID: "1aba71d0-bcc0-4345-8483-763f8328a53e"). InnerVolumeSpecName "kube-api-access-h47cd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:15:52.046969 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:52.046941 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aba71d0-bcc0-4345-8483-763f8328a53e-maas-api-tls\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:15:52.047121 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:52.046977 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h47cd\" (UniqueName: \"kubernetes.io/projected/1aba71d0-bcc0-4345-8483-763f8328a53e-kube-api-access-h47cd\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:15:52.047121 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:52.046991 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aba71d0-bcc0-4345-8483-763f8328a53e-openshift-service-ca\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:15:52.193568 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:52.193532 2554 generic.go:356] "Generic (PLEG): container finished" podID="1aba71d0-bcc0-4345-8483-763f8328a53e" containerID="41f12af0ffcd5b393e17c6f0915ce911afec3547f05ec0c2553b0001063e7398" exitCode=0 Jul 09 17:15:52.193732 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:52.193577 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" Jul 09 17:15:52.193732 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:52.193613 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" event={"ID":"1aba71d0-bcc0-4345-8483-763f8328a53e","Type":"ContainerDied","Data":"41f12af0ffcd5b393e17c6f0915ce911afec3547f05ec0c2553b0001063e7398"} Jul 09 17:15:52.193732 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:52.193666 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq" event={"ID":"1aba71d0-bcc0-4345-8483-763f8328a53e","Type":"ContainerDied","Data":"a6e2ace1b3138ee2d0994e1c7f2dfda22f68a135c347287aaa5dd0e1e8009550"} Jul 09 17:15:52.193732 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:52.193690 2554 scope.go:117] "RemoveContainer" containerID="41f12af0ffcd5b393e17c6f0915ce911afec3547f05ec0c2553b0001063e7398" Jul 09 17:15:52.202839 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:52.202818 2554 scope.go:117] "RemoveContainer" containerID="41f12af0ffcd5b393e17c6f0915ce911afec3547f05ec0c2553b0001063e7398" Jul 09 17:15:52.203088 ip-10-0-132-57 kubenswrapper[2554]: E0709 17:15:52.203070 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41f12af0ffcd5b393e17c6f0915ce911afec3547f05ec0c2553b0001063e7398\": container with ID starting with 41f12af0ffcd5b393e17c6f0915ce911afec3547f05ec0c2553b0001063e7398 not found: ID does not exist" containerID="41f12af0ffcd5b393e17c6f0915ce911afec3547f05ec0c2553b0001063e7398" Jul 09 17:15:52.203139 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:52.203093 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f12af0ffcd5b393e17c6f0915ce911afec3547f05ec0c2553b0001063e7398"} err="failed to get container status \"41f12af0ffcd5b393e17c6f0915ce911afec3547f05ec0c2553b0001063e7398\": rpc error: code = NotFound desc = could not find container \"41f12af0ffcd5b393e17c6f0915ce911afec3547f05ec0c2553b0001063e7398\": container with ID starting with 41f12af0ffcd5b393e17c6f0915ce911afec3547f05ec0c2553b0001063e7398 not found: ID does not exist" Jul 09 17:15:52.215492 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:52.215471 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq"] Jul 09 17:15:52.221123 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:52.221100 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6f26a7e-b696bbfc9-l66sq"] Jul 09 17:15:53.540014 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:53.539983 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aba71d0-bcc0-4345-8483-763f8328a53e" path="/var/lib/kubelet/pods/1aba71d0-bcc0-4345-8483-763f8328a53e/volumes" Jul 09 17:15:57.385848 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:57.385812 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:57.506007 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:57.505976 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:15:59.935352 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:15:59.935319 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:01.244075 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:01.244042 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:03.257069 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:03.257021 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:03.335197 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:03.335167 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:03.514709 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:03.514631 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:03.591745 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:03.591716 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:04.689602 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.689564 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:04.782989 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.782946 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt"] Jul 09 17:16:04.783439 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.783423 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aba71d0-bcc0-4345-8483-763f8328a53e" containerName="maas-api" Jul 09 17:16:04.783439 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.783439 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aba71d0-bcc0-4345-8483-763f8328a53e" containerName="maas-api" Jul 09 17:16:04.783578 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.783525 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aba71d0-bcc0-4345-8483-763f8328a53e" containerName="maas-api" Jul 09 17:16:04.785350 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.785323 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:04.786492 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.786470 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" Jul 09 17:16:04.789203 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.789178 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-8631fde9-serving-cert\"" Jul 09 17:16:04.799412 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.799391 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt"] Jul 09 17:16:04.862778 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.862746 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rrk7\" (UniqueName: \"kubernetes.io/projected/c9129192-f380-4676-8b77-364a5fc55696-kube-api-access-6rrk7\") pod \"maas-api-e2e-derive-8631fde9-6b8555f574-fbptt\" (UID: \"c9129192-f380-4676-8b77-364a5fc55696\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" Jul 09 17:16:04.862938 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.862783 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9129192-f380-4676-8b77-364a5fc55696-openshift-service-ca\") pod \"maas-api-e2e-derive-8631fde9-6b8555f574-fbptt\" (UID: \"c9129192-f380-4676-8b77-364a5fc55696\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" Jul 09 17:16:04.862938 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.862802 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9129192-f380-4676-8b77-364a5fc55696-maas-api-tls\") pod \"maas-api-e2e-derive-8631fde9-6b8555f574-fbptt\" (UID: \"c9129192-f380-4676-8b77-364a5fc55696\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" Jul 09 17:16:04.894033 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.894000 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:04.964058 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.963966 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rrk7\" (UniqueName: \"kubernetes.io/projected/c9129192-f380-4676-8b77-364a5fc55696-kube-api-access-6rrk7\") pod \"maas-api-e2e-derive-8631fde9-6b8555f574-fbptt\" (UID: \"c9129192-f380-4676-8b77-364a5fc55696\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" Jul 09 17:16:04.964058 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.964013 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9129192-f380-4676-8b77-364a5fc55696-openshift-service-ca\") pod \"maas-api-e2e-derive-8631fde9-6b8555f574-fbptt\" (UID: \"c9129192-f380-4676-8b77-364a5fc55696\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" Jul 09 17:16:04.964283 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.964126 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9129192-f380-4676-8b77-364a5fc55696-maas-api-tls\") pod \"maas-api-e2e-derive-8631fde9-6b8555f574-fbptt\" (UID: \"c9129192-f380-4676-8b77-364a5fc55696\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" Jul 09 17:16:04.964686 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.964664 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9129192-f380-4676-8b77-364a5fc55696-openshift-service-ca\") pod \"maas-api-e2e-derive-8631fde9-6b8555f574-fbptt\" (UID: \"c9129192-f380-4676-8b77-364a5fc55696\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" Jul 09 17:16:04.966474 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.966454 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9129192-f380-4676-8b77-364a5fc55696-maas-api-tls\") pod \"maas-api-e2e-derive-8631fde9-6b8555f574-fbptt\" (UID: \"c9129192-f380-4676-8b77-364a5fc55696\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" Jul 09 17:16:04.973253 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.973231 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rrk7\" (UniqueName: \"kubernetes.io/projected/c9129192-f380-4676-8b77-364a5fc55696-kube-api-access-6rrk7\") pod \"maas-api-e2e-derive-8631fde9-6b8555f574-fbptt\" (UID: \"c9129192-f380-4676-8b77-364a5fc55696\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" Jul 09 17:16:04.991182 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:04.991156 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:05.098686 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:05.098663 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" Jul 09 17:16:05.238841 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:05.238819 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt"] Jul 09 17:16:05.241510 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:16:05.241484 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9129192_f380_4676_8b77_364a5fc55696.slice/crio-02fbc6d164857607f999a8368e0a0b717006bd4d2bf8ca35d07eca1134c6b908 WatchSource:0}: Error finding container 02fbc6d164857607f999a8368e0a0b717006bd4d2bf8ca35d07eca1134c6b908: Status 404 returned error can't find the container with id 02fbc6d164857607f999a8368e0a0b717006bd4d2bf8ca35d07eca1134c6b908 Jul 09 17:16:05.264308 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:05.264279 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" event={"ID":"c9129192-f380-4676-8b77-364a5fc55696","Type":"ContainerStarted","Data":"02fbc6d164857607f999a8368e0a0b717006bd4d2bf8ca35d07eca1134c6b908"} Jul 09 17:16:05.339198 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:05.339172 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:05.471575 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:05.471547 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:06.271085 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:06.271051 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" event={"ID":"c9129192-f380-4676-8b77-364a5fc55696","Type":"ContainerStarted","Data":"b8971ad1167e2c195adc367426689509efed3bae0ca7302b8cc9093bf0d65592"} Jul 09 17:16:06.271592 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:06.271185 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" Jul 09 17:16:06.291528 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:06.291447 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" podStartSLOduration=1.511542452 podStartE2EDuration="2.291433624s" totalImagesPullingTime="779.891172ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:16:06.289908315 +0000 UTC m=+1535.332683565" watchObservedRunningTime="2026-07-09 17:16:06.291433624 +0000 UTC m=+1535.334208873" Jul 09 17:16:06.420482 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:06.420443 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:09.043903 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.043866 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:09.243092 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.243061 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:09.342919 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.342831 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:09.393332 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.393290 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt"] Jul 09 17:16:09.393784 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.393749 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" podUID="c9129192-f380-4676-8b77-364a5fc55696" containerName="maas-api" containerID="cri-o://b8971ad1167e2c195adc367426689509efed3bae0ca7302b8cc9093bf0d65592" gracePeriod=30 Jul 09 17:16:09.443624 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.443592 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:09.648871 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.648848 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" Jul 09 17:16:09.709274 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.709245 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9129192-f380-4676-8b77-364a5fc55696-maas-api-tls\") pod \"c9129192-f380-4676-8b77-364a5fc55696\" (UID: \"c9129192-f380-4676-8b77-364a5fc55696\") " Jul 09 17:16:09.709448 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.709419 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9129192-f380-4676-8b77-364a5fc55696-openshift-service-ca\") pod \"c9129192-f380-4676-8b77-364a5fc55696\" (UID: \"c9129192-f380-4676-8b77-364a5fc55696\") " Jul 09 17:16:09.709597 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.709451 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rrk7\" (UniqueName: \"kubernetes.io/projected/c9129192-f380-4676-8b77-364a5fc55696-kube-api-access-6rrk7\") pod \"c9129192-f380-4676-8b77-364a5fc55696\" (UID: \"c9129192-f380-4676-8b77-364a5fc55696\") " Jul 09 17:16:09.709852 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.709815 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9129192-f380-4676-8b77-364a5fc55696-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c9129192-f380-4676-8b77-364a5fc55696" (UID: "c9129192-f380-4676-8b77-364a5fc55696"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:16:09.711308 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.711277 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9129192-f380-4676-8b77-364a5fc55696-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c9129192-f380-4676-8b77-364a5fc55696" (UID: "c9129192-f380-4676-8b77-364a5fc55696"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:16:09.711510 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.711487 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9129192-f380-4676-8b77-364a5fc55696-kube-api-access-6rrk7" (OuterVolumeSpecName: "kube-api-access-6rrk7") pod "c9129192-f380-4676-8b77-364a5fc55696" (UID: "c9129192-f380-4676-8b77-364a5fc55696"). InnerVolumeSpecName "kube-api-access-6rrk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:16:09.810679 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.810644 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9129192-f380-4676-8b77-364a5fc55696-maas-api-tls\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:16:09.810679 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.810668 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9129192-f380-4676-8b77-364a5fc55696-openshift-service-ca\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:16:09.810679 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:09.810680 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rrk7\" (UniqueName: \"kubernetes.io/projected/c9129192-f380-4676-8b77-364a5fc55696-kube-api-access-6rrk7\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:16:10.292081 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:10.292044 2554 generic.go:356] "Generic (PLEG): container finished" podID="c9129192-f380-4676-8b77-364a5fc55696" containerID="b8971ad1167e2c195adc367426689509efed3bae0ca7302b8cc9093bf0d65592" exitCode=0 Jul 09 17:16:10.292482 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:10.292090 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" Jul 09 17:16:10.292482 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:10.292089 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" event={"ID":"c9129192-f380-4676-8b77-364a5fc55696","Type":"ContainerDied","Data":"b8971ad1167e2c195adc367426689509efed3bae0ca7302b8cc9093bf0d65592"} Jul 09 17:16:10.292482 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:10.292152 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt" event={"ID":"c9129192-f380-4676-8b77-364a5fc55696","Type":"ContainerDied","Data":"02fbc6d164857607f999a8368e0a0b717006bd4d2bf8ca35d07eca1134c6b908"} Jul 09 17:16:10.292482 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:10.292184 2554 scope.go:117] "RemoveContainer" containerID="b8971ad1167e2c195adc367426689509efed3bae0ca7302b8cc9093bf0d65592" Jul 09 17:16:10.301757 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:10.301738 2554 scope.go:117] "RemoveContainer" containerID="b8971ad1167e2c195adc367426689509efed3bae0ca7302b8cc9093bf0d65592" Jul 09 17:16:10.302011 ip-10-0-132-57 kubenswrapper[2554]: E0709 17:16:10.301990 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8971ad1167e2c195adc367426689509efed3bae0ca7302b8cc9093bf0d65592\": container with ID starting with b8971ad1167e2c195adc367426689509efed3bae0ca7302b8cc9093bf0d65592 not found: ID does not exist" containerID="b8971ad1167e2c195adc367426689509efed3bae0ca7302b8cc9093bf0d65592" Jul 09 17:16:10.302065 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:10.302024 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8971ad1167e2c195adc367426689509efed3bae0ca7302b8cc9093bf0d65592"} err="failed to get container status \"b8971ad1167e2c195adc367426689509efed3bae0ca7302b8cc9093bf0d65592\": rpc error: code = NotFound desc = could not find container \"b8971ad1167e2c195adc367426689509efed3bae0ca7302b8cc9093bf0d65592\": container with ID starting with b8971ad1167e2c195adc367426689509efed3bae0ca7302b8cc9093bf0d65592 not found: ID does not exist" Jul 09 17:16:10.314702 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:10.314678 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt"] Jul 09 17:16:10.321842 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:10.321822 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8631fde9-6b8555f574-fbptt"] Jul 09 17:16:10.738546 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:10.738519 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:11.540824 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:11.540793 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9129192-f380-4676-8b77-364a5fc55696" path="/var/lib/kubelet/pods/c9129192-f380-4676-8b77-364a5fc55696/volumes" Jul 09 17:16:15.500441 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:15.500406 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:15.597277 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:15.597243 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:15.997324 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:15.997275 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:16.094753 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:16.094725 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:16.195689 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:16.195660 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:17.704539 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:17.704498 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:22.836118 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:22.836087 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:24.757519 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:24.757490 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:24.857421 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:24.857390 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:50.768553 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:50.768515 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:56.461915 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:56.461877 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:56.520267 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:56.520237 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:56.607952 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:56.607919 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:16:56.705994 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:16:56.705965 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:12.566297 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:12.566259 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:18.164607 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:18.164571 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:18.224906 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:18.224871 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:18.298128 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:18.298098 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:18.398089 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:18.398057 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:28.858543 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:28.858468 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:29.706653 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:29.706622 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:35.454651 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:35.454614 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:35.555727 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:35.555696 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:35.655105 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:35.655059 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:35.754789 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:35.754675 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:36.551499 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:36.551446 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:36.647252 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:36.647213 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:36.747987 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:36.747952 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:38.413935 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:38.413903 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:44.132885 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:44.132854 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:44.187954 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:44.187924 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:45.948012 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:45.947979 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:50.484809 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:50.484746 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:50.582557 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:50.582525 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:50.739062 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:50.738977 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:51.047330 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:51.047249 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:51.432774 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:51.432744 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:53.883283 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:53.883194 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:53.979608 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:53.979578 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:54.102439 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:54.102397 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:54.537489 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:54.537453 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:54.637938 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:54.637905 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:58.402289 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:58.402252 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:59.089552 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:59.089522 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:59.184420 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:59.184384 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:17:59.587679 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:17:59.587650 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:05.550627 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:05.550591 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:05.650960 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:05.650926 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:06.064212 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:06.064168 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:06.392974 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:06.392942 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:06.492564 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:06.492530 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:12.322891 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:12.322854 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:12.396322 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:12.396288 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:12.588926 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:12.588852 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:12.863568 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:12.863480 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:12.968141 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:12.968104 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:13.058016 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:13.057983 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:13.259749 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:13.259709 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:18.710169 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:18.710136 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:18.777720 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:18.777686 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:18.867200 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:18.867166 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:18.970193 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:18.970109 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:19.069533 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:19.069505 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:24.848303 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:24.848267 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:24.947943 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:24.947909 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:31.704184 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:31.704151 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:32.001413 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:32.001301 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:32.288987 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:32.288901 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:35.102665 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:35.102623 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:35.191688 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:35.191652 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:35.262888 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:35.262855 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:35.692857 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:35.692828 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:35.793231 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:35.793192 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:39.632616 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:39.632583 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:44.274211 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:44.274171 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:49.065444 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:49.065416 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:49.171706 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:49.171670 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:57.250226 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:57.250149 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:18:57.349980 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:18:57.349949 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:19:12.251085 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:19:12.251051 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:19:12.570555 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:19:12.570481 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:19:18.335920 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:19:18.335890 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:19:23.413418 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:19:23.413362 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:00.293648 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:00.293607 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:00.411719 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:00.411685 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:06.069192 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:06.069162 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:12.842383 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:12.842335 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:12.943435 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:12.943394 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:20.614440 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:20.614390 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:20.671779 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:20.671741 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:20.906442 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:20.906338 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:21.135201 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:21.135165 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:22.225063 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:22.225031 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:22.323600 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:22.323564 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:22.428200 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:22.428164 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:23.146239 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:23.146197 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:23.246979 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:23.246944 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:23.345886 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:23.345849 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:24.805234 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:24.805197 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:30.638998 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:30.638963 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:30.739170 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:30.739137 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:31.360249 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:31.360215 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:31.557880 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:31.557853 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:20:31.562152 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:31.562129 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:20:36.933052 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:36.933007 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:36.989807 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:36.989772 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:37.060493 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:37.060441 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:37.160924 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:37.160887 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:47.639444 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:47.639411 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:20:47.970176 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:20:47.970100 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:08.954459 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:08.954423 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:14.524726 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:14.524697 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:14.625179 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:14.625143 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:14.884033 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:14.884000 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:15.212141 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:15.212056 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:15.526404 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:15.526302 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:17.940552 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:17.940512 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:18.033134 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:18.033094 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:18.096889 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:18.096854 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:18.221994 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:18.221912 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:18.500411 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:18.500294 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:18.600577 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:18.600492 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:22.459078 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:22.459044 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:22.803971 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:22.803877 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:23.125821 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:23.125731 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:23.363565 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:23.363536 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:25.965664 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:25.965628 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:26.068172 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:26.068138 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:26.216728 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:26.216646 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:26.491895 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:26.491800 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:26.592345 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:26.592313 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:27.485935 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:27.485896 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:30.470069 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:30.470033 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:34.738952 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:34.738914 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:40.033178 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:40.033144 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:40.135416 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:40.135382 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:47.440516 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:47.440470 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:47.576727 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:47.576699 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:21:59.095229 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:21:59.095144 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:22:01.138090 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:22:01.138055 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:22:04.673203 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:22:04.673164 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:22:15.761967 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:22:15.761914 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:22:29.080822 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:22:29.080771 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:22:29.986922 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:22:29.986893 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:22:30.443295 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:22:30.443264 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:22:30.543353 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:22:30.543320 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:22:30.654045 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:22:30.654013 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:22:30.755135 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:22:30.755053 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:22:30.907489 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:22:30.907457 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:22:35.623287 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:22:35.623233 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:22:39.111527 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:22:39.111473 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:12.309551 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:12.303829 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:12.728601 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:12.728566 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:13.128138 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:13.128111 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:13.335949 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:13.335913 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:13.852644 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:13.852609 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:13.940813 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:13.940787 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:14.096153 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:14.096112 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:19.468699 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:19.468663 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:19.569060 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:19.569031 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:19.790772 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:19.790689 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:19.989797 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:19.989759 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:20.338182 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:20.338137 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:20.637873 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:20.637834 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:20.780267 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:20.780231 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:23.667802 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:23.667715 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:23.762307 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:23.762279 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:23.870090 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:23.870058 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:24.132483 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:24.132455 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:24.335182 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:24.335137 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:24.437675 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:24.437586 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:28.094114 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:28.094082 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:28.914483 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:28.914440 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:29.017246 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:29.017212 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:29.204742 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:29.204661 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:31.594258 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:31.594225 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:31.691458 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:31.691425 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:31.792051 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:31.792018 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:31.893733 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:31.893703 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:32.257250 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:32.257167 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:32.342546 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:32.342514 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:36.099496 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:36.099459 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:44.233955 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:44.233922 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:44.659492 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:44.659456 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:44.765429 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:44.765391 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:44.862233 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:44.862198 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:44.990070 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:44.989998 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:49.852581 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:49.852544 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:49.953509 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:49.953474 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:50.717828 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:50.717792 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:50.777152 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:50.777121 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:50.994280 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:50.994202 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:51.205686 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:51.205650 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:51.363295 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:51.363203 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:51.844292 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:51.844250 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:51.942847 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:51.942815 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:52.042297 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:52.042269 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:52.143257 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:52.143229 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:57.663594 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:57.663563 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:58.184833 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:58.184796 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:58.248167 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:58.248121 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:58.519192 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:58.519105 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:59.224241 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:59.224197 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:23:59.324439 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:23:59.324406 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:01.907598 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:01.907557 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:01.994706 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:01.994673 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:02.093055 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:02.093026 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:02.347663 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:02.347582 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:02.448009 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:02.447980 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:06.362646 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:06.362614 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:06.712430 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:06.712392 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:07.009586 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:07.009506 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:07.513647 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:07.513613 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:09.858625 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:09.858585 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:09.956534 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:09.956502 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:10.098019 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:10.097984 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:10.268435 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:10.268398 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:10.550320 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:10.550240 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:10.647941 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:10.647908 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:14.409967 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:14.409931 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:23.083050 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:23.083005 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:23.165969 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:23.165935 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:30.569816 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:30.569783 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:32.241723 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:32.241683 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:32.343329 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:32.343295 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:24:59.201767 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:24:59.201688 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:25:31.588802 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:25:31.588764 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:25:31.595577 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:25:31.595553 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:25:47.295548 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:25:47.295513 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:26:59.668281 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:26:59.668247 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:27:00.455977 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:27:00.455947 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:27:18.482051 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:27:18.482015 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:27:42.863035 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:27:42.862999 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:28:23.337835 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:28:23.337799 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:28:24.094756 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:28:24.094729 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:28:27.047422 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:28:27.047376 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:28:31.310500 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:28:31.310465 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:28:39.123184 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:28:39.123129 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:28:49.329743 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:28:49.329704 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:28:50.660419 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:28:50.660385 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:28:50.760531 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:28:50.760501 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:28:58.976324 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:28:58.976293 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:29:23.749058 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:29:23.748983 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:29:23.850891 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:29:23.850859 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:29:31.589552 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:29:31.589511 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:29:31.645243 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:29:31.645215 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:29:32.918473 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:29:32.918433 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:29:33.019717 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:29:33.019679 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:00.134456 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.134415 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg"] Jul 09 17:30:00.135054 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.135032 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9129192-f380-4676-8b77-364a5fc55696" containerName="maas-api" Jul 09 17:30:00.135153 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.135057 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9129192-f380-4676-8b77-364a5fc55696" containerName="maas-api" Jul 09 17:30:00.135223 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.135167 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9129192-f380-4676-8b77-364a5fc55696" containerName="maas-api" Jul 09 17:30:00.138465 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.138443 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f"] Jul 09 17:30:00.138590 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.138553 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg" Jul 09 17:30:00.151336 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.151303 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z"] Jul 09 17:30:00.154625 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.154393 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f" Jul 09 17:30:00.155452 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.155432 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg"] Jul 09 17:30:00.155676 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.155660 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z" Jul 09 17:30:00.157322 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.157303 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f"] Jul 09 17:30:00.160325 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.160299 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z"] Jul 09 17:30:00.193425 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.193400 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktclh\" (UniqueName: \"kubernetes.io/projected/7a056ac8-8b23-4ebd-a340-710f563f105c-kube-api-access-ktclh\") pod \"maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg\" (UID: \"7a056ac8-8b23-4ebd-a340-710f563f105c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg" Jul 09 17:30:00.294554 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.294519 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktclh\" (UniqueName: \"kubernetes.io/projected/7a056ac8-8b23-4ebd-a340-710f563f105c-kube-api-access-ktclh\") pod \"maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg\" (UID: \"7a056ac8-8b23-4ebd-a340-710f563f105c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg" Jul 09 17:30:00.294722 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.294615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lm9l\" (UniqueName: \"kubernetes.io/projected/500e5479-e5f0-4d1c-9418-44bab0b015ed-kube-api-access-6lm9l\") pod \"maas-api-key-cleanup-29726970-phl6f\" (UID: \"500e5479-e5f0-4d1c-9418-44bab0b015ed\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f" Jul 09 17:30:00.294722 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.294660 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcbpq\" (UniqueName: \"kubernetes.io/projected/bfd0dd27-ab2f-4480-9439-fe2431302908-kube-api-access-dcbpq\") pod \"maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z\" (UID: \"bfd0dd27-ab2f-4480-9439-fe2431302908\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z" Jul 09 17:30:00.303058 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.303030 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktclh\" (UniqueName: \"kubernetes.io/projected/7a056ac8-8b23-4ebd-a340-710f563f105c-kube-api-access-ktclh\") pod \"maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg\" (UID: \"7a056ac8-8b23-4ebd-a340-710f563f105c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg" Jul 09 17:30:00.395781 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.395702 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lm9l\" (UniqueName: \"kubernetes.io/projected/500e5479-e5f0-4d1c-9418-44bab0b015ed-kube-api-access-6lm9l\") pod \"maas-api-key-cleanup-29726970-phl6f\" (UID: \"500e5479-e5f0-4d1c-9418-44bab0b015ed\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f" Jul 09 17:30:00.395781 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.395749 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcbpq\" (UniqueName: \"kubernetes.io/projected/bfd0dd27-ab2f-4480-9439-fe2431302908-kube-api-access-dcbpq\") pod \"maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z\" (UID: \"bfd0dd27-ab2f-4480-9439-fe2431302908\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z" Jul 09 17:30:00.404282 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.404254 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lm9l\" (UniqueName: \"kubernetes.io/projected/500e5479-e5f0-4d1c-9418-44bab0b015ed-kube-api-access-6lm9l\") pod \"maas-api-key-cleanup-29726970-phl6f\" (UID: \"500e5479-e5f0-4d1c-9418-44bab0b015ed\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f" Jul 09 17:30:00.404455 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.404384 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcbpq\" (UniqueName: \"kubernetes.io/projected/bfd0dd27-ab2f-4480-9439-fe2431302908-kube-api-access-dcbpq\") pod \"maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z\" (UID: \"bfd0dd27-ab2f-4480-9439-fe2431302908\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z" Jul 09 17:30:00.461299 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.461258 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg" Jul 09 17:30:00.470336 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.470315 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f" Jul 09 17:30:00.477648 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.477616 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z" Jul 09 17:30:00.678711 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.678681 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z"] Jul 09 17:30:00.680285 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:30:00.680258 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfd0dd27_ab2f_4480_9439_fe2431302908.slice/crio-f50965867df783a7cab9e5fa38bf49d81fadfcb99e1f12e28696fdbee8c9053f WatchSource:0}: Error finding container f50965867df783a7cab9e5fa38bf49d81fadfcb99e1f12e28696fdbee8c9053f: Status 404 returned error can't find the container with id f50965867df783a7cab9e5fa38bf49d81fadfcb99e1f12e28696fdbee8c9053f Jul 09 17:30:00.682140 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.682122 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 17:30:00.836595 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.836570 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg"] Jul 09 17:30:00.839710 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:30:00.839680 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a056ac8_8b23_4ebd_a340_710f563f105c.slice/crio-2525cf4b0cc01298684603b954f88dd8c6f5ce725bd6e364dc0eaff5452b2c44 WatchSource:0}: Error finding container 2525cf4b0cc01298684603b954f88dd8c6f5ce725bd6e364dc0eaff5452b2c44: Status 404 returned error can't find the container with id 2525cf4b0cc01298684603b954f88dd8c6f5ce725bd6e364dc0eaff5452b2c44 Jul 09 17:30:00.861164 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:00.861127 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f"] Jul 09 17:30:00.863548 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:30:00.863524 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500e5479_e5f0_4d1c_9418_44bab0b015ed.slice/crio-6c145b046ebaec2bdd42df19a1da6a0ada72e2ecf75b9feaf15914fda903963c WatchSource:0}: Error finding container 6c145b046ebaec2bdd42df19a1da6a0ada72e2ecf75b9feaf15914fda903963c: Status 404 returned error can't find the container with id 6c145b046ebaec2bdd42df19a1da6a0ada72e2ecf75b9feaf15914fda903963c Jul 09 17:30:01.540502 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:01.540470 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f" event={"ID":"500e5479-e5f0-4d1c-9418-44bab0b015ed","Type":"ContainerStarted","Data":"6c145b046ebaec2bdd42df19a1da6a0ada72e2ecf75b9feaf15914fda903963c"} Jul 09 17:30:01.540912 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:01.540525 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg" event={"ID":"7a056ac8-8b23-4ebd-a340-710f563f105c","Type":"ContainerStarted","Data":"2525cf4b0cc01298684603b954f88dd8c6f5ce725bd6e364dc0eaff5452b2c44"} Jul 09 17:30:01.541671 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:01.541651 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z" event={"ID":"bfd0dd27-ab2f-4480-9439-fe2431302908","Type":"ContainerStarted","Data":"f50965867df783a7cab9e5fa38bf49d81fadfcb99e1f12e28696fdbee8c9053f"} Jul 09 17:30:03.553433 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:03.553402 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z" event={"ID":"bfd0dd27-ab2f-4480-9439-fe2431302908","Type":"ContainerStarted","Data":"52844be67d3f3a884c8ec213d2e742cc58f37e119d8bcd55e19b0fe0284284ed"} Jul 09 17:30:03.554891 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:03.554867 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f" event={"ID":"500e5479-e5f0-4d1c-9418-44bab0b015ed","Type":"ContainerStarted","Data":"a509db2b511a014bbf7965cd8b4c87f4ac5339e16e19682ab83b62660744fd4d"} Jul 09 17:30:03.556332 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:03.556304 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg" event={"ID":"7a056ac8-8b23-4ebd-a340-710f563f105c","Type":"ContainerStarted","Data":"92668f6c7090ab5f1a223d6ca5893a6f13aee60a87c75717b5c9ae5690b5cbd4"} Jul 09 17:30:03.568429 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:03.568392 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z" podStartSLOduration=1.0605058 podStartE2EDuration="3.568356893s" totalImagesPullingTime="2.507851093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:30:03.567617968 +0000 UTC m=+2372.610393220" watchObservedRunningTime="2026-07-09 17:30:03.568356893 +0000 UTC m=+2372.611132143" Jul 09 17:30:03.584102 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:03.584065 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f" podStartSLOduration=1.316790429 podStartE2EDuration="3.584054252s" totalImagesPullingTime="2.267263823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:30:03.582108337 +0000 UTC m=+2372.624883585" watchObservedRunningTime="2026-07-09 17:30:03.584054252 +0000 UTC m=+2372.626829480" Jul 09 17:30:03.597349 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:03.597309 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg" podStartSLOduration=1.253823355 podStartE2EDuration="3.597293987s" totalImagesPullingTime="2.343470632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:30:03.595471522 +0000 UTC m=+2372.638246853" watchObservedRunningTime="2026-07-09 17:30:03.597293987 +0000 UTC m=+2372.640069238" Jul 09 17:30:15.007847 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:15.007809 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:15.763616 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:15.763581 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:16.772880 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:16.772843 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7561-140577984543152"] Jul 09 17:30:16.776469 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:16.776452 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577984543152" Jul 09 17:30:16.779327 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:16.779301 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-4c6xj\"" Jul 09 17:30:16.781879 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:16.781858 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7561-140577984543152"] Jul 09 17:30:16.949280 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:16.949240 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwlf5\" (UniqueName: \"kubernetes.io/projected/1eb2f0e7-d276-44b5-b1f9-86b300847668-kube-api-access-jwlf5\") pod \"test-curl-7561-140577984543152\" (UID: \"1eb2f0e7-d276-44b5-b1f9-86b300847668\") " pod="openshift-ingress/test-curl-7561-140577984543152" Jul 09 17:30:17.050214 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:17.050116 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwlf5\" (UniqueName: \"kubernetes.io/projected/1eb2f0e7-d276-44b5-b1f9-86b300847668-kube-api-access-jwlf5\") pod \"test-curl-7561-140577984543152\" (UID: \"1eb2f0e7-d276-44b5-b1f9-86b300847668\") " pod="openshift-ingress/test-curl-7561-140577984543152" Jul 09 17:30:17.058685 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:17.058655 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwlf5\" (UniqueName: \"kubernetes.io/projected/1eb2f0e7-d276-44b5-b1f9-86b300847668-kube-api-access-jwlf5\") pod \"test-curl-7561-140577984543152\" (UID: \"1eb2f0e7-d276-44b5-b1f9-86b300847668\") " pod="openshift-ingress/test-curl-7561-140577984543152" Jul 09 17:30:17.086541 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:17.086512 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577984543152" Jul 09 17:30:17.224527 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:17.224504 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7561-140577984543152"] Jul 09 17:30:17.229722 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:30:17.229690 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1eb2f0e7_d276_44b5_b1f9_86b300847668.slice/crio-03da7f65d09886dc904ad6118b2edd4b5759c22b41a994425ed1469d7aa4b96e WatchSource:0}: Error finding container 03da7f65d09886dc904ad6118b2edd4b5759c22b41a994425ed1469d7aa4b96e: Status 404 returned error can't find the container with id 03da7f65d09886dc904ad6118b2edd4b5759c22b41a994425ed1469d7aa4b96e Jul 09 17:30:17.641509 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:17.641468 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7561-140577984543152" event={"ID":"1eb2f0e7-d276-44b5-b1f9-86b300847668","Type":"ContainerStarted","Data":"03da7f65d09886dc904ad6118b2edd4b5759c22b41a994425ed1469d7aa4b96e"} Jul 09 17:30:18.648750 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:18.648718 2554 generic.go:356] "Generic (PLEG): container finished" podID="1eb2f0e7-d276-44b5-b1f9-86b300847668" containerID="dd20bcca83fc32bd1ad92fe095a8807b986a94352633ebe6c1b5f93842a2fcf2" exitCode=0 Jul 09 17:30:18.649119 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:18.648767 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7561-140577984543152" event={"ID":"1eb2f0e7-d276-44b5-b1f9-86b300847668","Type":"ContainerDied","Data":"dd20bcca83fc32bd1ad92fe095a8807b986a94352633ebe6c1b5f93842a2fcf2"} Jul 09 17:30:19.801297 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:19.801272 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577984543152" Jul 09 17:30:19.828039 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:19.828008 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7561-140577984543152_1eb2f0e7-d276-44b5-b1f9-86b300847668/test-curl-7561-140577984543152/0.log" Jul 09 17:30:19.854990 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:19.854945 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7561-140577984543152"] Jul 09 17:30:19.859946 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:19.859911 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7561-140577984543152"] Jul 09 17:30:19.977684 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:19.977600 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwlf5\" (UniqueName: \"kubernetes.io/projected/1eb2f0e7-d276-44b5-b1f9-86b300847668-kube-api-access-jwlf5\") pod \"1eb2f0e7-d276-44b5-b1f9-86b300847668\" (UID: \"1eb2f0e7-d276-44b5-b1f9-86b300847668\") " Jul 09 17:30:19.980013 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:19.979969 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eb2f0e7-d276-44b5-b1f9-86b300847668-kube-api-access-jwlf5" (OuterVolumeSpecName: "kube-api-access-jwlf5") pod "1eb2f0e7-d276-44b5-b1f9-86b300847668" (UID: "1eb2f0e7-d276-44b5-b1f9-86b300847668"). InnerVolumeSpecName "kube-api-access-jwlf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:30:19.982946 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:19.982916 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7561-140577984544048"] Jul 09 17:30:19.983668 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:19.983647 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb2f0e7-d276-44b5-b1f9-86b300847668" containerName="test-curl-7561-140577984543152" Jul 09 17:30:19.983786 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:19.983671 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb2f0e7-d276-44b5-b1f9-86b300847668" containerName="test-curl-7561-140577984543152" Jul 09 17:30:19.983846 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:19.983827 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eb2f0e7-d276-44b5-b1f9-86b300847668" containerName="test-curl-7561-140577984543152" Jul 09 17:30:19.987601 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:19.987577 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577984544048" Jul 09 17:30:19.989904 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:19.989881 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7561-140577984544048"] Jul 09 17:30:20.079047 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:20.079010 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c72jx\" (UniqueName: \"kubernetes.io/projected/c6234184-cc92-46a1-b8ad-4538e9f9b9fa-kube-api-access-c72jx\") pod \"test-curl-7561-140577984544048\" (UID: \"c6234184-cc92-46a1-b8ad-4538e9f9b9fa\") " pod="openshift-ingress/test-curl-7561-140577984544048" Jul 09 17:30:20.079261 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:20.079192 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwlf5\" (UniqueName: \"kubernetes.io/projected/1eb2f0e7-d276-44b5-b1f9-86b300847668-kube-api-access-jwlf5\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:30:20.180515 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:20.180477 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c72jx\" (UniqueName: \"kubernetes.io/projected/c6234184-cc92-46a1-b8ad-4538e9f9b9fa-kube-api-access-c72jx\") pod \"test-curl-7561-140577984544048\" (UID: \"c6234184-cc92-46a1-b8ad-4538e9f9b9fa\") " pod="openshift-ingress/test-curl-7561-140577984544048" Jul 09 17:30:20.188914 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:20.188887 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c72jx\" (UniqueName: \"kubernetes.io/projected/c6234184-cc92-46a1-b8ad-4538e9f9b9fa-kube-api-access-c72jx\") pod \"test-curl-7561-140577984544048\" (UID: \"c6234184-cc92-46a1-b8ad-4538e9f9b9fa\") " pod="openshift-ingress/test-curl-7561-140577984544048" Jul 09 17:30:20.300534 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:20.300445 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577984544048" Jul 09 17:30:20.440147 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:20.440118 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7561-140577984544048"] Jul 09 17:30:20.442256 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:30:20.442225 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6234184_cc92_46a1_b8ad_4538e9f9b9fa.slice/crio-330ae0c6786cf1f2f243429c8106f49c0ed4a12b7a9c3a3ba2968d3f1e01b8c8 WatchSource:0}: Error finding container 330ae0c6786cf1f2f243429c8106f49c0ed4a12b7a9c3a3ba2968d3f1e01b8c8: Status 404 returned error can't find the container with id 330ae0c6786cf1f2f243429c8106f49c0ed4a12b7a9c3a3ba2968d3f1e01b8c8 Jul 09 17:30:20.661041 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:20.661002 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7561-140577984544048" event={"ID":"c6234184-cc92-46a1-b8ad-4538e9f9b9fa","Type":"ContainerStarted","Data":"330ae0c6786cf1f2f243429c8106f49c0ed4a12b7a9c3a3ba2968d3f1e01b8c8"} Jul 09 17:30:20.662326 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:20.662306 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03da7f65d09886dc904ad6118b2edd4b5759c22b41a994425ed1469d7aa4b96e" Jul 09 17:30:20.662326 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:20.662318 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577984543152" Jul 09 17:30:20.673799 ip-10-0-132-57 kubenswrapper[2554]: E0709 17:30:20.673767 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7561-140577984543152\" is forbidden: User \"system:node:ip-10-0-132-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-132-57.ec2.internal' and this object" podUID="1eb2f0e7-d276-44b5-b1f9-86b300847668" pod="openshift-ingress/test-curl-7561-140577984543152" Jul 09 17:30:21.543383 ip-10-0-132-57 kubenswrapper[2554]: E0709 17:30:21.543323 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7561-140577984543152\" is forbidden: User \"system:node:ip-10-0-132-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-132-57.ec2.internal' and this object" podUID="1eb2f0e7-d276-44b5-b1f9-86b300847668" pod="openshift-ingress/test-curl-7561-140577984543152" Jul 09 17:30:21.547620 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:21.547586 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eb2f0e7-d276-44b5-b1f9-86b300847668" path="/var/lib/kubelet/pods/1eb2f0e7-d276-44b5-b1f9-86b300847668/volumes" Jul 09 17:30:21.669255 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:21.669218 2554 generic.go:356] "Generic (PLEG): container finished" podID="c6234184-cc92-46a1-b8ad-4538e9f9b9fa" containerID="3350c070982b42826cf7a9ffee6f37a728f0e950fb8c25819532a202c91a7009" exitCode=0 Jul 09 17:30:21.669442 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:21.669284 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7561-140577984544048" event={"ID":"c6234184-cc92-46a1-b8ad-4538e9f9b9fa","Type":"ContainerDied","Data":"3350c070982b42826cf7a9ffee6f37a728f0e950fb8c25819532a202c91a7009"} Jul 09 17:30:22.829335 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:22.829310 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577984544048" Jul 09 17:30:22.848719 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:22.848695 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7561-140577984544048_c6234184-cc92-46a1-b8ad-4538e9f9b9fa/test-curl-7561-140577984544048/0.log" Jul 09 17:30:22.873762 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:22.873726 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7561-140577984544048"] Jul 09 17:30:22.875806 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:22.875783 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7561-140577984544048"] Jul 09 17:30:23.008334 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.008235 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c72jx\" (UniqueName: \"kubernetes.io/projected/c6234184-cc92-46a1-b8ad-4538e9f9b9fa-kube-api-access-c72jx\") pod \"c6234184-cc92-46a1-b8ad-4538e9f9b9fa\" (UID: \"c6234184-cc92-46a1-b8ad-4538e9f9b9fa\") " Jul 09 17:30:23.010322 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.010293 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6234184-cc92-46a1-b8ad-4538e9f9b9fa-kube-api-access-c72jx" (OuterVolumeSpecName: "kube-api-access-c72jx") pod "c6234184-cc92-46a1-b8ad-4538e9f9b9fa" (UID: "c6234184-cc92-46a1-b8ad-4538e9f9b9fa"). InnerVolumeSpecName "kube-api-access-c72jx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:30:23.039047 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.039015 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7561-140577980376960"] Jul 09 17:30:23.039500 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.039486 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6234184-cc92-46a1-b8ad-4538e9f9b9fa" containerName="test-curl-7561-140577984544048" Jul 09 17:30:23.039544 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.039501 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6234184-cc92-46a1-b8ad-4538e9f9b9fa" containerName="test-curl-7561-140577984544048" Jul 09 17:30:23.039593 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.039584 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6234184-cc92-46a1-b8ad-4538e9f9b9fa" containerName="test-curl-7561-140577984544048" Jul 09 17:30:23.042767 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.042751 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577980376960" Jul 09 17:30:23.046719 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.046691 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7561-140577980376960"] Jul 09 17:30:23.109597 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.109567 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c72jx\" (UniqueName: \"kubernetes.io/projected/c6234184-cc92-46a1-b8ad-4538e9f9b9fa-kube-api-access-c72jx\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:30:23.210448 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.210412 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67j8t\" (UniqueName: \"kubernetes.io/projected/e283ada7-9e18-4a9c-aa94-4f0d29e21902-kube-api-access-67j8t\") pod \"test-curl-7561-140577980376960\" (UID: \"e283ada7-9e18-4a9c-aa94-4f0d29e21902\") " pod="openshift-ingress/test-curl-7561-140577980376960" Jul 09 17:30:23.311177 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.311088 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67j8t\" (UniqueName: \"kubernetes.io/projected/e283ada7-9e18-4a9c-aa94-4f0d29e21902-kube-api-access-67j8t\") pod \"test-curl-7561-140577980376960\" (UID: \"e283ada7-9e18-4a9c-aa94-4f0d29e21902\") " pod="openshift-ingress/test-curl-7561-140577980376960" Jul 09 17:30:23.320038 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.320010 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67j8t\" (UniqueName: \"kubernetes.io/projected/e283ada7-9e18-4a9c-aa94-4f0d29e21902-kube-api-access-67j8t\") pod \"test-curl-7561-140577980376960\" (UID: \"e283ada7-9e18-4a9c-aa94-4f0d29e21902\") " pod="openshift-ingress/test-curl-7561-140577980376960" Jul 09 17:30:23.352997 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.352948 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577980376960" Jul 09 17:30:23.491678 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.491648 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7561-140577980376960"] Jul 09 17:30:23.493291 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:30:23.493259 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode283ada7_9e18_4a9c_aa94_4f0d29e21902.slice/crio-d5ca7b6d169606d88cd1e703f8a42dc2bd11d692102904a99034216e9be1383c WatchSource:0}: Error finding container d5ca7b6d169606d88cd1e703f8a42dc2bd11d692102904a99034216e9be1383c: Status 404 returned error can't find the container with id d5ca7b6d169606d88cd1e703f8a42dc2bd11d692102904a99034216e9be1383c Jul 09 17:30:23.541820 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.541789 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6234184-cc92-46a1-b8ad-4538e9f9b9fa" path="/var/lib/kubelet/pods/c6234184-cc92-46a1-b8ad-4538e9f9b9fa/volumes" Jul 09 17:30:23.681091 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.681068 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577984544048" Jul 09 17:30:23.681091 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.681090 2554 scope.go:117] "RemoveContainer" containerID="3350c070982b42826cf7a9ffee6f37a728f0e950fb8c25819532a202c91a7009" Jul 09 17:30:23.682555 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:23.682521 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7561-140577980376960" event={"ID":"e283ada7-9e18-4a9c-aa94-4f0d29e21902","Type":"ContainerStarted","Data":"d5ca7b6d169606d88cd1e703f8a42dc2bd11d692102904a99034216e9be1383c"} Jul 09 17:30:24.689012 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:24.688981 2554 generic.go:356] "Generic (PLEG): container finished" podID="e283ada7-9e18-4a9c-aa94-4f0d29e21902" containerID="23cb26a554965d7c3a2cdaf86d5bf2356e23b88cf1c33c232b3073d7f6847bc2" exitCode=0 Jul 09 17:30:24.689436 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:24.689104 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7561-140577980376960" event={"ID":"e283ada7-9e18-4a9c-aa94-4f0d29e21902","Type":"ContainerDied","Data":"23cb26a554965d7c3a2cdaf86d5bf2356e23b88cf1c33c232b3073d7f6847bc2"} Jul 09 17:30:25.858549 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:25.858514 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577980376960" Jul 09 17:30:25.878138 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:25.878107 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7561-140577980376960_e283ada7-9e18-4a9c-aa94-4f0d29e21902/test-curl-7561-140577980376960/0.log" Jul 09 17:30:25.900387 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:25.900334 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7561-140577980376960"] Jul 09 17:30:25.903847 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:25.903820 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7561-140577980376960"] Jul 09 17:30:25.937881 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:25.937829 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67j8t\" (UniqueName: \"kubernetes.io/projected/e283ada7-9e18-4a9c-aa94-4f0d29e21902-kube-api-access-67j8t\") pod \"e283ada7-9e18-4a9c-aa94-4f0d29e21902\" (UID: \"e283ada7-9e18-4a9c-aa94-4f0d29e21902\") " Jul 09 17:30:25.939985 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:25.939962 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e283ada7-9e18-4a9c-aa94-4f0d29e21902-kube-api-access-67j8t" (OuterVolumeSpecName: "kube-api-access-67j8t") pod "e283ada7-9e18-4a9c-aa94-4f0d29e21902" (UID: "e283ada7-9e18-4a9c-aa94-4f0d29e21902"). InnerVolumeSpecName "kube-api-access-67j8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:30:26.021046 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.021012 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7561-140577980376960"] Jul 09 17:30:26.021551 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.021536 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e283ada7-9e18-4a9c-aa94-4f0d29e21902" containerName="test-curl-7561-140577980376960" Jul 09 17:30:26.021615 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.021553 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e283ada7-9e18-4a9c-aa94-4f0d29e21902" containerName="test-curl-7561-140577980376960" Jul 09 17:30:26.021650 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.021641 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e283ada7-9e18-4a9c-aa94-4f0d29e21902" containerName="test-curl-7561-140577980376960" Jul 09 17:30:26.024752 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.024733 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577980376960" Jul 09 17:30:26.030334 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.030311 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7561-140577980376960"] Jul 09 17:30:26.039400 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.039356 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62dwf\" (UniqueName: \"kubernetes.io/projected/e25ac50b-99ac-4633-bbea-af56168d6ec9-kube-api-access-62dwf\") pod \"test-curl-7561-140577980376960\" (UID: \"e25ac50b-99ac-4633-bbea-af56168d6ec9\") " pod="openshift-ingress/test-curl-7561-140577980376960" Jul 09 17:30:26.039522 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.039423 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67j8t\" (UniqueName: \"kubernetes.io/projected/e283ada7-9e18-4a9c-aa94-4f0d29e21902-kube-api-access-67j8t\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:30:26.139917 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.139877 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62dwf\" (UniqueName: \"kubernetes.io/projected/e25ac50b-99ac-4633-bbea-af56168d6ec9-kube-api-access-62dwf\") pod \"test-curl-7561-140577980376960\" (UID: \"e25ac50b-99ac-4633-bbea-af56168d6ec9\") " pod="openshift-ingress/test-curl-7561-140577980376960" Jul 09 17:30:26.148009 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.147981 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62dwf\" (UniqueName: \"kubernetes.io/projected/e25ac50b-99ac-4633-bbea-af56168d6ec9-kube-api-access-62dwf\") pod \"test-curl-7561-140577980376960\" (UID: \"e25ac50b-99ac-4633-bbea-af56168d6ec9\") " pod="openshift-ingress/test-curl-7561-140577980376960" Jul 09 17:30:26.336307 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.336219 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577980376960" Jul 09 17:30:26.471033 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.471008 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7561-140577980376960"] Jul 09 17:30:26.472674 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:30:26.472643 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode25ac50b_99ac_4633_bbea_af56168d6ec9.slice/crio-0965655abd972d7edc2bfd34822a9472ea715acce0c9aa35ad8404ae59b190dd WatchSource:0}: Error finding container 0965655abd972d7edc2bfd34822a9472ea715acce0c9aa35ad8404ae59b190dd: Status 404 returned error can't find the container with id 0965655abd972d7edc2bfd34822a9472ea715acce0c9aa35ad8404ae59b190dd Jul 09 17:30:26.702433 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.702393 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5ca7b6d169606d88cd1e703f8a42dc2bd11d692102904a99034216e9be1383c" Jul 09 17:30:26.702433 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.702397 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577980376960" Jul 09 17:30:26.703797 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.703763 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7561-140577980376960" event={"ID":"e25ac50b-99ac-4633-bbea-af56168d6ec9","Type":"ContainerStarted","Data":"0965655abd972d7edc2bfd34822a9472ea715acce0c9aa35ad8404ae59b190dd"} Jul 09 17:30:26.714148 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:26.714117 2554 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7561-140577980376960" oldPodUID="e283ada7-9e18-4a9c-aa94-4f0d29e21902" podUID="e25ac50b-99ac-4633-bbea-af56168d6ec9" Jul 09 17:30:27.541017 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:27.540981 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e283ada7-9e18-4a9c-aa94-4f0d29e21902" path="/var/lib/kubelet/pods/e283ada7-9e18-4a9c-aa94-4f0d29e21902/volumes" Jul 09 17:30:27.711358 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:27.711321 2554 generic.go:356] "Generic (PLEG): container finished" podID="e25ac50b-99ac-4633-bbea-af56168d6ec9" containerID="56f5256e7d6a51297030f035ac223dd3cc6a0c18067b20edbac0221ec2dfae69" exitCode=0 Jul 09 17:30:27.711514 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:27.711415 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7561-140577980376960" event={"ID":"e25ac50b-99ac-4633-bbea-af56168d6ec9","Type":"ContainerDied","Data":"56f5256e7d6a51297030f035ac223dd3cc6a0c18067b20edbac0221ec2dfae69"} Jul 09 17:30:28.867114 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:28.867089 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577980376960" Jul 09 17:30:28.886279 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:28.886252 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7561-140577980376960_e25ac50b-99ac-4633-bbea-af56168d6ec9/test-curl-7561-140577980376960/0.log" Jul 09 17:30:28.909754 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:28.909725 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7561-140577980376960"] Jul 09 17:30:28.915033 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:28.915004 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7561-140577980376960"] Jul 09 17:30:28.968179 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:28.968101 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62dwf\" (UniqueName: \"kubernetes.io/projected/e25ac50b-99ac-4633-bbea-af56168d6ec9-kube-api-access-62dwf\") pod \"e25ac50b-99ac-4633-bbea-af56168d6ec9\" (UID: \"e25ac50b-99ac-4633-bbea-af56168d6ec9\") " Jul 09 17:30:28.970188 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:28.970162 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e25ac50b-99ac-4633-bbea-af56168d6ec9-kube-api-access-62dwf" (OuterVolumeSpecName: "kube-api-access-62dwf") pod "e25ac50b-99ac-4633-bbea-af56168d6ec9" (UID: "e25ac50b-99ac-4633-bbea-af56168d6ec9"). InnerVolumeSpecName "kube-api-access-62dwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:30:29.039928 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.039894 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7561-140577980377968"] Jul 09 17:30:29.040342 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.040330 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e25ac50b-99ac-4633-bbea-af56168d6ec9" containerName="test-curl-7561-140577980376960" Jul 09 17:30:29.040411 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.040344 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e25ac50b-99ac-4633-bbea-af56168d6ec9" containerName="test-curl-7561-140577980376960" Jul 09 17:30:29.040450 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.040438 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e25ac50b-99ac-4633-bbea-af56168d6ec9" containerName="test-curl-7561-140577980376960" Jul 09 17:30:29.043559 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.043543 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577980377968" Jul 09 17:30:29.047953 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.047928 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7561-140577980377968"] Jul 09 17:30:29.069328 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.069297 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xms8s\" (UniqueName: \"kubernetes.io/projected/84424cb3-46b2-4b53-8761-c2f16fbe9238-kube-api-access-xms8s\") pod \"test-curl-7561-140577980377968\" (UID: \"84424cb3-46b2-4b53-8761-c2f16fbe9238\") " pod="openshift-ingress/test-curl-7561-140577980377968" Jul 09 17:30:29.069468 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.069378 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62dwf\" (UniqueName: \"kubernetes.io/projected/e25ac50b-99ac-4633-bbea-af56168d6ec9-kube-api-access-62dwf\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:30:29.170166 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.170127 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xms8s\" (UniqueName: \"kubernetes.io/projected/84424cb3-46b2-4b53-8761-c2f16fbe9238-kube-api-access-xms8s\") pod \"test-curl-7561-140577980377968\" (UID: \"84424cb3-46b2-4b53-8761-c2f16fbe9238\") " pod="openshift-ingress/test-curl-7561-140577980377968" Jul 09 17:30:29.179605 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.179577 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xms8s\" (UniqueName: \"kubernetes.io/projected/84424cb3-46b2-4b53-8761-c2f16fbe9238-kube-api-access-xms8s\") pod \"test-curl-7561-140577980377968\" (UID: \"84424cb3-46b2-4b53-8761-c2f16fbe9238\") " pod="openshift-ingress/test-curl-7561-140577980377968" Jul 09 17:30:29.353936 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.353850 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577980377968" Jul 09 17:30:29.493132 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.493108 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7561-140577980377968"] Jul 09 17:30:29.494860 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:30:29.494829 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84424cb3_46b2_4b53_8761_c2f16fbe9238.slice/crio-afe9548e419c501410ac17f55354a2b469f8e3850d89e3a1b4d8f7a80511b5bd WatchSource:0}: Error finding container afe9548e419c501410ac17f55354a2b469f8e3850d89e3a1b4d8f7a80511b5bd: Status 404 returned error can't find the container with id afe9548e419c501410ac17f55354a2b469f8e3850d89e3a1b4d8f7a80511b5bd Jul 09 17:30:29.547016 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.546983 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e25ac50b-99ac-4633-bbea-af56168d6ec9" path="/var/lib/kubelet/pods/e25ac50b-99ac-4633-bbea-af56168d6ec9/volumes" Jul 09 17:30:29.724225 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.724196 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577980376960" Jul 09 17:30:29.724432 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.724209 2554 scope.go:117] "RemoveContainer" containerID="56f5256e7d6a51297030f035ac223dd3cc6a0c18067b20edbac0221ec2dfae69" Jul 09 17:30:29.725634 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:29.725577 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7561-140577980377968" event={"ID":"84424cb3-46b2-4b53-8761-c2f16fbe9238","Type":"ContainerStarted","Data":"afe9548e419c501410ac17f55354a2b469f8e3850d89e3a1b4d8f7a80511b5bd"} Jul 09 17:30:30.733037 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:30.733000 2554 generic.go:356] "Generic (PLEG): container finished" podID="84424cb3-46b2-4b53-8761-c2f16fbe9238" containerID="f372a36f1ddf0d30cb5b439f2399a4ce09dac6f4ad69a058e82a58dcbab07271" exitCode=0 Jul 09 17:30:30.733426 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:30.733050 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7561-140577980377968" event={"ID":"84424cb3-46b2-4b53-8761-c2f16fbe9238","Type":"ContainerDied","Data":"f372a36f1ddf0d30cb5b439f2399a4ce09dac6f4ad69a058e82a58dcbab07271"} Jul 09 17:30:31.623923 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:31.623899 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:30:31.630387 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:31.630342 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:30:31.889420 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:31.889400 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577980377968" Jul 09 17:30:31.911864 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:31.911839 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7561-140577980377968_84424cb3-46b2-4b53-8761-c2f16fbe9238/test-curl-7561-140577980377968/0.log" Jul 09 17:30:31.940116 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:31.940082 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7561-140577980377968"] Jul 09 17:30:31.942599 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:31.942573 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7561-140577980377968"] Jul 09 17:30:31.996915 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:31.996879 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xms8s\" (UniqueName: \"kubernetes.io/projected/84424cb3-46b2-4b53-8761-c2f16fbe9238-kube-api-access-xms8s\") pod \"84424cb3-46b2-4b53-8761-c2f16fbe9238\" (UID: \"84424cb3-46b2-4b53-8761-c2f16fbe9238\") " Jul 09 17:30:31.998934 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:31.998903 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84424cb3-46b2-4b53-8761-c2f16fbe9238-kube-api-access-xms8s" (OuterVolumeSpecName: "kube-api-access-xms8s") pod "84424cb3-46b2-4b53-8761-c2f16fbe9238" (UID: "84424cb3-46b2-4b53-8761-c2f16fbe9238"). InnerVolumeSpecName "kube-api-access-xms8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:30:32.097920 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:32.097888 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xms8s\" (UniqueName: \"kubernetes.io/projected/84424cb3-46b2-4b53-8761-c2f16fbe9238-kube-api-access-xms8s\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:30:32.744757 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:32.744729 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7561-140577980377968" Jul 09 17:30:32.744757 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:32.744754 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afe9548e419c501410ac17f55354a2b469f8e3850d89e3a1b4d8f7a80511b5bd" Jul 09 17:30:32.754903 ip-10-0-132-57 kubenswrapper[2554]: E0709 17:30:32.754875 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7561-140577980377968\" is forbidden: User \"system:node:ip-10-0-132-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-132-57.ec2.internal' and this object" podUID="84424cb3-46b2-4b53-8761-c2f16fbe9238" pod="openshift-ingress/test-curl-7561-140577980377968" Jul 09 17:30:33.540329 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:33.540292 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84424cb3-46b2-4b53-8761-c2f16fbe9238" path="/var/lib/kubelet/pods/84424cb3-46b2-4b53-8761-c2f16fbe9238/volumes" Jul 09 17:30:34.900296 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:34.900230 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:35.303087 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:35.303003 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:35.403379 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:35.403343 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:35.515454 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:35.515420 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:35.579802 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:35.579718 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z"] Jul 09 17:30:35.579947 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:35.579910 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z" podUID="bfd0dd27-ab2f-4480-9439-fe2431302908" containerName="cleanup" containerID="cri-o://52844be67d3f3a884c8ec213d2e742cc58f37e119d8bcd55e19b0fe0284284ed" gracePeriod=30 Jul 09 17:30:35.583920 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:35.583896 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:41.906242 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:41.906173 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:42.005254 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:42.005224 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:42.106710 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:42.106678 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:42.571840 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:42.571810 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:42.671355 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:42.671326 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:42.818240 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:42.818207 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:42.826413 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:42.826332 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg"] Jul 09 17:30:42.826567 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:42.826545 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg" podUID="7a056ac8-8b23-4ebd-a340-710f563f105c" containerName="cleanup" containerID="cri-o://92668f6c7090ab5f1a223d6ca5893a6f13aee60a87c75717b5c9ae5690b5cbd4" gracePeriod=30 Jul 09 17:30:48.372514 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:48.372483 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:48.495709 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:48.495663 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:48.643128 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:48.643086 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:48.900977 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:48.900897 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:30:54.312423 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:54.312330 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-66d8c97569-v5cdw_05749339-3006-4d9d-bd66-2f4e667b9ee5/manager/0.log" Jul 09 17:30:54.564358 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:54.564283 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4q8p5_191e58c8-307d-4e6e-bcfe-97fbc3d7801b/manager/0.log" Jul 09 17:30:54.680812 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:54.680790 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-789dddf866-44m2w_02cf5953-c877-4978-87f0-ab5d76535b14/copy-manifests/0.log" Jul 09 17:30:54.692804 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:54.692776 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-789dddf866-44m2w_02cf5953-c877-4978-87f0-ab5d76535b14/manager/0.log" Jul 09 17:30:55.301630 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:55.301598 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-66574c666d-9x56k_5b7bea53-2681-4e90-806b-86fca95c17ca/maas-api/0.log" Jul 09 17:30:55.417405 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:55.417354 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29726970-phl6f_500e5479-e5f0-4d1c-9418-44bab0b015ed/cleanup/0.log" Jul 09 17:30:55.527869 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:55.527844 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z_bfd0dd27-ab2f-4480-9439-fe2431302908/cleanup/0.log" Jul 09 17:30:55.644917 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:55.644893 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg_7a056ac8-8b23-4ebd-a340-710f563f105c/cleanup/0.log" Jul 09 17:30:55.755427 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:55.755399 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-fhqlb_70de4996-7cb6-4dc0-bd52-b7f373c52148/postgres/0.log" Jul 09 17:30:57.151702 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:57.151677 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-d4n8v_c50db898-6890-4c10-9585-115d59cbb02b/manager/0.log" Jul 09 17:30:57.270509 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:57.270483 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mwm7q_3d7d6387-ac95-4482-b02b-1be43105f3d5/manager/0.log" Jul 09 17:30:57.512885 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:57.512795 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nrjrh_24bd2005-3d25-40bf-ba7b-cdfb64a7d538/registry-server/0.log" Jul 09 17:30:57.652341 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:57.652299 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8v8tg_6f1f9222-2e68-4913-8a0d-c20769378177/manager/0.log" Jul 09 17:30:57.892099 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:57.892055 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rrwtm_7c25ce23-165d-42a6-9112-5da2682c3df5/manager/0.log" Jul 09 17:30:58.488380 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:58.488326 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc96589f5-gs57w_d575e9cd-a523-491d-8541-57cef5693c77/kube-auth-proxy/0.log" Jul 09 17:30:58.849628 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:58.849542 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-j7fk7_b04c49dc-05e4-4c15-a771-29fe9c60c188/payload-pre-processing/0.log" Jul 09 17:30:59.088630 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:59.088586 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bfddd6d84-ldxz4_d131f137-3bee-4979-89b5-daafa4bd9deb/router/0.log" Jul 09 17:30:59.436879 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:59.436850 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-8gwmm_892a4a9d-33e7-46b9-a480-5a51b938f6f2/main/0.log" Jul 09 17:30:59.777245 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:59.777164 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgdcm9_3bf61948-9e28-44ab-9598-60b379bcfee9/main/0.log" Jul 09 17:30:59.901006 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:30:59.900976 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gjrdg_cd92ab15-dab8-4728-9e53-41523e9e0c97/main/0.log" Jul 09 17:31:00.013897 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:00.013865 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f"] Jul 09 17:31:00.014070 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:00.014050 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f" podUID="500e5479-e5f0-4d1c-9418-44bab0b015ed" containerName="cleanup" containerID="cri-o://a509db2b511a014bbf7965cd8b4c87f4ac5339e16e19682ab83b62660744fd4d" gracePeriod=30 Jul 09 17:31:00.531243 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:00.531201 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:31:04.188449 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:04.188414 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:31:04.262327 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:04.262298 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:31:05.765782 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:05.765758 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z" Jul 09 17:31:05.914703 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:05.914675 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcbpq\" (UniqueName: \"kubernetes.io/projected/bfd0dd27-ab2f-4480-9439-fe2431302908-kube-api-access-dcbpq\") pod \"bfd0dd27-ab2f-4480-9439-fe2431302908\" (UID: \"bfd0dd27-ab2f-4480-9439-fe2431302908\") " Jul 09 17:31:05.917152 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:05.917122 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfd0dd27-ab2f-4480-9439-fe2431302908-kube-api-access-dcbpq" (OuterVolumeSpecName: "kube-api-access-dcbpq") pod "bfd0dd27-ab2f-4480-9439-fe2431302908" (UID: "bfd0dd27-ab2f-4480-9439-fe2431302908"). InnerVolumeSpecName "kube-api-access-dcbpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:31:05.920997 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:05.920971 2554 generic.go:356] "Generic (PLEG): container finished" podID="bfd0dd27-ab2f-4480-9439-fe2431302908" containerID="52844be67d3f3a884c8ec213d2e742cc58f37e119d8bcd55e19b0fe0284284ed" exitCode=137 Jul 09 17:31:05.921096 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:05.921005 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z" event={"ID":"bfd0dd27-ab2f-4480-9439-fe2431302908","Type":"ContainerDied","Data":"52844be67d3f3a884c8ec213d2e742cc58f37e119d8bcd55e19b0fe0284284ed"} Jul 09 17:31:05.921096 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:05.921030 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z" Jul 09 17:31:05.921096 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:05.921042 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z" event={"ID":"bfd0dd27-ab2f-4480-9439-fe2431302908","Type":"ContainerDied","Data":"f50965867df783a7cab9e5fa38bf49d81fadfcb99e1f12e28696fdbee8c9053f"} Jul 09 17:31:05.921096 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:05.921064 2554 scope.go:117] "RemoveContainer" containerID="52844be67d3f3a884c8ec213d2e742cc58f37e119d8bcd55e19b0fe0284284ed" Jul 09 17:31:05.932579 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:05.932565 2554 scope.go:117] "RemoveContainer" containerID="52844be67d3f3a884c8ec213d2e742cc58f37e119d8bcd55e19b0fe0284284ed" Jul 09 17:31:05.932808 ip-10-0-132-57 kubenswrapper[2554]: E0709 17:31:05.932793 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52844be67d3f3a884c8ec213d2e742cc58f37e119d8bcd55e19b0fe0284284ed\": container with ID starting with 52844be67d3f3a884c8ec213d2e742cc58f37e119d8bcd55e19b0fe0284284ed not found: ID does not exist" containerID="52844be67d3f3a884c8ec213d2e742cc58f37e119d8bcd55e19b0fe0284284ed" Jul 09 17:31:05.932848 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:05.932816 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52844be67d3f3a884c8ec213d2e742cc58f37e119d8bcd55e19b0fe0284284ed"} err="failed to get container status \"52844be67d3f3a884c8ec213d2e742cc58f37e119d8bcd55e19b0fe0284284ed\": rpc error: code = NotFound desc = could not find container \"52844be67d3f3a884c8ec213d2e742cc58f37e119d8bcd55e19b0fe0284284ed\": container with ID starting with 52844be67d3f3a884c8ec213d2e742cc58f37e119d8bcd55e19b0fe0284284ed not found: ID does not exist" Jul 09 17:31:05.944130 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:05.944106 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z"] Jul 09 17:31:05.948679 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:05.948652 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abbe5-29726970-jwn6z"] Jul 09 17:31:06.015550 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:06.015520 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcbpq\" (UniqueName: \"kubernetes.io/projected/bfd0dd27-ab2f-4480-9439-fe2431302908-kube-api-access-dcbpq\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:31:06.959484 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:06.959451 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f7rmt_1c2a0c99-8fb4-486d-8e71-e714c7dc1c0f/global-pull-secret-syncer/0.log" Jul 09 17:31:07.009587 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:07.009547 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" Jul 09 17:31:07.137357 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:07.137328 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-57.ec2.internal_087471a9f59f7c1e03f22c0bf78eab5d/haproxy/0.log" Jul 09 17:31:07.540972 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:07.540938 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfd0dd27-ab2f-4480-9439-fe2431302908" path="/var/lib/kubelet/pods/bfd0dd27-ab2f-4480-9439-fe2431302908/volumes" Jul 09 17:31:11.824648 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:11.824598 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:31:11.926181 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:11.926152 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c874l_862c17b2-7e3e-4971-8cfa-3cb73d2fce4b/konnectivity-agent/0.log" limit=1024 Jul 09 17:31:12.937542 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:12.937512 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-d4n8v_c50db898-6890-4c10-9585-115d59cbb02b/manager/0.log" Jul 09 17:31:12.965559 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:12.965511 2554 generic.go:356] "Generic (PLEG): container finished" podID="7a056ac8-8b23-4ebd-a340-710f563f105c" containerID="92668f6c7090ab5f1a223d6ca5893a6f13aee60a87c75717b5c9ae5690b5cbd4" exitCode=137 Jul 09 17:31:12.965798 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:12.965597 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg" event={"ID":"7a056ac8-8b23-4ebd-a340-710f563f105c","Type":"ContainerDied","Data":"92668f6c7090ab5f1a223d6ca5893a6f13aee60a87c75717b5c9ae5690b5cbd4"} Jul 09 17:31:12.981163 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:12.981130 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mwm7q_3d7d6387-ac95-4482-b02b-1be43105f3d5/manager/0.log" Jul 09 17:31:13.031682 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:13.031655 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg" Jul 09 17:31:13.066586 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:13.066560 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nrjrh_24bd2005-3d25-40bf-ba7b-cdfb64a7d538/registry-server/0.log" Jul 09 17:31:13.075325 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:13.075302 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktclh\" (UniqueName: \"kubernetes.io/projected/7a056ac8-8b23-4ebd-a340-710f563f105c-kube-api-access-ktclh\") pod \"7a056ac8-8b23-4ebd-a340-710f563f105c\" (UID: \"7a056ac8-8b23-4ebd-a340-710f563f105c\") " Jul 09 17:31:13.077267 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:13.077241 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a056ac8-8b23-4ebd-a340-710f563f105c-kube-api-access-ktclh" (OuterVolumeSpecName: "kube-api-access-ktclh") pod "7a056ac8-8b23-4ebd-a340-710f563f105c" (UID: "7a056ac8-8b23-4ebd-a340-710f563f105c"). InnerVolumeSpecName "kube-api-access-ktclh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:31:13.175938 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:13.175901 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktclh\" (UniqueName: \"kubernetes.io/projected/7a056ac8-8b23-4ebd-a340-710f563f105c-kube-api-access-ktclh\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:31:13.213614 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:13.213572 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8v8tg_6f1f9222-2e68-4913-8a0d-c20769378177/manager/0.log" Jul 09 17:31:13.330529 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:13.330494 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rrwtm_7c25ce23-165d-42a6-9112-5da2682c3df5/manager/0.log" Jul 09 17:31:13.972130 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:13.972104 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg" Jul 09 17:31:13.972591 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:13.972135 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg" event={"ID":"7a056ac8-8b23-4ebd-a340-710f563f105c","Type":"ContainerDied","Data":"2525cf4b0cc01298684603b954f88dd8c6f5ce725bd6e364dc0eaff5452b2c44"} Jul 09 17:31:13.972591 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:13.972200 2554 scope.go:117] "RemoveContainer" containerID="92668f6c7090ab5f1a223d6ca5893a6f13aee60a87c75717b5c9ae5690b5cbd4" Jul 09 17:31:13.991988 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:13.991967 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg"] Jul 09 17:31:13.995360 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:13.995338 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-265f70-29726970-nf8cg"] Jul 09 17:31:15.132027 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:15.131999 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-vzqx2_030be92e-4ef0-4a99-a4e8-d5f55803bb62/cluster-monitoring-operator/0.log" Jul 09 17:31:15.384679 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:15.384607 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kqb9_27488284-4e29-46cc-93d9-631a2ddcac16/node-exporter/0.log" Jul 09 17:31:15.425593 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:15.425571 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kqb9_27488284-4e29-46cc-93d9-631a2ddcac16/kube-rbac-proxy/0.log" Jul 09 17:31:15.464506 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:15.464478 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kqb9_27488284-4e29-46cc-93d9-631a2ddcac16/init-textfile/0.log" Jul 09 17:31:15.541319 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:15.541287 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a056ac8-8b23-4ebd-a340-710f563f105c" path="/var/lib/kubelet/pods/7a056ac8-8b23-4ebd-a340-710f563f105c/volumes" Jul 09 17:31:15.920090 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:15.920065 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-rzlf9_2f2bc738-82ea-40ba-bb67-05944b7b7fd0/prometheus-operator/0.log" Jul 09 17:31:15.936844 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:15.936826 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-rzlf9_2f2bc738-82ea-40ba-bb67-05944b7b7fd0/kube-rbac-proxy/0.log" Jul 09 17:31:15.963167 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:15.963148 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-pbzjm_7fa4694e-d6bc-4237-8abd-43b4634bbe4a/prometheus-operator-admission-webhook/0.log" Jul 09 17:31:16.770309 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.770274 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv"] Jul 09 17:31:16.770764 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.770750 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a056ac8-8b23-4ebd-a340-710f563f105c" containerName="cleanup" Jul 09 17:31:16.770813 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.770767 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a056ac8-8b23-4ebd-a340-710f563f105c" containerName="cleanup" Jul 09 17:31:16.770813 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.770779 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfd0dd27-ab2f-4480-9439-fe2431302908" containerName="cleanup" Jul 09 17:31:16.770813 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.770784 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd0dd27-ab2f-4480-9439-fe2431302908" containerName="cleanup" Jul 09 17:31:16.770813 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.770791 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84424cb3-46b2-4b53-8761-c2f16fbe9238" containerName="test-curl-7561-140577980377968" Jul 09 17:31:16.770813 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.770799 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="84424cb3-46b2-4b53-8761-c2f16fbe9238" containerName="test-curl-7561-140577980377968" Jul 09 17:31:16.770980 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.770874 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="84424cb3-46b2-4b53-8761-c2f16fbe9238" containerName="test-curl-7561-140577980377968" Jul 09 17:31:16.770980 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.770885 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a056ac8-8b23-4ebd-a340-710f563f105c" containerName="cleanup" Jul 09 17:31:16.770980 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.770891 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfd0dd27-ab2f-4480-9439-fe2431302908" containerName="cleanup" Jul 09 17:31:16.775488 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.775467 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.778167 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.778143 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qjspn\"/\"openshift-service-ca.crt\"" Jul 09 17:31:16.778296 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.778191 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qjspn\"/\"kube-root-ca.crt\"" Jul 09 17:31:16.779390 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.779351 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qjspn\"/\"default-dockercfg-d452k\"" Jul 09 17:31:16.784161 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.784135 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv"] Jul 09 17:31:16.810354 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.810323 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvdhp\" (UniqueName: \"kubernetes.io/projected/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-kube-api-access-wvdhp\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.810508 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.810387 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-proc\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.810508 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.810439 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-lib-modules\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.810508 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.810487 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-sys\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.810686 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.810513 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-podres\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.911537 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.911512 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-proc\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.911664 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.911548 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-lib-modules\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.911664 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.911581 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-sys\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.911664 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.911606 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-podres\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.911664 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.911626 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-proc\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.911796 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.911700 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-sys\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.911796 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.911713 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-podres\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.911796 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.911723 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdhp\" (UniqueName: \"kubernetes.io/projected/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-kube-api-access-wvdhp\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.911796 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.911702 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-lib-modules\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:16.920186 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:16.920161 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvdhp\" (UniqueName: \"kubernetes.io/projected/ecc8846d-8637-4e8a-887b-6d32f92bb7a8-kube-api-access-wvdhp\") pod \"perf-node-gather-daemonset-h8jpv\" (UID: \"ecc8846d-8637-4e8a-887b-6d32f92bb7a8\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:17.085666 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:17.085593 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:17.223104 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:17.223075 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv"] Jul 09 17:31:17.224376 ip-10-0-132-57 kubenswrapper[2554]: W0709 17:31:17.224324 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podecc8846d_8637_4e8a_887b_6d32f92bb7a8.slice/crio-41c3d1f1b088c25afbeba3b481966516879267a4c9550a877df74ca42435bc7c WatchSource:0}: Error finding container 41c3d1f1b088c25afbeba3b481966516879267a4c9550a877df74ca42435bc7c: Status 404 returned error can't find the container with id 41c3d1f1b088c25afbeba3b481966516879267a4c9550a877df74ca42435bc7c Jul 09 17:31:17.363758 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:17.363690 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-hmngr_18807929-f09f-43ee-bf4a-280ef5005665/networking-console-plugin/0.log" Jul 09 17:31:17.985106 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:17.985075 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/1.log" Jul 09 17:31:17.988961 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:17.988940 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nj9s6_4e25e426-6b92-427a-a57a-3cef3ca130df/console-operator/2.log" Jul 09 17:31:17.995923 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:17.995893 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" event={"ID":"ecc8846d-8637-4e8a-887b-6d32f92bb7a8","Type":"ContainerStarted","Data":"1a605b4ae669c96d20be8477d42c824c1eb51db8742f80f51739f0f0817d5a92"} Jul 09 17:31:17.996045 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:17.995955 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:17.996045 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:17.995979 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" event={"ID":"ecc8846d-8637-4e8a-887b-6d32f92bb7a8","Type":"ContainerStarted","Data":"41c3d1f1b088c25afbeba3b481966516879267a4c9550a877df74ca42435bc7c"} Jul 09 17:31:18.011668 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:18.011624 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" podStartSLOduration=2.011612063 podStartE2EDuration="2.011612063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:31:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:31:18.010592128 +0000 UTC m=+2447.053367379" watchObservedRunningTime="2026-07-09 17:31:18.011612063 +0000 UTC m=+2447.054387312" Jul 09 17:31:18.449124 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:18.449099 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5867d4d7c7-7wpjz_15e8bf54-7f9d-42fc-8f52-e379deb11dff/console/0.log" Jul 09 17:31:18.478567 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:18.478539 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-vg4p8_466ffcf6-d687-4473-84e1-116404ca3718/download-server/0.log" Jul 09 17:31:19.019112 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:19.019089 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-8qhrw_b9ea0f7d-503b-4f39-b1d4-fa4698cb24c8/volume-data-source-validator/0.log" Jul 09 17:31:20.004564 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:20.004534 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6vr4n_d9cac543-ec4f-47b6-be53-f3ac697c99d6/dns/0.log" Jul 09 17:31:20.027549 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:20.027522 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6vr4n_d9cac543-ec4f-47b6-be53-f3ac697c99d6/kube-rbac-proxy/0.log" Jul 09 17:31:20.230729 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:20.230697 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nnnfb_44bd29d3-9dcd-4792-8176-7eb4aee75a2c/dns-node-resolver/0.log" Jul 09 17:31:20.825531 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:20.825501 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b86bcd54c-j8gxx_b1404334-3914-449b-b1e3-1f77334dcaab/registry/0.log" Jul 09 17:31:20.889694 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:20.889671 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nms4w_52f9eea5-3668-4c12-ba94-ea441750861f/node-ca/0.log" Jul 09 17:31:22.068023 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:22.067995 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc96589f5-gs57w_d575e9cd-a523-491d-8541-57cef5693c77/kube-auth-proxy/0.log" Jul 09 17:31:22.180879 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:22.180852 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-j7fk7_b04c49dc-05e4-4c15-a771-29fe9c60c188/payload-pre-processing/0.log" Jul 09 17:31:22.229058 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:22.229028 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bfddd6d84-ldxz4_d131f137-3bee-4979-89b5-daafa4bd9deb/router/0.log" Jul 09 17:31:22.946398 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:22.946356 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v9h26_7f888d89-ac7e-4d32-bb6d-ece8c6a5974a/serve-healthcheck-canary/0.log" Jul 09 17:31:23.389609 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:23.389575 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-mzdjr_86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1/insights-operator/0.log" Jul 09 17:31:23.390030 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:23.389946 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-mzdjr_86cf7e9d-3d57-451d-9c6d-5cb0e1dd49c1/insights-operator/1.log" Jul 09 17:31:23.410446 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:23.410425 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9bk6q_71f2e19d-a596-4872-8897-1a911b056109/kube-rbac-proxy/0.log" Jul 09 17:31:23.432466 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:23.432440 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9bk6q_71f2e19d-a596-4872-8897-1a911b056109/exporter/0.log" Jul 09 17:31:23.454487 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:23.454468 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9bk6q_71f2e19d-a596-4872-8897-1a911b056109/extractor/0.log" Jul 09 17:31:24.012042 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:24.012016 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-h8jpv" Jul 09 17:31:26.237960 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:26.237929 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-66d8c97569-v5cdw_05749339-3006-4d9d-bd66-2f4e667b9ee5/manager/0.log" Jul 09 17:31:26.321322 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:26.321300 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4q8p5_191e58c8-307d-4e6e-bcfe-97fbc3d7801b/manager/0.log" Jul 09 17:31:26.390816 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:26.390788 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-789dddf866-44m2w_02cf5953-c877-4978-87f0-ab5d76535b14/manager/0.log" Jul 09 17:31:26.407856 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:26.407835 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-789dddf866-44m2w_02cf5953-c877-4978-87f0-ab5d76535b14/copy-manifests/0.log" Jul 09 17:31:27.810295 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:27.810257 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc96589f5-gs57w_d575e9cd-a523-491d-8541-57cef5693c77/kube-auth-proxy/0.log" Jul 09 17:31:27.894728 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:27.894703 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-j7fk7_b04c49dc-05e4-4c15-a771-29fe9c60c188/payload-pre-processing/0.log" Jul 09 17:31:27.938303 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:27.938276 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bfddd6d84-ldxz4_d131f137-3bee-4979-89b5-daafa4bd9deb/router/0.log" Jul 09 17:31:29.276168 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:29.276133 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc96589f5-gs57w_d575e9cd-a523-491d-8541-57cef5693c77/kube-auth-proxy/0.log" Jul 09 17:31:29.359956 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:29.359928 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-j7fk7_b04c49dc-05e4-4c15-a771-29fe9c60c188/payload-pre-processing/0.log" Jul 09 17:31:29.398920 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:29.398893 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bfddd6d84-ldxz4_d131f137-3bee-4979-89b5-daafa4bd9deb/router/0.log" Jul 09 17:31:30.060684 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:30.060657 2554 generic.go:356] "Generic (PLEG): container finished" podID="500e5479-e5f0-4d1c-9418-44bab0b015ed" containerID="a509db2b511a014bbf7965cd8b4c87f4ac5339e16e19682ab83b62660744fd4d" exitCode=137 Jul 09 17:31:30.060789 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:30.060698 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f" event={"ID":"500e5479-e5f0-4d1c-9418-44bab0b015ed","Type":"ContainerDied","Data":"a509db2b511a014bbf7965cd8b4c87f4ac5339e16e19682ab83b62660744fd4d"} Jul 09 17:31:30.197870 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:30.197844 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f" Jul 09 17:31:30.332069 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:30.331987 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lm9l\" (UniqueName: \"kubernetes.io/projected/500e5479-e5f0-4d1c-9418-44bab0b015ed-kube-api-access-6lm9l\") pod \"500e5479-e5f0-4d1c-9418-44bab0b015ed\" (UID: \"500e5479-e5f0-4d1c-9418-44bab0b015ed\") " Jul 09 17:31:30.333959 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:30.333935 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/500e5479-e5f0-4d1c-9418-44bab0b015ed-kube-api-access-6lm9l" (OuterVolumeSpecName: "kube-api-access-6lm9l") pod "500e5479-e5f0-4d1c-9418-44bab0b015ed" (UID: "500e5479-e5f0-4d1c-9418-44bab0b015ed"). InnerVolumeSpecName "kube-api-access-6lm9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:31:30.433682 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:30.433653 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lm9l\" (UniqueName: \"kubernetes.io/projected/500e5479-e5f0-4d1c-9418-44bab0b015ed-kube-api-access-6lm9l\") on node \"ip-10-0-132-57.ec2.internal\" DevicePath \"\"" Jul 09 17:31:31.067750 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:31.067720 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f" Jul 09 17:31:31.067937 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:31.067713 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f" event={"ID":"500e5479-e5f0-4d1c-9418-44bab0b015ed","Type":"ContainerDied","Data":"6c145b046ebaec2bdd42df19a1da6a0ada72e2ecf75b9feaf15914fda903963c"} Jul 09 17:31:31.067937 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:31.067865 2554 scope.go:117] "RemoveContainer" containerID="a509db2b511a014bbf7965cd8b4c87f4ac5339e16e19682ab83b62660744fd4d" Jul 09 17:31:31.089285 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:31.089262 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f"] Jul 09 17:31:31.093099 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:31.093080 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-phl6f"] Jul 09 17:31:31.541582 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:31.541551 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="500e5479-e5f0-4d1c-9418-44bab0b015ed" path="/var/lib/kubelet/pods/500e5479-e5f0-4d1c-9418-44bab0b015ed/volumes" Jul 09 17:31:32.592980 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:32.592950 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-kctr7_dca3a140-9f64-4dda-ab8a-435df418b17a/migrator/0.log" Jul 09 17:31:32.612704 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:32.612676 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-kctr7_dca3a140-9f64-4dda-ab8a-435df418b17a/graceful-termination/0.log" Jul 09 17:31:33.015320 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:33.015288 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-qmt54_1876b077-aa7e-412c-9d33-b579aa0da20e/kube-storage-version-migrator-operator/1.log" Jul 09 17:31:33.016032 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:33.016015 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-qmt54_1876b077-aa7e-412c-9d33-b579aa0da20e/kube-storage-version-migrator-operator/0.log" Jul 09 17:31:34.042415 ip-10-0-132-57 kubenswrapper[2554]: I0709 17:31:34.042388 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5hgnp_1b2f3565-468b-40b1-aa95-05eaf1ea2288/kube-multus/0.log"