Aug 02 09:31:00.702449 ip-10-0-142-118 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Aug 02 09:31:00.702458 ip-10-0-142-118 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Aug 02 09:31:00.702467 ip-10-0-142-118 systemd[1]: kubelet.service: Failed with result 'resources'. Aug 02 09:31:00.702741 ip-10-0-142-118 systemd[1]: Failed to start Kubernetes Kubelet. Aug 02 09:31:10.932006 ip-10-0-142-118 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Aug 02 09:31:10.932027 ip-10-0-142-118 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d96e91dc60584c8aa55fa27f6108368b -- Aug 02 09:32:43.308063 ip-10-0-142-118 systemd[1]: Starting Kubernetes Kubelet... Aug 02 09:32:43.759644 ip-10-0-142-118 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 02 09:32:43.759644 ip-10-0-142-118 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 02 09:32:43.759644 ip-10-0-142-118 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 02 09:32:43.759644 ip-10-0-142-118 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 02 09:32:43.759644 ip-10-0-142-118 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 02 09:32:43.761799 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.761695 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 02 09:32:43.766723 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766706 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 02 09:32:43.766723 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766724 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766728 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766732 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766736 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766741 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766744 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766747 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766750 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766753 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766756 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766758 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766761 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766763 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766766 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766769 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766782 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766785 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766790 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766794 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 02 09:32:43.766807 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766797 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766800 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766803 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766806 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766809 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766812 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766815 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766818 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766822 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766824 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766827 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766830 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766832 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766835 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766837 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766840 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766843 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766846 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766848 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766851 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 02 09:32:43.767252 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766853 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766856 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766858 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766861 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766864 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766866 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766869 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766871 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766874 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766876 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766879 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766881 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766883 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766886 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766890 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766893 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766897 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766900 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766902 2575 feature_gate.go:328] unrecognized feature gate: Example2 Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766905 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 02 09:32:43.767747 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766908 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766912 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766915 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766918 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766920 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766923 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766925 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766928 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766931 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766934 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766937 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766940 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766942 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766945 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766948 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766950 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766953 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766956 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766958 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 02 09:32:43.768232 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766961 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766963 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766966 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766968 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766971 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766973 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766976 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766981 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766984 2575 feature_gate.go:328] unrecognized feature gate: Example Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766987 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766989 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766992 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766995 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766997 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.766999 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767002 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767005 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767007 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767010 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767026 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 02 09:32:43.768695 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767768 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767789 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767792 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767795 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767798 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767802 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767805 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767808 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767811 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767813 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767816 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767818 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767821 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767824 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767826 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767829 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767831 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767834 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767839 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 02 09:32:43.769249 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767843 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767846 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767848 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767851 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767854 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767857 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767859 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767862 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767864 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767867 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767870 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767872 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767875 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767877 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767880 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767882 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767885 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767887 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767890 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767893 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 02 09:32:43.769718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767895 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767898 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767901 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767904 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767907 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767911 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767915 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767918 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767921 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767924 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767927 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767929 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767932 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767934 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767937 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767940 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767942 2575 feature_gate.go:328] unrecognized feature gate: Example2 Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767945 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767948 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767951 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 02 09:32:43.770222 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767953 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767956 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767959 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767961 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767963 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767966 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767969 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767971 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767974 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767976 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767979 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767981 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767985 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767988 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767992 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767994 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767997 2575 feature_gate.go:328] unrecognized feature gate: Example Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.767999 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768002 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768006 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 02 09:32:43.770707 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768009 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768011 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768015 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768027 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768030 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768032 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768035 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768038 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768040 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768043 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768046 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768048 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768051 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768053 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768055 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768058 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768060 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768063 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768066 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 02 09:32:43.771216 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768070 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768455 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768461 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768464 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768467 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768471 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768474 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768477 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768479 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768483 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768487 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768491 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768494 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768497 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768500 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768503 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768506 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768508 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768511 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 02 09:32:43.771680 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768513 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768518 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768520 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768523 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768525 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768528 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768531 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768533 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768536 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768539 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768542 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768544 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768546 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768549 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768551 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768554 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768557 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768559 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768562 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768565 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 02 09:32:43.772157 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768568 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768571 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768573 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768576 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768578 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768581 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768584 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768586 2575 feature_gate.go:328] unrecognized feature gate: Example Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768589 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768592 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768595 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768598 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768601 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768604 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768606 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768609 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768611 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768614 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768617 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768619 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 02 09:32:43.772796 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768622 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768625 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768627 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768630 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768633 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768635 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768638 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768640 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768643 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768646 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768648 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768650 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768653 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768656 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768658 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768661 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768663 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768666 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768669 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768671 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 02 09:32:43.773301 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768674 2575 feature_gate.go:328] unrecognized feature gate: Example2 Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768676 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768679 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768681 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768684 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768687 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768689 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768692 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768695 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768697 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768700 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768703 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768706 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768709 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768713 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768716 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768719 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768722 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768724 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768727 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 02 09:32:43.773810 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.768730 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768818 2575 flags.go:64] FLAG: --address="0.0.0.0" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768833 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768839 2575 flags.go:64] FLAG: --anonymous-auth="true" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768843 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768849 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768852 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768856 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768860 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768864 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768867 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768870 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768876 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768879 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768882 2575 flags.go:64] FLAG: --cgroup-root="" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768885 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768888 2575 flags.go:64] FLAG: --client-ca-file="" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768891 2575 flags.go:64] FLAG: --cloud-provider="external" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768894 2575 flags.go:64] FLAG: --cluster-dns="[]" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768900 2575 flags.go:64] FLAG: --cluster-domain="" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768903 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768906 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768909 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768912 2575 flags.go:64] FLAG: --container-log-max-files="5" Aug 02 09:32:43.774316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768917 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768920 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768923 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768927 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768930 2575 flags.go:64] FLAG: --contention-profiling="false" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768933 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768936 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768939 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768942 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768967 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768972 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768975 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768979 2575 flags.go:64] FLAG: --enable-load-reader="false" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768982 2575 flags.go:64] FLAG: --enable-server="true" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768986 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768991 2575 flags.go:64] FLAG: --event-burst="100" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768994 2575 flags.go:64] FLAG: --event-qps="50" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.768997 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769000 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769002 2575 flags.go:64] FLAG: --eviction-hard="" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769008 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769011 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769014 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769017 2575 flags.go:64] FLAG: --eviction-soft="" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769020 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 02 09:32:43.774895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769023 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769025 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769028 2575 flags.go:64] FLAG: --experimental-mounter-path="" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769031 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769034 2575 flags.go:64] FLAG: --fail-swap-on="true" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769037 2575 flags.go:64] FLAG: --feature-gates="" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769043 2575 flags.go:64] FLAG: --file-check-frequency="20s" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769047 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769051 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769054 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769057 2575 flags.go:64] FLAG: --healthz-port="10248" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769060 2575 flags.go:64] FLAG: --help="false" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769063 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-142-118.ec2.internal" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769066 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769069 2575 flags.go:64] FLAG: --http-check-frequency="20s" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769073 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769076 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769079 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769082 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769085 2575 flags.go:64] FLAG: --image-service-endpoint="" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769088 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769091 2575 flags.go:64] FLAG: --kube-api-burst="100" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769094 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769097 2575 flags.go:64] FLAG: --kube-api-qps="50" Aug 02 09:32:43.775512 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769100 2575 flags.go:64] FLAG: --kube-reserved="" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769103 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769105 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769110 2575 flags.go:64] FLAG: --kubelet-cgroups="" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769112 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769115 2575 flags.go:64] FLAG: --lock-file="" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769118 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769121 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769124 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769129 2575 flags.go:64] FLAG: --log-json-split-stream="false" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769132 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769134 2575 flags.go:64] FLAG: --log-text-split-stream="false" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769137 2575 flags.go:64] FLAG: --logging-format="text" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769140 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769143 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769148 2575 flags.go:64] FLAG: --manifest-url="" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769151 2575 flags.go:64] FLAG: --manifest-url-header="" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769155 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769159 2575 flags.go:64] FLAG: --max-open-files="1000000" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769163 2575 flags.go:64] FLAG: --max-pods="110" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769166 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769169 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769172 2575 flags.go:64] FLAG: --memory-manager-policy="None" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769175 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769178 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 02 09:32:43.776181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769181 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769184 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769191 2575 flags.go:64] FLAG: --node-status-max-images="50" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769194 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769197 2575 flags.go:64] FLAG: --oom-score-adj="-999" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769200 2575 flags.go:64] FLAG: --pod-cidr="" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769204 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769209 2575 flags.go:64] FLAG: --pod-manifest-path="" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769212 2575 flags.go:64] FLAG: --pod-max-pids="-1" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769216 2575 flags.go:64] FLAG: --pods-per-core="0" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769218 2575 flags.go:64] FLAG: --port="10250" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769223 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769226 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0eb4fe0770c214ad5" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769229 2575 flags.go:64] FLAG: --qos-reserved="" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769232 2575 flags.go:64] FLAG: --read-only-port="10255" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769235 2575 flags.go:64] FLAG: --register-node="true" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769238 2575 flags.go:64] FLAG: --register-with-taints="" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769242 2575 flags.go:64] FLAG: --registry-burst="10" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769245 2575 flags.go:64] FLAG: --registry-qps="5" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769248 2575 flags.go:64] FLAG: --reserved-cpus="" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769251 2575 flags.go:64] FLAG: --reserved-memory="" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769254 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769259 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769263 2575 flags.go:64] FLAG: --rotate-certificates="false" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769266 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 02 09:32:43.777013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769269 2575 flags.go:64] FLAG: --runonce="false" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769272 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769275 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769278 2575 flags.go:64] FLAG: --seccomp-default="false" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769281 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769284 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769287 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769290 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769293 2575 flags.go:64] FLAG: --storage-driver-password="root" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769295 2575 flags.go:64] FLAG: --storage-driver-secure="false" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769298 2575 flags.go:64] FLAG: --storage-driver-table="stats" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769300 2575 flags.go:64] FLAG: --storage-driver-user="root" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769303 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769306 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769310 2575 flags.go:64] FLAG: --system-cgroups="" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769312 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769318 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769320 2575 flags.go:64] FLAG: --tls-cert-file="" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769325 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769329 2575 flags.go:64] FLAG: --tls-min-version="" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769332 2575 flags.go:64] FLAG: --tls-private-key-file="" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769335 2575 flags.go:64] FLAG: --topology-manager-policy="none" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769338 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769341 2575 flags.go:64] FLAG: --topology-manager-scope="container" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769344 2575 flags.go:64] FLAG: --v="2" Aug 02 09:32:43.777635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769348 2575 flags.go:64] FLAG: --version="false" Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769352 2575 flags.go:64] FLAG: --vmodule="" Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769356 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769359 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769484 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769488 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769491 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769494 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769497 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769499 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769502 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769504 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769507 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769510 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769513 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769515 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769518 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769520 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769523 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769526 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 02 09:32:43.778382 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769530 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769533 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769536 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769539 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769542 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769546 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769549 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769552 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769555 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769557 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769560 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769562 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769565 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769569 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769573 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769576 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769580 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769582 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769584 2575 feature_gate.go:328] unrecognized feature gate: Example Aug 02 09:32:43.778880 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769587 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769590 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769592 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769595 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769598 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769600 2575 feature_gate.go:328] unrecognized feature gate: Example2 Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769602 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769605 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769608 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769610 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769613 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769615 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769618 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769620 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769623 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769626 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769628 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769631 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769635 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769638 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 02 09:32:43.779343 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769640 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769643 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769645 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769648 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769651 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769655 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769657 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769660 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769663 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769667 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769669 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769672 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769675 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769677 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769680 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769683 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769685 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769688 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769691 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769693 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 02 09:32:43.779842 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769696 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769698 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769701 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769704 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769706 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769709 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769712 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769714 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769717 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769720 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769724 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769726 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769729 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769732 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769735 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769738 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769740 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769743 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769746 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 02 09:32:43.780329 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769748 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769750 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769754 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769757 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.769759 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.769768 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.777147 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.777161 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.778071 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.778078 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778136 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778141 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778145 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778148 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778151 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 02 09:32:43.780822 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778154 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778157 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778159 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778162 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778165 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778168 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778171 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778174 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778176 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778179 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778182 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778184 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778187 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778190 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778193 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778195 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778198 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778200 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778203 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 02 09:32:43.781207 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778206 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778208 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778211 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778214 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778217 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778220 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778223 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778226 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778229 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778231 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778234 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778237 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778239 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778242 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778244 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778247 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778249 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778252 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778254 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778257 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 02 09:32:43.781717 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778259 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778262 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778265 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778267 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778270 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778272 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778275 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778277 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778280 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778282 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778285 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778287 2575 feature_gate.go:328] unrecognized feature gate: Example Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778290 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778292 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778295 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778297 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778300 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778305 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778309 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778312 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 02 09:32:43.782228 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778316 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778319 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778322 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778325 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778328 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778330 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778333 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778335 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778338 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778341 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778343 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778346 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778348 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778350 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778353 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778356 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778358 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778361 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778363 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 02 09:32:43.782714 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778365 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778368 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778371 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778373 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778376 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778378 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778380 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778383 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778386 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778389 2575 feature_gate.go:328] unrecognized feature gate: Example2 Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778392 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778395 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778398 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778401 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778405 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 02 09:32:43.783365 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778409 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.778414 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778525 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778536 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778540 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778543 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778546 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778549 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778552 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778555 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778557 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778560 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778562 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778566 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778569 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 02 09:32:43.783955 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778572 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778574 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778577 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778579 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778582 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778584 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778586 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778589 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778591 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778594 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778596 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778599 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778601 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778604 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778607 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778610 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778613 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778615 2575 feature_gate.go:328] unrecognized feature gate: Example Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778618 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778620 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 02 09:32:43.784490 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778623 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778625 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778628 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778630 2575 feature_gate.go:328] unrecognized feature gate: Example2 Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778633 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778635 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778638 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778640 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778642 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778645 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778648 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778651 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778653 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778656 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778659 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778661 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778663 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778666 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778668 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778671 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 02 09:32:43.785039 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778673 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778676 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778678 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778681 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778685 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778689 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778692 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778694 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778697 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778700 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778702 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778705 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778707 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778709 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778712 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778714 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778717 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778721 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 02 09:32:43.785604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778724 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778727 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778730 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778732 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778735 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778737 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778740 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778743 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778746 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778748 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778751 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778754 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778756 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778759 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778761 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778763 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778766 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778769 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778790 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 02 09:32:43.786075 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778794 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 02 09:32:43.786544 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778797 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 02 09:32:43.786544 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778800 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 02 09:32:43.786544 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778803 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 02 09:32:43.786544 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778806 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 02 09:32:43.786544 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778809 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 02 09:32:43.786544 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778811 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 02 09:32:43.786544 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778814 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 02 09:32:43.786544 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:43.778816 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 02 09:32:43.786544 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.778821 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 02 09:32:43.786544 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.778926 2575 server.go:962] "Client rotation is on, will bootstrap in background" Aug 02 09:32:43.786544 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.781332 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 02 09:32:43.786544 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.782948 2575 server.go:1019] "Starting client certificate rotation" Aug 02 09:32:43.786544 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.783341 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 02 09:32:43.786544 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.783558 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 02 09:32:43.787405 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.787390 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 02 09:32:43.789488 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.789473 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 02 09:32:43.799892 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.799873 2575 log.go:25] "Validated CRI v1 runtime API" Aug 02 09:32:43.804330 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.804314 2575 log.go:25] "Validated CRI v1 image API" Aug 02 09:32:43.805180 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.805158 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 02 09:32:43.807886 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.807865 2575 fs.go:135] Filesystem UUIDs: map[2c4348f5-a74a-425b-bfe9-b139b14d45fa:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ca2608a8-ff0b-4ce8-afeb-da3dd98b53d1:/dev/nvme0n1p4] Aug 02 09:32:43.807959 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.807886 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 02 09:32:43.812540 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.812430 2575 manager.go:216] Machine: {Timestamp:2026-08-02 09:32:43.811907949 +0000 UTC m=+0.373063260 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3081010 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2294d67bf7ef4d1a59537100d8cca4 SystemUUID:ec2294d6-7bf7-ef4d-1a59-537100d8cca4 BootID:d96e91dc-6058-4c8a-a55f-a27f6108368b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:55:f2:48:2b:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:55:f2:48:2b:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:cf:ff:47:2a:bc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 02 09:32:43.812540 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.812529 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 02 09:32:43.812673 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.812603 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 02 09:32:43.813966 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.813951 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 02 09:32:43.816263 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.816240 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 02 09:32:43.816419 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.816267 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 02 09:32:43.817215 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.817205 2575 topology_manager.go:138] "Creating topology manager with none policy" Aug 02 09:32:43.817253 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.817218 2575 container_manager_linux.go:309] "Creating device plugin manager" Aug 02 09:32:43.817253 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.817226 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 02 09:32:43.817253 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.817235 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 02 09:32:43.818525 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.818515 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 02 09:32:43.823854 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.823843 2575 state_mem.go:36] "Initialized new in-memory state store" Aug 02 09:32:43.823972 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.823963 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 02 09:32:43.824007 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.824002 2575 kubelet.go:486] "Attempting to sync node with API server" Aug 02 09:32:43.824038 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.824020 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 02 09:32:43.824038 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.824035 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 02 09:32:43.824132 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.824044 2575 kubelet.go:398] "Adding apiserver pod source" Aug 02 09:32:43.824132 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.824054 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 02 09:32:43.824493 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.824480 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 02 09:32:43.824527 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.824505 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 02 09:32:43.826844 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.826822 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 02 09:32:43.829429 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.829406 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 02 09:32:43.829507 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.829454 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 02 09:32:43.830843 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.830828 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 02 09:32:43.830891 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.830859 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 02 09:32:43.830891 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.830870 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 02 09:32:43.830891 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.830881 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 02 09:32:43.830982 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.830894 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 02 09:32:43.830982 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.830903 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 02 09:32:43.830982 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.830916 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 02 09:32:43.830982 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.830925 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 02 09:32:43.830982 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.830942 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 02 09:32:43.830982 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.830950 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 02 09:32:43.830982 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.830969 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 02 09:32:43.830982 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.830980 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 02 09:32:43.832869 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.832847 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 02 09:32:43.832869 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.832869 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 02 09:32:43.836323 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.836309 2575 server.go:1268] "Started kubelet" Aug 02 09:32:43.836433 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.836387 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 02 09:32:43.836489 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.836419 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 02 09:32:43.836489 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.836480 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 02 09:32:43.836914 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:43.836878 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 02 09:32:43.837014 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.836956 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 02 09:32:43.837074 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:43.837047 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 02 09:32:43.837243 ip-10-0-142-118 systemd[1]: Started Kubernetes Kubelet. Aug 02 09:32:43.837985 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.837968 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 02 09:32:43.838569 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.838542 2575 server.go:310] "Adding debug handlers to kubelet server" Aug 02 09:32:43.842024 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:43.840889 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-118.ec2.internal.18c7f32fc8f639a3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-118.ec2.internal,UID:ip-10-0-142-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-118.ec2.internal,},FirstTimestamp:2026-08-02 09:32:43.836283299 +0000 UTC m=+0.397438610,LastTimestamp:2026-08-02 09:32:43.836283299 +0000 UTC m=+0.397438610,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-118.ec2.internal,}" Aug 02 09:32:43.842961 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:43.842932 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 02 09:32:43.847803 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.847786 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 02 09:32:43.848214 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.847790 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 02 09:32:43.848214 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:43.847968 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-118.ec2.internal\" not found" Aug 02 09:32:43.848657 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.848630 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 02 09:32:43.848657 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.848631 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 02 09:32:43.848799 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.848662 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 02 09:32:43.848799 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.848728 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 02 09:32:43.848799 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.848741 2575 factory.go:55] Registering systemd factory Aug 02 09:32:43.848799 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.848751 2575 factory.go:223] Registration of the systemd container factory successfully Aug 02 09:32:43.848799 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.848791 2575 reconstruct.go:97] "Volume reconstruction finished" Aug 02 09:32:43.848799 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.848802 2575 reconciler.go:29] "Reconciler: start to sync state" Aug 02 09:32:43.849081 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.849001 2575 factory.go:153] Registering CRI-O factory Aug 02 09:32:43.849081 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.849016 2575 factory.go:223] Registration of the crio container factory successfully Aug 02 09:32:43.849081 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.849038 2575 factory.go:103] Registering Raw factory Aug 02 09:32:43.849081 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.849052 2575 manager.go:1196] Started watching for new ooms in manager Aug 02 09:32:43.849434 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.849420 2575 manager.go:349] Starting recovery of all containers Aug 02 09:32:43.856543 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.856518 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cp8dd" Aug 02 09:32:43.858090 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:43.858057 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 02 09:32:43.858185 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:43.858106 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 02 09:32:43.859452 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.859177 2575 manager.go:354] Recovery completed Aug 02 09:32:43.863756 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.863737 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cp8dd" Aug 02 09:32:43.866283 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.866270 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 02 09:32:43.869302 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.869283 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasSufficientMemory" Aug 02 09:32:43.869425 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.869317 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasNoDiskPressure" Aug 02 09:32:43.869425 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.869336 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasSufficientPID" Aug 02 09:32:43.869928 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.869844 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 02 09:32:43.869928 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.869860 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 02 09:32:43.869928 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.869866 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 02 09:32:43.869928 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.869877 2575 state_mem.go:36] "Initialized new in-memory state store" Aug 02 09:32:43.870566 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.870550 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasSufficientMemory" Aug 02 09:32:43.870634 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.870577 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasNoDiskPressure" Aug 02 09:32:43.870634 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.870586 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasSufficientPID" Aug 02 09:32:43.871893 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.871880 2575 policy_none.go:49] "None policy: Start" Aug 02 09:32:43.871942 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.871897 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 02 09:32:43.871942 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.871908 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 02 09:32:43.874004 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.873987 2575 policy_none.go:47] "Start" Aug 02 09:32:43.905584 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.905399 2575 manager.go:337] "Starting Device Plugin manager" Aug 02 09:32:43.926598 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:43.905608 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 02 09:32:43.926598 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.905621 2575 server.go:87] "Starting device plugin registration server" Aug 02 09:32:43.926598 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.905887 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 02 09:32:43.926598 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.905899 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 02 09:32:43.926598 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.906031 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 02 09:32:43.926598 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.906112 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 02 09:32:43.926598 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.906120 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 02 09:32:43.926598 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:43.906613 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 02 09:32:43.926598 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:43.906666 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-118.ec2.internal\" not found" Aug 02 09:32:43.948308 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.948285 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 02 09:32:43.949475 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.949457 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 02 09:32:43.949569 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.949498 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 02 09:32:43.949569 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.949521 2575 kubelet.go:2448] "Starting kubelet main sync loop" Aug 02 09:32:43.949666 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:43.949559 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 02 09:32:43.951839 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:43.951823 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 02 09:32:44.006656 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.006633 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 02 09:32:44.007487 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.007471 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasSufficientMemory" Aug 02 09:32:44.007556 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.007504 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasNoDiskPressure" Aug 02 09:32:44.007556 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.007517 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasSufficientPID" Aug 02 09:32:44.007556 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.007540 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.016321 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.016262 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.016321 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.016285 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-118.ec2.internal\": node \"ip-10-0-142-118.ec2.internal\" not found" Aug 02 09:32:44.039502 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.039485 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-118.ec2.internal\" not found" Aug 02 09:32:44.049660 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.049636 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-118.ec2.internal"] Aug 02 09:32:44.049747 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.049692 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 02 09:32:44.050556 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.050544 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasSufficientMemory" Aug 02 09:32:44.050622 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.050567 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasNoDiskPressure" Aug 02 09:32:44.050622 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.050576 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasSufficientPID" Aug 02 09:32:44.054221 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.054210 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 02 09:32:44.054355 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.054339 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.054405 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.054375 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 02 09:32:44.055292 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.055271 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasSufficientMemory" Aug 02 09:32:44.055292 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.055290 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasNoDiskPressure" Aug 02 09:32:44.055292 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.055292 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasSufficientMemory" Aug 02 09:32:44.055435 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.055299 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasSufficientPID" Aug 02 09:32:44.055435 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.055313 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasNoDiskPressure" Aug 02 09:32:44.055435 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.055330 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasSufficientPID" Aug 02 09:32:44.057558 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.057542 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.057636 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.057572 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 02 09:32:44.058242 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.058219 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasSufficientMemory" Aug 02 09:32:44.058242 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.058242 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasNoDiskPressure" Aug 02 09:32:44.058393 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.058257 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeHasSufficientPID" Aug 02 09:32:44.081412 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.081391 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-118.ec2.internal\" not found" node="ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.084689 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.084672 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-118.ec2.internal\" not found" node="ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.139649 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.139628 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-118.ec2.internal\" not found" Aug 02 09:32:44.150226 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.150209 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5d4b06937af6ba8a8eda74dc1664069-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal\" (UID: \"c5d4b06937af6ba8a8eda74dc1664069\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.150302 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.150234 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5d4b06937af6ba8a8eda74dc1664069-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal\" (UID: \"c5d4b06937af6ba8a8eda74dc1664069\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.150302 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.150251 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0db2a1efae079538404aaf0b49eb4e1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-118.ec2.internal\" (UID: \"b0db2a1efae079538404aaf0b49eb4e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.240380 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.240351 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-118.ec2.internal\" not found" Aug 02 09:32:44.250761 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.250736 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5d4b06937af6ba8a8eda74dc1664069-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal\" (UID: \"c5d4b06937af6ba8a8eda74dc1664069\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.250761 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.250695 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5d4b06937af6ba8a8eda74dc1664069-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal\" (UID: \"c5d4b06937af6ba8a8eda74dc1664069\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.250911 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.250805 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5d4b06937af6ba8a8eda74dc1664069-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal\" (UID: \"c5d4b06937af6ba8a8eda74dc1664069\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.250911 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.250852 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5d4b06937af6ba8a8eda74dc1664069-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal\" (UID: \"c5d4b06937af6ba8a8eda74dc1664069\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.250911 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.250869 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0db2a1efae079538404aaf0b49eb4e1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-118.ec2.internal\" (UID: \"b0db2a1efae079538404aaf0b49eb4e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.250911 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.250899 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0db2a1efae079538404aaf0b49eb4e1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-118.ec2.internal\" (UID: \"b0db2a1efae079538404aaf0b49eb4e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.341213 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.341144 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-118.ec2.internal\" not found" Aug 02 09:32:44.385691 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.385659 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.387828 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.387808 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.442049 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.442022 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-118.ec2.internal\" not found" Aug 02 09:32:44.542607 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.542573 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-118.ec2.internal\" not found" Aug 02 09:32:44.645121 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.645089 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-118.ec2.internal\" not found" Aug 02 09:32:44.752869 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.752838 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-118.ec2.internal\" not found" Aug 02 09:32:44.781862 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.781839 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 02 09:32:44.782300 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.781950 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 02 09:32:44.782300 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.782022 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 02 09:32:44.824853 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.824824 2575 apiserver.go:52] "Watching apiserver" Aug 02 09:32:44.833415 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.833396 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 02 09:32:44.834355 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.834333 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt","openshift-image-registry/node-ca-8cg55","openshift-multus/multus-cwkdq","openshift-multus/network-metrics-daemon-g8skl","openshift-network-diagnostics/network-check-target-8zj85","openshift-network-operator/iptables-alerter-9877t","openshift-ovn-kubernetes/ovnkube-node-bsbjf","kube-system/global-pull-secret-syncer-cfz4x","kube-system/konnectivity-agent-lfv22","openshift-cluster-node-tuning-operator/tuned-pcklq","openshift-dns/node-resolver-2rnlq","openshift-multus/multus-additional-cni-plugins-6t2wd"] Aug 02 09:32:44.837016 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.836997 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8cg55" Aug 02 09:32:44.839220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.839191 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gnhr4\"" Aug 02 09:32:44.839220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.839211 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 02 09:32:44.839703 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.839658 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.839817 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.839760 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 02 09:32:44.839945 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.839910 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 02 09:32:44.842065 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.841901 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 02 09:32:44.842173 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.842099 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:32:44.842230 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.842186 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:32:44.842768 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.842665 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 02 09:32:44.842898 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.842750 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 02 09:32:44.842898 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.842758 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 02 09:32:44.843547 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.843528 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f6b46\"" Aug 02 09:32:44.844644 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.844629 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.846647 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.846624 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 02 09:32:44.846746 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.846655 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j95mm\"" Aug 02 09:32:44.846746 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.846658 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 02 09:32:44.847080 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.847064 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.848007 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.847993 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.848098 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.848027 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 02 09:32:44.849102 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.849082 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 02 09:32:44.849102 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.849094 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nv7dm\"" Aug 02 09:32:44.849252 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.849171 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 02 09:32:44.849419 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.849403 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.851156 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.851141 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 02 09:32:44.851239 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.851224 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 02 09:32:44.851504 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.851490 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vztqm\"" Aug 02 09:32:44.851551 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.851492 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 02 09:32:44.851905 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.851890 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:44.851979 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.851959 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:32:44.854206 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjv96\" (UniqueName: \"kubernetes.io/projected/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-kube-api-access-cjv96\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.854280 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854219 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-hostroot\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.854280 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854226 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9877t" Aug 02 09:32:44.854280 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854244 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-kubernetes\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.854280 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjn2q\" (UniqueName: \"kubernetes.io/projected/ee24b8ba-130b-48f0-ba6d-69a599c4e703-kube-api-access-pjn2q\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.854487 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854313 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-cnibin\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.854487 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854352 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.854487 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854379 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.854487 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854475 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-multus-cni-dir\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.854710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-run-netns\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.854710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854542 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-multus-conf-dir\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.854710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854566 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-run-multus-certs\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.854710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854593 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a559e669-33cb-46af-b05a-24b0a9cd6b12-host\") pod \"node-ca-8cg55\" (UID: \"a559e669-33cb-46af-b05a-24b0a9cd6b12\") " pod="openshift-image-registry/node-ca-8cg55" Aug 02 09:32:44.854710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854624 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-cnibin\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.854710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93964564-0f3e-4b0e-8470-02c97619fadc-cni-binary-copy\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.854710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854665 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-run-k8s-cni-cncf-io\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.854710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854681 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93964564-0f3e-4b0e-8470-02c97619fadc-multus-daemon-config\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.854710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-device-dir\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854743 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a559e669-33cb-46af-b05a-24b0a9cd6b12-serviceca\") pod \"node-ca-8cg55\" (UID: \"a559e669-33cb-46af-b05a-24b0a9cd6b12\") " pod="openshift-image-registry/node-ca-8cg55" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854758 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-var-lib-cni-multus\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854774 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhsbs\" (UniqueName: \"kubernetes.io/projected/93964564-0f3e-4b0e-8470-02c97619fadc-kube-api-access-xhsbs\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854807 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-sysctl-conf\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-run\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-os-release\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854861 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-multus-socket-dir-parent\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854880 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-etc-kubernetes\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854895 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-sysconfig\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854929 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-sys\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854962 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-lib-modules\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.854990 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-system-cni-dir\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855021 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckn4s\" (UniqueName: \"kubernetes.io/projected/a559e669-33cb-46af-b05a-24b0a9cd6b12-kube-api-access-ckn4s\") pod \"node-ca-8cg55\" (UID: \"a559e669-33cb-46af-b05a-24b0a9cd6b12\") " pod="openshift-image-registry/node-ca-8cg55" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-var-lib-cni-bin\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-systemd\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.855145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855097 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-var-lib-kubelet\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-host\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855159 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-tuned\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee24b8ba-130b-48f0-ba6d-69a599c4e703-tmp\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-socket-dir\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855207 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-sys-fs\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855224 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvjzx\" (UniqueName: \"kubernetes.io/projected/9553a3b0-fc35-448d-bd28-3c67561738bf-kube-api-access-cvjzx\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855239 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-var-lib-kubelet\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855254 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-modprobe-d\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-sysctl-d\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-cni-binary-copy\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855313 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-registration-dir\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-system-cni-dir\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855343 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c28bq\" (UniqueName: \"kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq\") pod \"network-check-target-8zj85\" (UID: \"45ab025b-b154-44d0-bc68-87769a1b3bf6\") " pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855372 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-os-release\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.855724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.855403 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.856533 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.856514 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 02 09:32:44.856608 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.856544 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 02 09:32:44.856608 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.856589 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n9qjp\"" Aug 02 09:32:44.856713 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.856547 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 02 09:32:44.857758 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.857743 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.860656 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.860507 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-smt4n\"" Aug 02 09:32:44.860656 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.860528 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 02 09:32:44.860656 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.860516 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 02 09:32:44.860656 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.860554 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 02 09:32:44.860656 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.860566 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 02 09:32:44.860936 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.860692 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 02 09:32:44.860936 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.860723 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 02 09:32:44.861046 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.861033 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:44.861103 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.861085 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:32:44.861505 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.861487 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 02 09:32:44.862833 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.862813 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 02 09:32:44.862961 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.862891 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-118.ec2.internal" Aug 02 09:32:44.863535 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.863518 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lfv22" Aug 02 09:32:44.865627 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.865610 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 02 09:32:44.865699 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.865610 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qfb6w\"" Aug 02 09:32:44.865699 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.865688 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 02 09:32:44.865831 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.865817 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal"] Aug 02 09:32:44.865912 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.865900 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2rnlq" Aug 02 09:32:44.867860 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.867835 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 02 09:32:44.867908 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.867844 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sdzkv\"" Aug 02 09:32:44.867945 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.867920 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 02 09:32:44.869174 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.869154 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-01 09:27:44 +0000 UTC" deadline="2028-01-10 12:34:11.558987157 +0000 UTC" Aug 02 09:32:44.869212 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.869174 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12627h1m26.689815682s" Aug 02 09:32:44.870767 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.870754 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-118.ec2.internal"] Aug 02 09:32:44.870866 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.870843 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 02 09:32:44.884536 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.884275 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fvqwg" Aug 02 09:32:44.891016 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.890992 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fvqwg" Aug 02 09:32:44.949492 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.949471 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 02 09:32:44.955584 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.955566 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-cnibin\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.955675 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.955594 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-cni-bin\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.955675 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.955614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmmgr\" (UniqueName: \"kubernetes.io/projected/0a3a2b26-2590-4283-bc30-bff9b47feeb6-kube-api-access-qmmgr\") pod \"node-resolver-2rnlq\" (UID: \"0a3a2b26-2590-4283-bc30-bff9b47feeb6\") " pod="openshift-dns/node-resolver-2rnlq" Aug 02 09:32:44.955675 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.955630 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-multus-cni-dir\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.955675 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.955646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-run-netns\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.955851 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.955687 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-systemd-units\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.955851 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.955691 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-cnibin\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.955851 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.955749 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-run-netns\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.955851 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.955822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.955851 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.955856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-cni-netd\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.956105 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.955945 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a99e78f-f418-412c-afa5-1ed095c705e8-ovn-node-metrics-cert\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.956105 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.955985 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl68w\" (UniqueName: \"kubernetes.io/projected/8a99e78f-f418-412c-afa5-1ed095c705e8-kube-api-access-zl68w\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.956105 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956033 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-multus-conf-dir\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.956105 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956063 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-cnibin\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.956105 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956054 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-multus-cni-dir\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.956105 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956079 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-multus-conf-dir\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.956105 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956093 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-run-k8s-cni-cncf-io\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-run\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956139 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-cnibin\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956143 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-run-openvswitch\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a3a2b26-2590-4283-bc30-bff9b47feeb6-tmp-dir\") pod \"node-resolver-2rnlq\" (UID: \"0a3a2b26-2590-4283-bc30-bff9b47feeb6\") " pod="openshift-dns/node-resolver-2rnlq" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-run-k8s-cni-cncf-io\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956201 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4cd2259-11bd-4e97-a3ea-154b643786e5-host-slash\") pod \"iptables-alerter-9877t\" (UID: \"b4cd2259-11bd-4e97-a3ea-154b643786e5\") " pod="openshift-network-operator/iptables-alerter-9877t" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956223 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-run\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956232 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93964564-0f3e-4b0e-8470-02c97619fadc-multus-daemon-config\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956272 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-device-dir\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956343 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a559e669-33cb-46af-b05a-24b0a9cd6b12-serviceca\") pod \"node-ca-8cg55\" (UID: \"a559e669-33cb-46af-b05a-24b0a9cd6b12\") " pod="openshift-image-registry/node-ca-8cg55" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956368 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhsbs\" (UniqueName: \"kubernetes.io/projected/93964564-0f3e-4b0e-8470-02c97619fadc-kube-api-access-xhsbs\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-sysctl-conf\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956406 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfa1c5f7-d982-410d-8f84-aa2cf646c6cd-konnectivity-ca\") pod \"konnectivity-agent-lfv22\" (UID: \"bfa1c5f7-d982-410d-8f84-aa2cf646c6cd\") " pod="kube-system/konnectivity-agent-lfv22" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956450 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-os-release\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956477 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-multus-socket-dir-parent\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.956513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-etc-kubernetes\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956527 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-sysconfig\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956551 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-sys\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-system-cni-dir\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956615 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8a99e78f-f418-412c-afa5-1ed095c705e8-ovnkube-script-lib\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956641 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gctm\" (UniqueName: \"kubernetes.io/projected/672e5316-3afa-43ab-a9e5-672d12a1c26e-kube-api-access-9gctm\") pod \"network-metrics-daemon-g8skl\" (UID: \"672e5316-3afa-43ab-a9e5-672d12a1c26e\") " pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckn4s\" (UniqueName: \"kubernetes.io/projected/a559e669-33cb-46af-b05a-24b0a9cd6b12-kube-api-access-ckn4s\") pod \"node-ca-8cg55\" (UID: \"a559e669-33cb-46af-b05a-24b0a9cd6b12\") " pod="openshift-image-registry/node-ca-8cg55" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956703 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-systemd\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956740 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-tuned\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956758 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-node-log\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956757 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93964564-0f3e-4b0e-8470-02c97619fadc-multus-daemon-config\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956783 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-socket-dir\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-sys-fs\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956876 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-cni-binary-copy\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956898 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-socket-dir\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956917 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a559e669-33cb-46af-b05a-24b0a9cd6b12-serviceca\") pod \"node-ca-8cg55\" (UID: \"a559e669-33cb-46af-b05a-24b0a9cd6b12\") " pod="openshift-image-registry/node-ca-8cg55" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956314 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-device-dir\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.957390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956942 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-sys-fs\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957040 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957104 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-etc-kubernetes\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957114 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-sysctl-conf\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957208 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-sys\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957266 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-sysconfig\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957308 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-system-cni-dir\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957364 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-os-release\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956899 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957453 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8a99e78f-f418-412c-afa5-1ed095c705e8-env-overrides\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957461 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-cni-binary-copy\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.956700 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-multus-socket-dir-parent\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4cd2259-11bd-4e97-a3ea-154b643786e5-iptables-alerter-script\") pod \"iptables-alerter-9877t\" (UID: \"b4cd2259-11bd-4e97-a3ea-154b643786e5\") " pod="openshift-network-operator/iptables-alerter-9877t" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957524 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-systemd\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957561 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-registration-dir\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957565 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957588 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-system-cni-dir\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.958220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957612 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c28bq\" (UniqueName: \"kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq\") pod \"network-check-target-8zj85\" (UID: \"45ab025b-b154-44d0-bc68-87769a1b3bf6\") " pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957607 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-registration-dir\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957637 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjv96\" (UniqueName: \"kubernetes.io/projected/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-kube-api-access-cjv96\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957665 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a3a2b26-2590-4283-bc30-bff9b47feeb6-hosts-file\") pod \"node-resolver-2rnlq\" (UID: \"0a3a2b26-2590-4283-bc30-bff9b47feeb6\") " pod="openshift-dns/node-resolver-2rnlq" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-hostroot\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957722 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957745 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-var-lib-openvswitch\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957638 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-system-cni-dir\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957885 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-etc-openvswitch\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957906 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-hostroot\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957919 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.957955 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-var-lib-kubelet\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958014 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9553a3b0-fc35-448d-bd28-3c67561738bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958022 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-var-lib-kubelet\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958059 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee24b8ba-130b-48f0-ba6d-69a599c4e703-tmp\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjn2q\" (UniqueName: \"kubernetes.io/projected/ee24b8ba-130b-48f0-ba6d-69a599c4e703-kube-api-access-pjn2q\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958113 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-slash\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.959154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958443 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958455 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-run-multus-certs\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958495 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a559e669-33cb-46af-b05a-24b0a9cd6b12-host\") pod \"node-ca-8cg55\" (UID: \"a559e669-33cb-46af-b05a-24b0a9cd6b12\") " pod="openshift-image-registry/node-ca-8cg55" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958516 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93964564-0f3e-4b0e-8470-02c97619fadc-cni-binary-copy\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958522 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-run-multus-certs\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-var-lib-cni-multus\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958568 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ead495a-945d-4c39-954e-98e47d4976cf-dbus\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958570 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a559e669-33cb-46af-b05a-24b0a9cd6b12-host\") pod \"node-ca-8cg55\" (UID: \"a559e669-33cb-46af-b05a-24b0a9cd6b12\") " pod="openshift-image-registry/node-ca-8cg55" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958578 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-var-lib-cni-multus\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958596 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958624 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs\") pod \"network-metrics-daemon-g8skl\" (UID: \"672e5316-3afa-43ab-a9e5-672d12a1c26e\") " pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958647 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4ghb\" (UniqueName: \"kubernetes.io/projected/b4cd2259-11bd-4e97-a3ea-154b643786e5-kube-api-access-d4ghb\") pod \"iptables-alerter-9877t\" (UID: \"b4cd2259-11bd-4e97-a3ea-154b643786e5\") " pod="openshift-network-operator/iptables-alerter-9877t" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-lib-modules\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958696 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-kubelet\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958721 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958749 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-var-lib-cni-bin\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958819 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-lib-modules\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.960068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958821 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-host\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958866 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8a99e78f-f418-412c-afa5-1ed095c705e8-ovnkube-config\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958867 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-var-lib-cni-bin\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvjzx\" (UniqueName: \"kubernetes.io/projected/9553a3b0-fc35-448d-bd28-3c67561738bf-kube-api-access-cvjzx\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958918 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-host\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-var-lib-kubelet\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958973 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93964564-0f3e-4b0e-8470-02c97619fadc-host-var-lib-kubelet\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.958997 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-modprobe-d\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959020 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-sysctl-d\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959075 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93964564-0f3e-4b0e-8470-02c97619fadc-cni-binary-copy\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959143 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-run-netns\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959171 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-log-socket\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959182 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-modprobe-d\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959197 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfa1c5f7-d982-410d-8f84-aa2cf646c6cd-agent-certs\") pod \"konnectivity-agent-lfv22\" (UID: \"bfa1c5f7-d982-410d-8f84-aa2cf646c6cd\") " pod="kube-system/konnectivity-agent-lfv22" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-os-release\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959282 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-sysctl-d\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.960635 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959306 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-os-release\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.961520 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959376 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-run-systemd\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.961520 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959419 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-run-ovn\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:44.961520 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959443 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ead495a-945d-4c39-954e-98e47d4976cf-kubelet-config\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:44.961520 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959478 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-kubernetes\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.961520 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.959579 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-kubernetes\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.961520 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.960339 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.961520 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.961043 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee24b8ba-130b-48f0-ba6d-69a599c4e703-tmp\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.961520 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.961087 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee24b8ba-130b-48f0-ba6d-69a599c4e703-etc-tuned\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.965978 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.965956 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 02 09:32:44.966086 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.965986 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 02 09:32:44.966086 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.966001 2575 projected.go:196] Error preparing data for projected volume kube-api-access-c28bq for pod openshift-network-diagnostics/network-check-target-8zj85: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 09:32:44.966216 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:44.966114 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq podName:45ab025b-b154-44d0-bc68-87769a1b3bf6 nodeName:}" failed. No retries permitted until 2026-08-02 09:32:45.46609265 +0000 UTC m=+2.027247973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c28bq" (UniqueName: "kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq") pod "network-check-target-8zj85" (UID: "45ab025b-b154-44d0-bc68-87769a1b3bf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 09:32:44.968301 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.968280 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjn2q\" (UniqueName: \"kubernetes.io/projected/ee24b8ba-130b-48f0-ba6d-69a599c4e703-kube-api-access-pjn2q\") pod \"tuned-pcklq\" (UID: \"ee24b8ba-130b-48f0-ba6d-69a599c4e703\") " pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:44.968380 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.968341 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhsbs\" (UniqueName: \"kubernetes.io/projected/93964564-0f3e-4b0e-8470-02c97619fadc-kube-api-access-xhsbs\") pod \"multus-cwkdq\" (UID: \"93964564-0f3e-4b0e-8470-02c97619fadc\") " pod="openshift-multus/multus-cwkdq" Aug 02 09:32:44.968380 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.968341 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjv96\" (UniqueName: \"kubernetes.io/projected/1f4e25cd-d1a3-488f-a108-f358f6ea7c41-kube-api-access-cjv96\") pod \"multus-additional-cni-plugins-6t2wd\" (UID: \"1f4e25cd-d1a3-488f-a108-f358f6ea7c41\") " pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:44.968480 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.968411 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckn4s\" (UniqueName: \"kubernetes.io/projected/a559e669-33cb-46af-b05a-24b0a9cd6b12-kube-api-access-ckn4s\") pod \"node-ca-8cg55\" (UID: \"a559e669-33cb-46af-b05a-24b0a9cd6b12\") " pod="openshift-image-registry/node-ca-8cg55" Aug 02 09:32:44.968692 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:44.968672 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvjzx\" (UniqueName: \"kubernetes.io/projected/9553a3b0-fc35-448d-bd28-3c67561738bf-kube-api-access-cvjzx\") pod \"aws-ebs-csi-driver-node-cjrwt\" (UID: \"9553a3b0-fc35-448d-bd28-3c67561738bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:45.060080 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a3a2b26-2590-4283-bc30-bff9b47feeb6-hosts-file\") pod \"node-resolver-2rnlq\" (UID: \"0a3a2b26-2590-4283-bc30-bff9b47feeb6\") " pod="openshift-dns/node-resolver-2rnlq" Aug 02 09:32:45.060295 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060084 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-var-lib-openvswitch\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060295 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060109 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-etc-openvswitch\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060295 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060135 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-slash\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060295 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ead495a-945d-4c39-954e-98e47d4976cf-dbus\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:45.060295 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060178 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a3a2b26-2590-4283-bc30-bff9b47feeb6-hosts-file\") pod \"node-resolver-2rnlq\" (UID: \"0a3a2b26-2590-4283-bc30-bff9b47feeb6\") " pod="openshift-dns/node-resolver-2rnlq" Aug 02 09:32:45.060295 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-var-lib-openvswitch\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060295 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060183 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:45.060295 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-etc-openvswitch\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060295 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060237 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-slash\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060295 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs\") pod \"network-metrics-daemon-g8skl\" (UID: \"672e5316-3afa-43ab-a9e5-672d12a1c26e\") " pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:45.060295 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.060275 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060297 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ead495a-945d-4c39-954e-98e47d4976cf-dbus\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.060315 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060275 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4ghb\" (UniqueName: \"kubernetes.io/projected/b4cd2259-11bd-4e97-a3ea-154b643786e5-kube-api-access-d4ghb\") pod \"iptables-alerter-9877t\" (UID: \"b4cd2259-11bd-4e97-a3ea-154b643786e5\") " pod="openshift-network-operator/iptables-alerter-9877t" Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.060335 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret podName:5ead495a-945d-4c39-954e-98e47d4976cf nodeName:}" failed. No retries permitted until 2026-08-02 09:32:45.560316354 +0000 UTC m=+2.121471675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret") pod "global-pull-secret-syncer-cfz4x" (UID: "5ead495a-945d-4c39-954e-98e47d4976cf") : object "kube-system"/"original-pull-secret" not registered Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.060370 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs podName:672e5316-3afa-43ab-a9e5-672d12a1c26e nodeName:}" failed. No retries permitted until 2026-08-02 09:32:45.560358006 +0000 UTC m=+2.121513333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs") pod "network-metrics-daemon-g8skl" (UID: "672e5316-3afa-43ab-a9e5-672d12a1c26e") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060398 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-kubelet\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060428 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060469 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8a99e78f-f418-412c-afa5-1ed095c705e8-ovnkube-config\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060482 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060494 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-kubelet\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060499 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-run-netns\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060538 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-run-netns\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060549 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-log-socket\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060576 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-log-socket\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060576 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfa1c5f7-d982-410d-8f84-aa2cf646c6cd-agent-certs\") pod \"konnectivity-agent-lfv22\" (UID: \"bfa1c5f7-d982-410d-8f84-aa2cf646c6cd\") " pod="kube-system/konnectivity-agent-lfv22" Aug 02 09:32:45.060933 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060607 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-run-systemd\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060625 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-run-ovn\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060650 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ead495a-945d-4c39-954e-98e47d4976cf-kubelet-config\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060668 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-cni-bin\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060685 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmmgr\" (UniqueName: \"kubernetes.io/projected/0a3a2b26-2590-4283-bc30-bff9b47feeb6-kube-api-access-qmmgr\") pod \"node-resolver-2rnlq\" (UID: \"0a3a2b26-2590-4283-bc30-bff9b47feeb6\") " pod="openshift-dns/node-resolver-2rnlq" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060692 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-run-ovn\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-systemd-units\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060727 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ead495a-945d-4c39-954e-98e47d4976cf-kubelet-config\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060738 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060690 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-run-systemd\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060747 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-systemd-units\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060748 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-cni-bin\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060763 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-cni-netd\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060792 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a99e78f-f418-412c-afa5-1ed095c705e8-ovn-node-metrics-cert\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060801 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060847 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-host-cni-netd\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl68w\" (UniqueName: \"kubernetes.io/projected/8a99e78f-f418-412c-afa5-1ed095c705e8-kube-api-access-zl68w\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.061711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060899 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-run-openvswitch\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060925 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a3a2b26-2590-4283-bc30-bff9b47feeb6-tmp-dir\") pod \"node-resolver-2rnlq\" (UID: \"0a3a2b26-2590-4283-bc30-bff9b47feeb6\") " pod="openshift-dns/node-resolver-2rnlq" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060934 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-run-openvswitch\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060951 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4cd2259-11bd-4e97-a3ea-154b643786e5-host-slash\") pod \"iptables-alerter-9877t\" (UID: \"b4cd2259-11bd-4e97-a3ea-154b643786e5\") " pod="openshift-network-operator/iptables-alerter-9877t" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.060983 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfa1c5f7-d982-410d-8f84-aa2cf646c6cd-konnectivity-ca\") pod \"konnectivity-agent-lfv22\" (UID: \"bfa1c5f7-d982-410d-8f84-aa2cf646c6cd\") " pod="kube-system/konnectivity-agent-lfv22" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.061014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8a99e78f-f418-412c-afa5-1ed095c705e8-ovnkube-script-lib\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.061039 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gctm\" (UniqueName: \"kubernetes.io/projected/672e5316-3afa-43ab-a9e5-672d12a1c26e-kube-api-access-9gctm\") pod \"network-metrics-daemon-g8skl\" (UID: \"672e5316-3afa-43ab-a9e5-672d12a1c26e\") " pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.061060 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8a99e78f-f418-412c-afa5-1ed095c705e8-ovnkube-config\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.061066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-node-log\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.061098 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8a99e78f-f418-412c-afa5-1ed095c705e8-node-log\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.061124 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8a99e78f-f418-412c-afa5-1ed095c705e8-env-overrides\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.061157 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4cd2259-11bd-4e97-a3ea-154b643786e5-iptables-alerter-script\") pod \"iptables-alerter-9877t\" (UID: \"b4cd2259-11bd-4e97-a3ea-154b643786e5\") " pod="openshift-network-operator/iptables-alerter-9877t" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.061277 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a3a2b26-2590-4283-bc30-bff9b47feeb6-tmp-dir\") pod \"node-resolver-2rnlq\" (UID: \"0a3a2b26-2590-4283-bc30-bff9b47feeb6\") " pod="openshift-dns/node-resolver-2rnlq" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.061331 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4cd2259-11bd-4e97-a3ea-154b643786e5-host-slash\") pod \"iptables-alerter-9877t\" (UID: \"b4cd2259-11bd-4e97-a3ea-154b643786e5\") " pod="openshift-network-operator/iptables-alerter-9877t" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.061640 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfa1c5f7-d982-410d-8f84-aa2cf646c6cd-konnectivity-ca\") pod \"konnectivity-agent-lfv22\" (UID: \"bfa1c5f7-d982-410d-8f84-aa2cf646c6cd\") " pod="kube-system/konnectivity-agent-lfv22" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.061704 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8a99e78f-f418-412c-afa5-1ed095c705e8-env-overrides\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.061738 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8a99e78f-f418-412c-afa5-1ed095c705e8-ovnkube-script-lib\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.062282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.061738 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4cd2259-11bd-4e97-a3ea-154b643786e5-iptables-alerter-script\") pod \"iptables-alerter-9877t\" (UID: \"b4cd2259-11bd-4e97-a3ea-154b643786e5\") " pod="openshift-network-operator/iptables-alerter-9877t" Aug 02 09:32:45.063696 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.063672 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a99e78f-f418-412c-afa5-1ed095c705e8-ovn-node-metrics-cert\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.063790 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.063746 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfa1c5f7-d982-410d-8f84-aa2cf646c6cd-agent-certs\") pod \"konnectivity-agent-lfv22\" (UID: \"bfa1c5f7-d982-410d-8f84-aa2cf646c6cd\") " pod="kube-system/konnectivity-agent-lfv22" Aug 02 09:32:45.068893 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.068845 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmmgr\" (UniqueName: \"kubernetes.io/projected/0a3a2b26-2590-4283-bc30-bff9b47feeb6-kube-api-access-qmmgr\") pod \"node-resolver-2rnlq\" (UID: \"0a3a2b26-2590-4283-bc30-bff9b47feeb6\") " pod="openshift-dns/node-resolver-2rnlq" Aug 02 09:32:45.069018 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.068995 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4ghb\" (UniqueName: \"kubernetes.io/projected/b4cd2259-11bd-4e97-a3ea-154b643786e5-kube-api-access-d4ghb\") pod \"iptables-alerter-9877t\" (UID: \"b4cd2259-11bd-4e97-a3ea-154b643786e5\") " pod="openshift-network-operator/iptables-alerter-9877t" Aug 02 09:32:45.069126 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.069112 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl68w\" (UniqueName: \"kubernetes.io/projected/8a99e78f-f418-412c-afa5-1ed095c705e8-kube-api-access-zl68w\") pod \"ovnkube-node-bsbjf\" (UID: \"8a99e78f-f418-412c-afa5-1ed095c705e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.069747 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.069731 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gctm\" (UniqueName: \"kubernetes.io/projected/672e5316-3afa-43ab-a9e5-672d12a1c26e-kube-api-access-9gctm\") pod \"network-metrics-daemon-g8skl\" (UID: \"672e5316-3afa-43ab-a9e5-672d12a1c26e\") " pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:45.133423 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.133405 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 02 09:32:45.139566 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:45.139541 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d4b06937af6ba8a8eda74dc1664069.slice/crio-f6c9cb32d4e9fd6e187fdc351626a359289ad331dffb5ce4da2146fdeb6c5d9b WatchSource:0}: Error finding container f6c9cb32d4e9fd6e187fdc351626a359289ad331dffb5ce4da2146fdeb6c5d9b: Status 404 returned error can't find the container with id f6c9cb32d4e9fd6e187fdc351626a359289ad331dffb5ce4da2146fdeb6c5d9b Aug 02 09:32:45.159508 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.159481 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8cg55" Aug 02 09:32:45.169012 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:45.168992 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda559e669_33cb_46af_b05a_24b0a9cd6b12.slice/crio-9b6a325fefc998c3247ca18a06b68acdb4f239579abc516492427cfc555a4a5e WatchSource:0}: Error finding container 9b6a325fefc998c3247ca18a06b68acdb4f239579abc516492427cfc555a4a5e: Status 404 returned error can't find the container with id 9b6a325fefc998c3247ca18a06b68acdb4f239579abc516492427cfc555a4a5e Aug 02 09:32:45.182983 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.182963 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cwkdq" Aug 02 09:32:45.190927 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.190908 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pcklq" Aug 02 09:32:45.191155 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:45.191134 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93964564_0f3e_4b0e_8470_02c97619fadc.slice/crio-f26838803d9298c64bb1135eb2e088c1d8ed94bf3281f67cf53d4669a61e710a WatchSource:0}: Error finding container f26838803d9298c64bb1135eb2e088c1d8ed94bf3281f67cf53d4669a61e710a: Status 404 returned error can't find the container with id f26838803d9298c64bb1135eb2e088c1d8ed94bf3281f67cf53d4669a61e710a Aug 02 09:32:45.199060 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:45.199035 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee24b8ba_130b_48f0_ba6d_69a599c4e703.slice/crio-08c1db371112c133ef74bc28aee49e9af5f21ca5c144f2bf58ab3b94d86ae31a WatchSource:0}: Error finding container 08c1db371112c133ef74bc28aee49e9af5f21ca5c144f2bf58ab3b94d86ae31a: Status 404 returned error can't find the container with id 08c1db371112c133ef74bc28aee49e9af5f21ca5c144f2bf58ab3b94d86ae31a Aug 02 09:32:45.212111 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.212087 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6t2wd" Aug 02 09:32:45.220027 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:45.220006 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4e25cd_d1a3_488f_a108_f358f6ea7c41.slice/crio-f4d956cdaacfb2dba80d43362e7815537463fd581413bc10f957ff1d8558243d WatchSource:0}: Error finding container f4d956cdaacfb2dba80d43362e7815537463fd581413bc10f957ff1d8558243d: Status 404 returned error can't find the container with id f4d956cdaacfb2dba80d43362e7815537463fd581413bc10f957ff1d8558243d Aug 02 09:32:45.228313 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.228292 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" Aug 02 09:32:45.236766 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:45.236744 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9553a3b0_fc35_448d_bd28_3c67561738bf.slice/crio-a57c5a83e64f9c1566b90be434cc28cb49f65f71a488ebaaf54fa0c7d68f6e0b WatchSource:0}: Error finding container a57c5a83e64f9c1566b90be434cc28cb49f65f71a488ebaaf54fa0c7d68f6e0b: Status 404 returned error can't find the container with id a57c5a83e64f9c1566b90be434cc28cb49f65f71a488ebaaf54fa0c7d68f6e0b Aug 02 09:32:45.243237 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.243209 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9877t" Aug 02 09:32:45.250905 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:45.250884 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4cd2259_11bd_4e97_a3ea_154b643786e5.slice/crio-b9ffc46c3eecbeb1cdc399f788b9670d1831e2f2c4720109da8c1792b6b7ade9 WatchSource:0}: Error finding container b9ffc46c3eecbeb1cdc399f788b9670d1831e2f2c4720109da8c1792b6b7ade9: Status 404 returned error can't find the container with id b9ffc46c3eecbeb1cdc399f788b9670d1831e2f2c4720109da8c1792b6b7ade9 Aug 02 09:32:45.255264 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.255249 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:32:45.263355 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:45.263333 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a99e78f_f418_412c_afa5_1ed095c705e8.slice/crio-a49406b0a85a0e9ecfa5e38e62d74b57bba6875686636adb735ad912f073297c WatchSource:0}: Error finding container a49406b0a85a0e9ecfa5e38e62d74b57bba6875686636adb735ad912f073297c: Status 404 returned error can't find the container with id a49406b0a85a0e9ecfa5e38e62d74b57bba6875686636adb735ad912f073297c Aug 02 09:32:45.276142 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.276123 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lfv22" Aug 02 09:32:45.280030 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.280013 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2rnlq" Aug 02 09:32:45.284632 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:45.284600 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa1c5f7_d982_410d_8f84_aa2cf646c6cd.slice/crio-f8a1419a348e045a22e59e4577689b5b9545ade865c24e64041d4b12622a24f2 WatchSource:0}: Error finding container f8a1419a348e045a22e59e4577689b5b9545ade865c24e64041d4b12622a24f2: Status 404 returned error can't find the container with id f8a1419a348e045a22e59e4577689b5b9545ade865c24e64041d4b12622a24f2 Aug 02 09:32:45.289056 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:32:45.289037 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3a2b26_2590_4283_bc30_bff9b47feeb6.slice/crio-8f2d3c4ce998f865854af7c7866112ffc9dfcdb1647f974dfedbfcc22e5f93c2 WatchSource:0}: Error finding container 8f2d3c4ce998f865854af7c7866112ffc9dfcdb1647f974dfedbfcc22e5f93c2: Status 404 returned error can't find the container with id 8f2d3c4ce998f865854af7c7866112ffc9dfcdb1647f974dfedbfcc22e5f93c2 Aug 02 09:32:45.290573 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.290556 2575 kuberuntime_manager.go:1459] "Unhandled Error" err="container dns-node-resolver start failed in pod node-resolver-2rnlq_openshift-dns(0a3a2b26-2590-4283-bc30-bff9b47feeb6): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Aug 02 09:32:45.290615 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.290587 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-dns/node-resolver-2rnlq" podUID="0a3a2b26-2590-4283-bc30-bff9b47feeb6" Aug 02 09:32:45.298110 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.298091 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 02 09:32:45.452576 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.452486 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 02 09:32:45.564227 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.564192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:45.564227 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.564227 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs\") pod \"network-metrics-daemon-g8skl\" (UID: \"672e5316-3afa-43ab-a9e5-672d12a1c26e\") " pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:45.564453 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.564272 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c28bq\" (UniqueName: \"kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq\") pod \"network-check-target-8zj85\" (UID: \"45ab025b-b154-44d0-bc68-87769a1b3bf6\") " pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:32:45.564453 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.564346 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 02 09:32:45.564453 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.564379 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 02 09:32:45.564453 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.564395 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 09:32:45.564453 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.564399 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 02 09:32:45.564453 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.564416 2575 projected.go:196] Error preparing data for projected volume kube-api-access-c28bq for pod openshift-network-diagnostics/network-check-target-8zj85: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 09:32:45.564453 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.564451 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs podName:672e5316-3afa-43ab-a9e5-672d12a1c26e nodeName:}" failed. No retries permitted until 2026-08-02 09:32:46.564431057 +0000 UTC m=+3.125586375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs") pod "network-metrics-daemon-g8skl" (UID: "672e5316-3afa-43ab-a9e5-672d12a1c26e") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 09:32:45.564885 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.564502 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret podName:5ead495a-945d-4c39-954e-98e47d4976cf nodeName:}" failed. No retries permitted until 2026-08-02 09:32:46.564461248 +0000 UTC m=+3.125616549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret") pod "global-pull-secret-syncer-cfz4x" (UID: "5ead495a-945d-4c39-954e-98e47d4976cf") : object "kube-system"/"original-pull-secret" not registered Aug 02 09:32:45.564885 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.564529 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq podName:45ab025b-b154-44d0-bc68-87769a1b3bf6 nodeName:}" failed. No retries permitted until 2026-08-02 09:32:46.564517973 +0000 UTC m=+3.125673274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c28bq" (UniqueName: "kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq") pod "network-check-target-8zj85" (UID: "45ab025b-b154-44d0-bc68-87769a1b3bf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 09:32:45.894929 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.894775 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-01 09:27:45 +0000 UTC" deadline="2027-12-31 11:25:56.641435124 +0000 UTC" Aug 02 09:32:45.894929 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.894826 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12385h53m10.746614342s" Aug 02 09:32:45.962754 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.962697 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2rnlq" event={"ID":"0a3a2b26-2590-4283-bc30-bff9b47feeb6","Type":"ContainerStarted","Data":"8f2d3c4ce998f865854af7c7866112ffc9dfcdb1647f974dfedbfcc22e5f93c2"} Aug 02 09:32:45.966296 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:45.966258 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:74b8d9cff26ab06c9d7bbeb115f3d2d4319dafb5e9f367b231d40f610b152391\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-dns/node-resolver-2rnlq" podUID="0a3a2b26-2590-4283-bc30-bff9b47feeb6" Aug 02 09:32:45.977780 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.977746 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lfv22" event={"ID":"bfa1c5f7-d982-410d-8f84-aa2cf646c6cd","Type":"ContainerStarted","Data":"f8a1419a348e045a22e59e4577689b5b9545ade865c24e64041d4b12622a24f2"} Aug 02 09:32:45.986917 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:45.986762 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" event={"ID":"8a99e78f-f418-412c-afa5-1ed095c705e8","Type":"ContainerStarted","Data":"a49406b0a85a0e9ecfa5e38e62d74b57bba6875686636adb735ad912f073297c"} Aug 02 09:32:46.009917 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.009878 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9877t" event={"ID":"b4cd2259-11bd-4e97-a3ea-154b643786e5","Type":"ContainerStarted","Data":"b9ffc46c3eecbeb1cdc399f788b9670d1831e2f2c4720109da8c1792b6b7ade9"} Aug 02 09:32:46.013420 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.013385 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" event={"ID":"9553a3b0-fc35-448d-bd28-3c67561738bf","Type":"ContainerStarted","Data":"a57c5a83e64f9c1566b90be434cc28cb49f65f71a488ebaaf54fa0c7d68f6e0b"} Aug 02 09:32:46.023135 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.023106 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t2wd" event={"ID":"1f4e25cd-d1a3-488f-a108-f358f6ea7c41","Type":"ContainerStarted","Data":"f4d956cdaacfb2dba80d43362e7815537463fd581413bc10f957ff1d8558243d"} Aug 02 09:32:46.032041 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.032012 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pcklq" event={"ID":"ee24b8ba-130b-48f0-ba6d-69a599c4e703","Type":"ContainerStarted","Data":"08c1db371112c133ef74bc28aee49e9af5f21ca5c144f2bf58ab3b94d86ae31a"} Aug 02 09:32:46.035555 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.035523 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cwkdq" event={"ID":"93964564-0f3e-4b0e-8470-02c97619fadc","Type":"ContainerStarted","Data":"f26838803d9298c64bb1135eb2e088c1d8ed94bf3281f67cf53d4669a61e710a"} Aug 02 09:32:46.039277 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.039248 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8cg55" event={"ID":"a559e669-33cb-46af-b05a-24b0a9cd6b12","Type":"ContainerStarted","Data":"9b6a325fefc998c3247ca18a06b68acdb4f239579abc516492427cfc555a4a5e"} Aug 02 09:32:46.055622 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.055575 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal" event={"ID":"c5d4b06937af6ba8a8eda74dc1664069","Type":"ContainerStarted","Data":"f6c9cb32d4e9fd6e187fdc351626a359289ad331dffb5ce4da2146fdeb6c5d9b"} Aug 02 09:32:46.063563 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.063527 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-118.ec2.internal" event={"ID":"b0db2a1efae079538404aaf0b49eb4e1","Type":"ContainerStarted","Data":"3b98d9fca4f6441ba98dad85c53378b4542b2aca17f558eb7a95f5cab833d415"} Aug 02 09:32:46.373142 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.373060 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 02 09:32:46.588738 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.587660 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c28bq\" (UniqueName: \"kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq\") pod \"network-check-target-8zj85\" (UID: \"45ab025b-b154-44d0-bc68-87769a1b3bf6\") " pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:32:46.588738 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.587727 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:46.588738 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.587759 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs\") pod \"network-metrics-daemon-g8skl\" (UID: \"672e5316-3afa-43ab-a9e5-672d12a1c26e\") " pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:46.588738 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:46.587945 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 09:32:46.588738 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:46.588014 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs podName:672e5316-3afa-43ab-a9e5-672d12a1c26e nodeName:}" failed. No retries permitted until 2026-08-02 09:32:48.587992613 +0000 UTC m=+5.149147928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs") pod "network-metrics-daemon-g8skl" (UID: "672e5316-3afa-43ab-a9e5-672d12a1c26e") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 09:32:46.588738 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:46.588452 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 02 09:32:46.588738 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:46.588517 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 02 09:32:46.588738 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:46.588532 2575 projected.go:196] Error preparing data for projected volume kube-api-access-c28bq for pod openshift-network-diagnostics/network-check-target-8zj85: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 09:32:46.588738 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:46.588579 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq podName:45ab025b-b154-44d0-bc68-87769a1b3bf6 nodeName:}" failed. No retries permitted until 2026-08-02 09:32:48.58856394 +0000 UTC m=+5.149719243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c28bq" (UniqueName: "kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq") pod "network-check-target-8zj85" (UID: "45ab025b-b154-44d0-bc68-87769a1b3bf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 09:32:46.588738 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:46.588651 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 02 09:32:46.588738 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:46.588686 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret podName:5ead495a-945d-4c39-954e-98e47d4976cf nodeName:}" failed. No retries permitted until 2026-08-02 09:32:48.588674591 +0000 UTC m=+5.149829894 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret") pod "global-pull-secret-syncer-cfz4x" (UID: "5ead495a-945d-4c39-954e-98e47d4976cf") : object "kube-system"/"original-pull-secret" not registered Aug 02 09:32:46.895382 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.895307 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-01 09:27:45 +0000 UTC" deadline="2028-04-10 08:04:14.052798882 +0000 UTC" Aug 02 09:32:46.895382 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.895380 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14806h31m27.157424191s" Aug 02 09:32:46.954722 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.949920 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:32:46.954722 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:46.950086 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:32:46.954722 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.950178 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:46.954722 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:46.950268 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:32:46.954722 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:46.950332 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:46.954722 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:46.950409 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:32:48.605451 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:48.604415 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:48.605451 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:48.604468 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs\") pod \"network-metrics-daemon-g8skl\" (UID: \"672e5316-3afa-43ab-a9e5-672d12a1c26e\") " pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:48.605451 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:48.604540 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c28bq\" (UniqueName: \"kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq\") pod \"network-check-target-8zj85\" (UID: \"45ab025b-b154-44d0-bc68-87769a1b3bf6\") " pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:32:48.605451 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:48.604710 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 02 09:32:48.605451 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:48.604734 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 02 09:32:48.605451 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:48.604749 2575 projected.go:196] Error preparing data for projected volume kube-api-access-c28bq for pod openshift-network-diagnostics/network-check-target-8zj85: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 09:32:48.605451 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:48.604814 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq podName:45ab025b-b154-44d0-bc68-87769a1b3bf6 nodeName:}" failed. No retries permitted until 2026-08-02 09:32:52.604793684 +0000 UTC m=+9.165949000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c28bq" (UniqueName: "kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq") pod "network-check-target-8zj85" (UID: "45ab025b-b154-44d0-bc68-87769a1b3bf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 09:32:48.605451 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:48.604928 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 02 09:32:48.605451 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:48.604969 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret podName:5ead495a-945d-4c39-954e-98e47d4976cf nodeName:}" failed. No retries permitted until 2026-08-02 09:32:52.604956391 +0000 UTC m=+9.166111716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret") pod "global-pull-secret-syncer-cfz4x" (UID: "5ead495a-945d-4c39-954e-98e47d4976cf") : object "kube-system"/"original-pull-secret" not registered Aug 02 09:32:48.605451 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:48.605026 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 09:32:48.605451 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:48.605066 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs podName:672e5316-3afa-43ab-a9e5-672d12a1c26e nodeName:}" failed. No retries permitted until 2026-08-02 09:32:52.605055139 +0000 UTC m=+9.166210456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs") pod "network-metrics-daemon-g8skl" (UID: "672e5316-3afa-43ab-a9e5-672d12a1c26e") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 09:32:48.950826 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:48.950706 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:48.950826 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:48.950765 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:48.951044 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:48.950880 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:32:48.951044 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:48.950960 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:32:48.951044 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:48.951013 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:32:48.951215 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:48.951093 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:32:50.951515 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:50.950648 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:50.951515 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:50.950824 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:32:50.951515 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:50.951229 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:50.951515 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:50.951328 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:32:50.951515 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:50.951381 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:32:50.951515 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:50.951463 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:32:52.643213 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:52.642212 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c28bq\" (UniqueName: \"kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq\") pod \"network-check-target-8zj85\" (UID: \"45ab025b-b154-44d0-bc68-87769a1b3bf6\") " pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:32:52.643213 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:52.642277 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:52.643213 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:52.642312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs\") pod \"network-metrics-daemon-g8skl\" (UID: \"672e5316-3afa-43ab-a9e5-672d12a1c26e\") " pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:52.643213 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:52.642459 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 09:32:52.643213 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:52.642528 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs podName:672e5316-3afa-43ab-a9e5-672d12a1c26e nodeName:}" failed. No retries permitted until 2026-08-02 09:33:00.642506798 +0000 UTC m=+17.203662125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs") pod "network-metrics-daemon-g8skl" (UID: "672e5316-3afa-43ab-a9e5-672d12a1c26e") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 09:32:52.643213 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:52.643007 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 02 09:32:52.643213 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:52.643026 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 02 09:32:52.643213 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:52.643039 2575 projected.go:196] Error preparing data for projected volume kube-api-access-c28bq for pod openshift-network-diagnostics/network-check-target-8zj85: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 09:32:52.643213 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:52.643086 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq podName:45ab025b-b154-44d0-bc68-87769a1b3bf6 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:00.643070245 +0000 UTC m=+17.204225547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c28bq" (UniqueName: "kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq") pod "network-check-target-8zj85" (UID: "45ab025b-b154-44d0-bc68-87769a1b3bf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 09:32:52.643213 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:52.643149 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 02 09:32:52.643213 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:52.643182 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret podName:5ead495a-945d-4c39-954e-98e47d4976cf nodeName:}" failed. No retries permitted until 2026-08-02 09:33:00.643170897 +0000 UTC m=+17.204326202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret") pod "global-pull-secret-syncer-cfz4x" (UID: "5ead495a-945d-4c39-954e-98e47d4976cf") : object "kube-system"/"original-pull-secret" not registered Aug 02 09:32:52.950496 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:52.950153 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:32:52.950496 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:52.950185 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:52.950496 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:52.950196 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:52.950496 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:52.950292 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:32:52.950496 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:52.950397 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:32:52.950884 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:52.950491 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:32:54.950587 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:54.950553 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:54.950587 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:54.950586 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:32:54.951146 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:54.950553 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:54.951146 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:54.950695 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:32:54.951146 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:54.950756 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:32:54.951146 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:54.950892 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:32:56.950794 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:56.950746 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:32:56.950794 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:56.950796 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:56.951255 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:56.950763 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:56.951255 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:56.950908 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:32:56.951255 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:56.951006 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:32:56.951255 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:56.951075 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:32:58.949872 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:58.949827 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:32:58.949872 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:58.949829 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:32:58.949872 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:32:58.949845 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:32:58.950471 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:58.950114 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:32:58.950471 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:58.950202 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:32:58.950471 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:32:58.950337 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:33:00.705990 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:00.705956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c28bq\" (UniqueName: \"kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq\") pod \"network-check-target-8zj85\" (UID: \"45ab025b-b154-44d0-bc68-87769a1b3bf6\") " pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:00.706384 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:00.705996 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:00.706384 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:00.706023 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs\") pod \"network-metrics-daemon-g8skl\" (UID: \"672e5316-3afa-43ab-a9e5-672d12a1c26e\") " pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:00.706384 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:00.706117 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 02 09:33:00.706384 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:00.706177 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret podName:5ead495a-945d-4c39-954e-98e47d4976cf nodeName:}" failed. No retries permitted until 2026-08-02 09:33:16.706161268 +0000 UTC m=+33.267316570 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret") pod "global-pull-secret-syncer-cfz4x" (UID: "5ead495a-945d-4c39-954e-98e47d4976cf") : object "kube-system"/"original-pull-secret" not registered Aug 02 09:33:00.706384 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:00.706125 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 02 09:33:00.706384 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:00.706219 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 02 09:33:00.706384 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:00.706232 2575 projected.go:196] Error preparing data for projected volume kube-api-access-c28bq for pod openshift-network-diagnostics/network-check-target-8zj85: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 09:33:00.706384 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:00.706124 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 09:33:00.706384 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:00.706284 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq podName:45ab025b-b154-44d0-bc68-87769a1b3bf6 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:16.70626845 +0000 UTC m=+33.267423771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c28bq" (UniqueName: "kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq") pod "network-check-target-8zj85" (UID: "45ab025b-b154-44d0-bc68-87769a1b3bf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 09:33:00.706384 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:00.706322 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs podName:672e5316-3afa-43ab-a9e5-672d12a1c26e nodeName:}" failed. No retries permitted until 2026-08-02 09:33:16.7063083 +0000 UTC m=+33.267463612 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs") pod "network-metrics-daemon-g8skl" (UID: "672e5316-3afa-43ab-a9e5-672d12a1c26e") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 09:33:00.950337 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:00.950308 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:00.950511 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:00.950308 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:00.950511 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:00.950421 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:33:00.950511 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:00.950309 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:00.950511 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:00.950485 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:33:00.950722 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:00.950546 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:33:02.950719 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:02.950507 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:02.951199 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:02.950507 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:02.951199 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:02.950841 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:33:02.951199 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:02.950507 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:02.951199 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:02.950890 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:33:02.951199 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:02.950968 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:33:04.950786 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:04.950736 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:04.951224 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:04.950743 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:04.951224 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:04.950862 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:33:04.951224 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:04.950882 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:04.951224 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:04.951015 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:33:04.951224 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:04.951132 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:33:06.124846 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:06.124809 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-118.ec2.internal" event={"ID":"b0db2a1efae079538404aaf0b49eb4e1","Type":"ContainerStarted","Data":"ecd00d7696060ccfeace9cb29184858efc75b4d1e3eccfd6c425e0f19baf4cf5"} Aug 02 09:33:06.126236 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:06.126213 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pcklq" event={"ID":"ee24b8ba-130b-48f0-ba6d-69a599c4e703","Type":"ContainerStarted","Data":"6299d8abba087596fdb98eadab4360bfbe60007446e9e5df39672a3d5465ab6a"} Aug 02 09:33:06.127696 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:06.127670 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cwkdq" event={"ID":"93964564-0f3e-4b0e-8470-02c97619fadc","Type":"ContainerStarted","Data":"50b69baa97e46c82e2e838ad5e5189da65f7660e8e258cdec5b42fb122c75e2b"} Aug 02 09:33:06.137619 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:06.137543 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-118.ec2.internal" podStartSLOduration=21.137530707 podStartE2EDuration="21.137530707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 09:32:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:06.137335102 +0000 UTC m=+22.698490422" watchObservedRunningTime="2026-08-02 09:33:06.137530707 +0000 UTC m=+22.698686027" Aug 02 09:33:06.151526 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:06.151492 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cwkdq" podStartSLOduration=1.649904731 podStartE2EDuration="22.151480081s" totalImagesPullingTime="20.50157535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 09:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:06.151275453 +0000 UTC m=+22.712430774" watchObservedRunningTime="2026-08-02 09:33:06.151480081 +0000 UTC m=+22.712635424" Aug 02 09:33:06.165215 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:06.165180 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pcklq" podStartSLOduration=2.002817726 podStartE2EDuration="22.165167392s" totalImagesPullingTime="20.162349666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 09:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:06.164749744 +0000 UTC m=+22.725905066" watchObservedRunningTime="2026-08-02 09:33:06.165167392 +0000 UTC m=+22.726322711" Aug 02 09:33:06.950343 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:06.950114 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:06.950509 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:06.950114 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:06.950509 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:06.950416 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:33:06.950509 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:06.950114 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:06.950509 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:06.950460 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:33:06.950709 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:06.950533 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:33:07.130934 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.130892 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lfv22" event={"ID":"bfa1c5f7-d982-410d-8f84-aa2cf646c6cd","Type":"ContainerStarted","Data":"08c4208e72add863d7e46b97496eeb7897c53afba115cfc9c347a3c998ead481"} Aug 02 09:33:07.133691 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.133671 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 09:33:07.134061 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.134042 2575 generic.go:356] "Generic (PLEG): container finished" podID="8a99e78f-f418-412c-afa5-1ed095c705e8" containerID="453db4417b6f28e2f913281235f2668ab5404076f459ff4ff21edf7fb74dfb26" exitCode=1 Aug 02 09:33:07.134126 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.134107 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" event={"ID":"8a99e78f-f418-412c-afa5-1ed095c705e8","Type":"ContainerStarted","Data":"29ea34b22773eb3bfc918ebb6b96355c9c0561df2a3d4452e836293a6f880342"} Aug 02 09:33:07.134166 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.134155 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" event={"ID":"8a99e78f-f418-412c-afa5-1ed095c705e8","Type":"ContainerStarted","Data":"31cf4e7d3da033510f129243b11182bc08d2dcb1db3497efa48449b48bb232b6"} Aug 02 09:33:07.134221 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.134202 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" event={"ID":"8a99e78f-f418-412c-afa5-1ed095c705e8","Type":"ContainerStarted","Data":"b4abe1fb04749fe5de27221dce101ff1d2f15fd882b902ec0a9934aaac82ce18"} Aug 02 09:33:07.134503 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.134236 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" event={"ID":"8a99e78f-f418-412c-afa5-1ed095c705e8","Type":"ContainerStarted","Data":"b3633d8f296c80624eb113c65feea85291ae9051c27b1e22b760a4a8041ce49c"} Aug 02 09:33:07.134503 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.134275 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" event={"ID":"8a99e78f-f418-412c-afa5-1ed095c705e8","Type":"ContainerDied","Data":"453db4417b6f28e2f913281235f2668ab5404076f459ff4ff21edf7fb74dfb26"} Aug 02 09:33:07.134503 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.134306 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" event={"ID":"8a99e78f-f418-412c-afa5-1ed095c705e8","Type":"ContainerStarted","Data":"e220df7ff79763fa1426671fc28dc826051e6dabb0074e73a40d2148bf33470e"} Aug 02 09:33:07.135459 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.135440 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9877t" event={"ID":"b4cd2259-11bd-4e97-a3ea-154b643786e5","Type":"ContainerStarted","Data":"b3267a1758fad96d127442df272ce4e4488a4224da9a9a3d97df89eaa9a9d7cd"} Aug 02 09:33:07.136735 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.136704 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" event={"ID":"9553a3b0-fc35-448d-bd28-3c67561738bf","Type":"ContainerStarted","Data":"9548ee29b92f0eef43ec13d06b26d6acd277ac35528f0a6ac46ab66a9063d225"} Aug 02 09:33:07.137983 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.137962 2575 generic.go:356] "Generic (PLEG): container finished" podID="1f4e25cd-d1a3-488f-a108-f358f6ea7c41" containerID="eaf156e672f859a2f79508316ae6790749a204bc96a970dfe085c1816b0c490f" exitCode=0 Aug 02 09:33:07.138069 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.138024 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t2wd" event={"ID":"1f4e25cd-d1a3-488f-a108-f358f6ea7c41","Type":"ContainerDied","Data":"eaf156e672f859a2f79508316ae6790749a204bc96a970dfe085c1816b0c490f"} Aug 02 09:33:07.139402 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.139384 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8cg55" event={"ID":"a559e669-33cb-46af-b05a-24b0a9cd6b12","Type":"ContainerStarted","Data":"4e1fdc74fa94594296969eceb4a538aeaec729d9985554b45654345bb059d326"} Aug 02 09:33:07.140731 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.140713 2575 generic.go:356] "Generic (PLEG): container finished" podID="c5d4b06937af6ba8a8eda74dc1664069" containerID="b622b854bb096bbc8dacf925321f05b2d1efd0166c4fbd517fba36ba191a2fb0" exitCode=0 Aug 02 09:33:07.140828 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.140791 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal" event={"ID":"c5d4b06937af6ba8a8eda74dc1664069","Type":"ContainerDied","Data":"b622b854bb096bbc8dacf925321f05b2d1efd0166c4fbd517fba36ba191a2fb0"} Aug 02 09:33:07.142287 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.142247 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2rnlq" event={"ID":"0a3a2b26-2590-4283-bc30-bff9b47feeb6","Type":"ContainerStarted","Data":"4ddb28bcde5b5557419bd999ce718a12271e288b6aa628d65cdb88bf5abc8c71"} Aug 02 09:33:07.143900 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.143863 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lfv22" podStartSLOduration=2.069978715 podStartE2EDuration="22.14385167s" totalImagesPullingTime="20.073872955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:07.143612828 +0000 UTC m=+23.704768147" watchObservedRunningTime="2026-08-02 09:33:07.14385167 +0000 UTC m=+23.705006981" Aug 02 09:33:07.155397 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.155364 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2rnlq" podStartSLOduration=1.75040673 podStartE2EDuration="22.155353094s" totalImagesPullingTime="20.404946364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 09:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-08-02 09:33:07.155130493 +0000 UTC m=+23.716285813" watchObservedRunningTime="2026-08-02 09:33:07.155353094 +0000 UTC m=+23.716508413" Aug 02 09:33:07.203718 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.203623 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9877t" podStartSLOduration=2.09540106 podStartE2EDuration="22.203607106s" totalImagesPullingTime="20.108206046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 09:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:07.201184406 +0000 UTC m=+23.762339726" watchObservedRunningTime="2026-08-02 09:33:07.203607106 +0000 UTC m=+23.764762426" Aug 02 09:33:07.204351 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.204311 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8cg55" podStartSLOduration=3.01472441 podStartE2EDuration="23.204299592s" totalImagesPullingTime="20.189575182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 09:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:07.176786354 +0000 UTC m=+23.737941665" watchObservedRunningTime="2026-08-02 09:33:07.204299592 +0000 UTC m=+23.765454913" Aug 02 09:33:07.935238 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:07.935218 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 02 09:33:08.146059 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:08.145975 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" event={"ID":"9553a3b0-fc35-448d-bd28-3c67561738bf","Type":"ContainerStarted","Data":"192481260a065b05d354edb5f7fcda7257cfb160d71974d51c29b6c782ac0fa9"} Aug 02 09:33:08.147686 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:08.147658 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal" event={"ID":"c5d4b06937af6ba8a8eda74dc1664069","Type":"ContainerStarted","Data":"ce012a7f3b473bd8ae666f15e592113e79731d74e41399e7796681086fb081c2"} Aug 02 09:33:08.160274 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:08.160234 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-118.ec2.internal" podStartSLOduration=23.160221917 podStartE2EDuration="23.160221917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 09:32:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:08.160211279 +0000 UTC m=+24.721366600" watchObservedRunningTime="2026-08-02 09:33:08.160221917 +0000 UTC m=+24.721377236" Aug 02 09:33:08.918861 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:08.918743 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-02T09:33:07.935234426Z","UUID":"dec97f4e-a33c-46c1-a2c6-56f76666f4aa","Handler":null,"Name":"","Endpoint":""} Aug 02 09:33:08.920326 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:08.920301 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 02 09:33:08.920454 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:08.920345 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 02 09:33:08.950054 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:08.950022 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:08.950207 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:08.950118 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:08.950207 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:08.950125 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:33:08.950207 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:08.950147 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:08.950319 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:08.950213 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:33:08.950319 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:08.950269 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:33:09.153102 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:09.152949 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 09:33:09.153499 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:09.153477 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" event={"ID":"8a99e78f-f418-412c-afa5-1ed095c705e8","Type":"ContainerStarted","Data":"edc14b7e4ca8448ef7312113edb923a312e2e5c1d495e0bd07bed9e1af0f15ac"} Aug 02 09:33:09.155680 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:09.155656 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" event={"ID":"9553a3b0-fc35-448d-bd28-3c67561738bf","Type":"ContainerStarted","Data":"c6efb2635eec90435c07d36e8899e5786edd41aa934951bdf17fcba4fc4da277"} Aug 02 09:33:10.173360 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:10.173304 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjrwt" podStartSLOduration=2.6443100729999998 podStartE2EDuration="25.173285243s" totalImagesPullingTime="22.52897517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 09:32:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:10.172223908 +0000 UTC m=+26.733379229" watchObservedRunningTime="2026-08-02 09:33:10.173285243 +0000 UTC m=+26.734440564" Aug 02 09:33:10.949839 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:10.949800 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:10.950013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:10.949847 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:10.950013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:10.949847 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:10.950013 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:10.949928 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:33:10.950125 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:10.950056 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:33:10.950160 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:10.950139 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:33:11.356108 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:11.356031 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lfv22" Aug 02 09:33:11.356596 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:11.356547 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lfv22" Aug 02 09:33:12.162621 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:12.162587 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lfv22" Aug 02 09:33:12.163143 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:12.163124 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lfv22" Aug 02 09:33:12.950444 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:12.950259 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:12.951011 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:12.950256 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:12.951011 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:12.950528 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:33:12.951011 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:12.950305 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:12.951011 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:12.950592 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:33:12.951011 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:12.950652 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:33:13.167559 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:13.167485 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 09:33:13.167882 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:13.167850 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" event={"ID":"8a99e78f-f418-412c-afa5-1ed095c705e8","Type":"ContainerStarted","Data":"d39dae01b2f7a7b0ad43b248f7536e9e9b636b9d461be7cbdd364902bf59927e"} Aug 02 09:33:13.168109 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:13.168082 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:33:13.168288 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:13.168270 2575 scope.go:117] "RemoveContainer" containerID="453db4417b6f28e2f913281235f2668ab5404076f459ff4ff21edf7fb74dfb26" Aug 02 09:33:13.169722 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:13.169700 2575 generic.go:356] "Generic (PLEG): container finished" podID="1f4e25cd-d1a3-488f-a108-f358f6ea7c41" containerID="e03325546e1b6cc98a650c6e2868083e1502839687516c719e1fbb3bdfbda18c" exitCode=0 Aug 02 09:33:13.169829 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:13.169799 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t2wd" event={"ID":"1f4e25cd-d1a3-488f-a108-f358f6ea7c41","Type":"ContainerDied","Data":"e03325546e1b6cc98a650c6e2868083e1502839687516c719e1fbb3bdfbda18c"} Aug 02 09:33:13.184431 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:13.184398 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:33:14.174414 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:14.174378 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t2wd" event={"ID":"1f4e25cd-d1a3-488f-a108-f358f6ea7c41","Type":"ContainerStarted","Data":"ee22f58d9ff8c650240f1fa1846115a542f8e9d7c9ca23490479bc50a19875d3"} Aug 02 09:33:14.178415 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:14.178396 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 09:33:14.178808 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:14.178768 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" event={"ID":"8a99e78f-f418-412c-afa5-1ed095c705e8","Type":"ContainerStarted","Data":"f9a51dbdb7a84ea48f2f365c38fa91bfdb61d07cd14f53b75b7ab2b467d47396"} Aug 02 09:33:14.179041 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:14.179025 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:33:14.179118 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:14.179096 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:33:14.193876 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:14.193845 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:33:14.222721 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:14.222679 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" podStartSLOduration=8.289561801 podStartE2EDuration="29.22266456s" totalImagesPullingTime="20.933102759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 09:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:14.221321409 +0000 UTC m=+30.782476748" watchObservedRunningTime="2026-08-02 09:33:14.22266456 +0000 UTC m=+30.783819880" Aug 02 09:33:14.746794 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:14.746746 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cfz4x"] Aug 02 09:33:14.746946 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:14.746907 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:14.747012 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:14.746991 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:33:14.749302 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:14.749241 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8zj85"] Aug 02 09:33:14.749429 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:14.749358 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:14.749493 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:14.749445 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:33:14.750070 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:14.750048 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g8skl"] Aug 02 09:33:14.750185 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:14.750154 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:14.750301 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:14.750282 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:33:15.183954 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:15.183714 2575 generic.go:356] "Generic (PLEG): container finished" podID="1f4e25cd-d1a3-488f-a108-f358f6ea7c41" containerID="ee22f58d9ff8c650240f1fa1846115a542f8e9d7c9ca23490479bc50a19875d3" exitCode=0 Aug 02 09:33:15.184300 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:15.183961 2575 generic.go:356] "Generic (PLEG): container finished" podID="1f4e25cd-d1a3-488f-a108-f358f6ea7c41" containerID="725b229ed79e53078877044e159e5ee9f6ced2204c22cc5ad619f8de63e400f0" exitCode=0 Aug 02 09:33:15.184300 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:15.183807 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t2wd" event={"ID":"1f4e25cd-d1a3-488f-a108-f358f6ea7c41","Type":"ContainerDied","Data":"ee22f58d9ff8c650240f1fa1846115a542f8e9d7c9ca23490479bc50a19875d3"} Aug 02 09:33:15.184300 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:15.184087 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t2wd" event={"ID":"1f4e25cd-d1a3-488f-a108-f358f6ea7c41","Type":"ContainerDied","Data":"725b229ed79e53078877044e159e5ee9f6ced2204c22cc5ad619f8de63e400f0"} Aug 02 09:33:16.726554 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:16.726516 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c28bq\" (UniqueName: \"kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq\") pod \"network-check-target-8zj85\" (UID: \"45ab025b-b154-44d0-bc68-87769a1b3bf6\") " pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:16.727228 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:16.726567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:16.727228 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:16.726663 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 02 09:33:16.727228 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:16.726697 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs\") pod \"network-metrics-daemon-g8skl\" (UID: \"672e5316-3afa-43ab-a9e5-672d12a1c26e\") " pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:16.727228 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:16.726703 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 02 09:33:16.727228 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:16.726722 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret podName:5ead495a-945d-4c39-954e-98e47d4976cf nodeName:}" failed. No retries permitted until 2026-08-02 09:33:48.726705875 +0000 UTC m=+65.287861193 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret") pod "global-pull-secret-syncer-cfz4x" (UID: "5ead495a-945d-4c39-954e-98e47d4976cf") : object "kube-system"/"original-pull-secret" not registered Aug 02 09:33:16.727228 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:16.726741 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 02 09:33:16.727228 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:16.726757 2575 projected.go:196] Error preparing data for projected volume kube-api-access-c28bq for pod openshift-network-diagnostics/network-check-target-8zj85: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 09:33:16.727228 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:16.726763 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 09:33:16.727228 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:16.726832 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq podName:45ab025b-b154-44d0-bc68-87769a1b3bf6 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:48.72681152 +0000 UTC m=+65.287966819 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c28bq" (UniqueName: "kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq") pod "network-check-target-8zj85" (UID: "45ab025b-b154-44d0-bc68-87769a1b3bf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 09:33:16.727228 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:16.726855 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs podName:672e5316-3afa-43ab-a9e5-672d12a1c26e nodeName:}" failed. No retries permitted until 2026-08-02 09:33:48.726844722 +0000 UTC m=+65.288000019 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs") pod "network-metrics-daemon-g8skl" (UID: "672e5316-3afa-43ab-a9e5-672d12a1c26e") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 09:33:16.950018 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:16.949935 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:16.950018 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:16.949946 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:16.950265 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:16.949937 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:16.950265 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:16.950077 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:33:16.950265 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:16.950193 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:33:16.950409 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:16.950283 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:33:18.950801 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:18.950740 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:18.950801 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:18.950801 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:18.951461 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:18.950801 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:18.951461 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:18.950898 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfz4x" podUID="5ead495a-945d-4c39-954e-98e47d4976cf" Aug 02 09:33:18.951461 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:18.951000 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zj85" podUID="45ab025b-b154-44d0-bc68-87769a1b3bf6" Aug 02 09:33:18.951461 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:18.951071 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8skl" podUID="672e5316-3afa-43ab-a9e5-672d12a1c26e" Aug 02 09:33:19.799003 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.798970 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-118.ec2.internal" event="NodeReady" Aug 02 09:33:19.799315 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.799128 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 02 09:33:19.838076 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.838026 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54"] Aug 02 09:33:19.864205 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.864173 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bccbf69c5-tv8vq"] Aug 02 09:33:19.864377 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.864330 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" Aug 02 09:33:19.866928 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.866905 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Aug 02 09:33:19.867146 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.867129 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Aug 02 09:33:19.867269 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.867162 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Aug 02 09:33:19.867269 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.867247 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-f8l5c\"" Aug 02 09:33:19.867370 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.867285 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Aug 02 09:33:19.879987 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.879929 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl"] Aug 02 09:33:19.880820 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.880794 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:19.884647 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.884237 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f75jg\"" Aug 02 09:33:19.884647 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.884488 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Aug 02 09:33:19.885423 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.885403 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Aug 02 09:33:19.886160 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.885896 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Aug 02 09:33:19.892891 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.892875 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Aug 02 09:33:19.898410 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.898379 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-68bf45c684-8lbrw"] Aug 02 09:33:19.898559 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.898542 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" Aug 02 09:33:19.900701 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.900680 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Aug 02 09:33:19.900814 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.900742 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Aug 02 09:33:19.900878 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.900812 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-csq7m\"" Aug 02 09:33:19.901415 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.901115 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Aug 02 09:33:19.920060 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.920041 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-mkpqg"] Aug 02 09:33:19.920169 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.920157 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:19.922820 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.922519 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Aug 02 09:33:19.922820 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.922536 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Aug 02 09:33:19.922820 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.922599 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Aug 02 09:33:19.922820 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.922617 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t7hq9\"" Aug 02 09:33:19.922820 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.922626 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Aug 02 09:33:19.922820 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.922685 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Aug 02 09:33:19.922820 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.922620 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Aug 02 09:33:19.940248 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.940226 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7wlgl"] Aug 02 09:33:19.940395 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.940380 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-mkpqg" Aug 02 09:33:19.942500 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.942469 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tvgqf\"" Aug 02 09:33:19.942604 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.942469 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Aug 02 09:33:19.942604 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.942598 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Aug 02 09:33:19.951564 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.951539 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-589dt\" (UniqueName: \"kubernetes.io/projected/70b57d9a-568e-4b0d-9017-4f02b3a832a5-kube-api-access-589dt\") pod \"service-ca-operator-784f97bcf6-tvg54\" (UID: \"70b57d9a-568e-4b0d-9017-4f02b3a832a5\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" Aug 02 09:33:19.951916 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.951606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70b57d9a-568e-4b0d-9017-4f02b3a832a5-serving-cert\") pod \"service-ca-operator-784f97bcf6-tvg54\" (UID: \"70b57d9a-568e-4b0d-9017-4f02b3a832a5\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" Aug 02 09:33:19.951916 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.951686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70b57d9a-568e-4b0d-9017-4f02b3a832a5-config\") pod \"service-ca-operator-784f97bcf6-tvg54\" (UID: \"70b57d9a-568e-4b0d-9017-4f02b3a832a5\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" Aug 02 09:33:19.966486 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.966464 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-rlxjx"] Aug 02 09:33:19.966573 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.966469 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:19.968607 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.968588 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 02 09:33:19.968607 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.968593 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 02 09:33:19.968882 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.968869 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zv4ml\"" Aug 02 09:33:19.988649 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.988630 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm"] Aug 02 09:33:19.988745 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.988732 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:19.990628 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.990610 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Aug 02 09:33:19.990742 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.990727 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 02 09:33:19.990955 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.990938 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Aug 02 09:33:19.991032 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.990945 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dtnz4\"" Aug 02 09:33:19.991032 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.990947 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 02 09:33:19.997550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:19.997528 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Aug 02 09:33:20.004842 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.004825 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl"] Aug 02 09:33:20.004934 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.004860 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54"] Aug 02 09:33:20.004934 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.004885 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68bf45c684-8lbrw"] Aug 02 09:33:20.005045 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.004998 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:20.008116 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.008087 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Aug 02 09:33:20.008213 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.008160 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 02 09:33:20.008213 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.008171 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 02 09:33:20.008213 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.008187 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cnsnj\"" Aug 02 09:33:20.008389 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.008170 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Aug 02 09:33:20.008576 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.008556 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bccbf69c5-tv8vq"] Aug 02 09:33:20.008678 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.008592 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-rlxjx"] Aug 02 09:33:20.008678 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.008608 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm"] Aug 02 09:33:20.008678 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.008625 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-7rm2v"] Aug 02 09:33:20.029180 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.029164 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c"] Aug 02 09:33:20.029283 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.029270 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:20.031873 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.031856 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Aug 02 09:33:20.031968 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.031890 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-tpq8c\"" Aug 02 09:33:20.031968 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.031917 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Aug 02 09:33:20.032103 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.032091 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Aug 02 09:33:20.032327 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.032315 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Aug 02 09:33:20.037449 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.037432 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Aug 02 09:33:20.043612 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.043599 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" Aug 02 09:33:20.043668 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.043618 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jgcm2"] Aug 02 09:33:20.045682 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.045661 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Aug 02 09:33:20.046032 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.046009 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Aug 02 09:33:20.046032 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.046025 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Aug 02 09:33:20.046183 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.046043 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Aug 02 09:33:20.052987 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.052948 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70b57d9a-568e-4b0d-9017-4f02b3a832a5-serving-cert\") pod \"service-ca-operator-784f97bcf6-tvg54\" (UID: \"70b57d9a-568e-4b0d-9017-4f02b3a832a5\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" Aug 02 09:33:20.052987 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.052974 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75v89\" (UniqueName: \"kubernetes.io/projected/87c64fe1-ab49-4ec4-84a5-07698b9f1070-kube-api-access-75v89\") pod \"volume-data-source-validator-5b8776669-mkpqg\" (UID: \"87c64fe1-ab49-4ec4-84a5-07698b9f1070\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-mkpqg" Aug 02 09:33:20.053130 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.052992 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-tmp-dir\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:20.053130 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70b57d9a-568e-4b0d-9017-4f02b3a832a5-config\") pod \"service-ca-operator-784f97bcf6-tvg54\" (UID: \"70b57d9a-568e-4b0d-9017-4f02b3a832a5\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" Aug 02 09:33:20.053130 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053049 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9e6d019-2275-43d8-850b-f0ac2c4d805e-ca-trust-extracted\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.053130 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053092 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-stats-auth\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.053130 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9e6d019-2275-43d8-850b-f0ac2c4d805e-installation-pull-secrets\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.053358 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053146 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkmmj\" (UniqueName: \"kubernetes.io/projected/32ba520c-f409-4571-8260-1c321bbf4702-kube-api-access-mkmmj\") pod \"cluster-samples-operator-559cbf5745-7tgvl\" (UID: \"32ba520c-f409-4571-8260-1c321bbf4702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" Aug 02 09:33:20.053358 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053170 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-certificates\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.053358 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-default-certificate\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.053358 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053219 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:20.053358 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053276 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9pdt\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-kube-api-access-n9pdt\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.053358 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053305 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.053358 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.053358 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053349 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cjch\" (UniqueName: \"kubernetes.io/projected/a2ee01dc-14aa-4625-8584-22a4d7c70dae-kube-api-access-4cjch\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.053684 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053384 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-589dt\" (UniqueName: \"kubernetes.io/projected/70b57d9a-568e-4b0d-9017-4f02b3a832a5-kube-api-access-589dt\") pod \"service-ca-operator-784f97bcf6-tvg54\" (UID: \"70b57d9a-568e-4b0d-9017-4f02b3a832a5\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" Aug 02 09:33:20.053684 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053418 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9e6d019-2275-43d8-850b-f0ac2c4d805e-image-registry-private-configuration\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.053684 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053447 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-config-volume\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:20.053684 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053467 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xlvh\" (UniqueName: \"kubernetes.io/projected/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-kube-api-access-7xlvh\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:20.053684 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053547 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70b57d9a-568e-4b0d-9017-4f02b3a832a5-config\") pod \"service-ca-operator-784f97bcf6-tvg54\" (UID: \"70b57d9a-568e-4b0d-9017-4f02b3a832a5\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" Aug 02 09:33:20.053684 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053584 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-7tgvl\" (UID: \"32ba520c-f409-4571-8260-1c321bbf4702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" Aug 02 09:33:20.053684 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053652 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9e6d019-2275-43d8-850b-f0ac2c4d805e-trusted-ca\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.053684 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053682 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-bound-sa-token\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.053968 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.053759 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.056911 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.056894 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70b57d9a-568e-4b0d-9017-4f02b3a832a5-serving-cert\") pod \"service-ca-operator-784f97bcf6-tvg54\" (UID: \"70b57d9a-568e-4b0d-9017-4f02b3a832a5\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" Aug 02 09:33:20.057424 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.057397 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-62znj\"" Aug 02 09:33:20.062667 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.062649 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-589dt\" (UniqueName: \"kubernetes.io/projected/70b57d9a-568e-4b0d-9017-4f02b3a832a5-kube-api-access-589dt\") pod \"service-ca-operator-784f97bcf6-tvg54\" (UID: \"70b57d9a-568e-4b0d-9017-4f02b3a832a5\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" Aug 02 09:33:20.065692 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.065673 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-n6ngw"] Aug 02 09:33:20.065846 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.065825 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jgcm2" Aug 02 09:33:20.067699 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.067680 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 02 09:33:20.067924 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.067877 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 02 09:33:20.068020 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.067929 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4s9vb\"" Aug 02 09:33:20.068020 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.068000 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 02 09:33:20.079936 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.079920 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp"] Aug 02 09:33:20.080036 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.080022 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-n6ngw" Aug 02 09:33:20.081999 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.081977 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-v6q87\"" Aug 02 09:33:20.081999 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.081990 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 02 09:33:20.082186 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.082174 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 02 09:33:20.092263 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.092247 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-mkpqg"] Aug 02 09:33:20.092361 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.092273 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7wlgl"] Aug 02 09:33:20.092361 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.092295 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp"] Aug 02 09:33:20.092435 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.092365 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" Aug 02 09:33:20.092435 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.092384 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-7rm2v"] Aug 02 09:33:20.092435 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.092399 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-n6ngw"] Aug 02 09:33:20.092435 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.092418 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c"] Aug 02 09:33:20.092561 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.092495 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jgcm2"] Aug 02 09:33:20.094523 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.094498 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Aug 02 09:33:20.094820 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.094801 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cszcj\"" Aug 02 09:33:20.095104 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.094893 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Aug 02 09:33:20.154279 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154244 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9e6d019-2275-43d8-850b-f0ac2c4d805e-installation-pull-secrets\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.154279 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154280 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkmmj\" (UniqueName: \"kubernetes.io/projected/32ba520c-f409-4571-8260-1c321bbf4702-kube-api-access-mkmmj\") pod \"cluster-samples-operator-559cbf5745-7tgvl\" (UID: \"32ba520c-f409-4571-8260-1c321bbf4702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" Aug 02 09:33:20.154504 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154305 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjlw8\" (UniqueName: \"kubernetes.io/projected/0d2b40e4-a705-4d10-b565-a220c1d687c1-kube-api-access-hjlw8\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.154504 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154336 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tprgv\" (UniqueName: \"kubernetes.io/projected/33c29a7d-6149-4136-ac38-82c7f44fb4e1-kube-api-access-tprgv\") pod \"console-operator-5ccd6b445f-7rm2v\" (UID: \"33c29a7d-6149-4136-ac38-82c7f44fb4e1\") " pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:20.154504 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154374 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.154504 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154399 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cjch\" (UniqueName: \"kubernetes.io/projected/a2ee01dc-14aa-4625-8584-22a4d7c70dae-kube-api-access-4cjch\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.154504 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154448 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xlvh\" (UniqueName: \"kubernetes.io/projected/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-kube-api-access-7xlvh\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:20.154504 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154492 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9e6d019-2275-43d8-850b-f0ac2c4d805e-trusted-ca\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.154916 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33c29a7d-6149-4136-ac38-82c7f44fb4e1-trusted-ca\") pod \"console-operator-5ccd6b445f-7rm2v\" (UID: \"33c29a7d-6149-4136-ac38-82c7f44fb4e1\") " pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:20.154916 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154554 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:20.154916 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154584 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33c29a7d-6149-4136-ac38-82c7f44fb4e1-config\") pod \"console-operator-5ccd6b445f-7rm2v\" (UID: \"33c29a7d-6149-4136-ac38-82c7f44fb4e1\") " pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:20.154916 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.154526 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 09:33:20.154916 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.154614 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bccbf69c5-tv8vq: secret "image-registry-tls" not found Aug 02 09:33:20.154916 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64209794-a5d5-4a29-82ef-bc6d8eecec0c-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-l248c\" (UID: \"64209794-a5d5-4a29-82ef-bc6d8eecec0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" Aug 02 09:33:20.154916 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.154693 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls podName:a9e6d019-2275-43d8-850b-f0ac2c4d805e nodeName:}" failed. No retries permitted until 2026-08-02 09:33:20.654662759 +0000 UTC m=+37.215818060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls") pod "image-registry-5bccbf69c5-tv8vq" (UID: "a9e6d019-2275-43d8-850b-f0ac2c4d805e") : secret "image-registry-tls" not found Aug 02 09:33:20.154916 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.154696 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 09:33:20.154916 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154730 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/981e1336-3fb3-4b90-87a1-94f963b6099b-cert\") pod \"ingress-canary-jgcm2\" (UID: \"981e1336-3fb3-4b90-87a1-94f963b6099b\") " pod="openshift-ingress-canary/ingress-canary-jgcm2" Aug 02 09:33:20.154916 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154761 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d2b40e4-a705-4d10-b565-a220c1d687c1-service-ca-bundle\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.154916 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.154804 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls podName:ed13e3aa-46af-43a9-8f01-3d84befb4b9a nodeName:}" failed. No retries permitted until 2026-08-02 09:33:20.654756191 +0000 UTC m=+37.215911507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls") pod "dns-default-7wlgl" (UID: "ed13e3aa-46af-43a9-8f01-3d84befb4b9a") : secret "dns-default-metrics-tls" not found Aug 02 09:33:20.154916 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154848 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-certificates\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.154916 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154896 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-default-certificate\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.154972 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9pdt\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-kube-api-access-n9pdt\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155045 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64209794-a5d5-4a29-82ef-bc6d8eecec0c-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-l248c\" (UID: \"64209794-a5d5-4a29-82ef-bc6d8eecec0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155145 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4c65\" (UniqueName: \"kubernetes.io/projected/981e1336-3fb3-4b90-87a1-94f963b6099b-kube-api-access-v4c65\") pod \"ingress-canary-jgcm2\" (UID: \"981e1336-3fb3-4b90-87a1-94f963b6099b\") " pod="openshift-ingress-canary/ingress-canary-jgcm2" Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155179 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9e6d019-2275-43d8-850b-f0ac2c4d805e-image-registry-private-configuration\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155211 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-config-volume\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155237 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5qgb\" (UniqueName: \"kubernetes.io/projected/b992edc6-b2fd-4c99-abae-418014dc3ee2-kube-api-access-z5qgb\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.155310 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.155371 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs podName:a2ee01dc-14aa-4625-8584-22a4d7c70dae nodeName:}" failed. No retries permitted until 2026-08-02 09:33:20.655353307 +0000 UTC m=+37.216508620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs") pod "router-default-68bf45c684-8lbrw" (UID: "a2ee01dc-14aa-4625-8584-22a4d7c70dae") : secret "router-metrics-certs-default" not found Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155401 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-7tgvl\" (UID: \"32ba520c-f409-4571-8260-1c321bbf4702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155434 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d2b40e4-a705-4d10-b565-a220c1d687c1-tmp\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-bound-sa-token\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155495 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b992edc6-b2fd-4c99-abae-418014dc3ee2-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.155498 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 02 09:33:20.156252 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155553 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9e6d019-2275-43d8-850b-f0ac2c4d805e-trusted-ca\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.155567 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls podName:32ba520c-f409-4571-8260-1c321bbf4702 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:20.655551272 +0000 UTC m=+37.216706571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-7tgvl" (UID: "32ba520c-f409-4571-8260-1c321bbf4702") : secret "samples-operator-tls" not found Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155617 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33c29a7d-6149-4136-ac38-82c7f44fb4e1-serving-cert\") pod \"console-operator-5ccd6b445f-7rm2v\" (UID: \"33c29a7d-6149-4136-ac38-82c7f44fb4e1\") " pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155683 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75v89\" (UniqueName: \"kubernetes.io/projected/87c64fe1-ab49-4ec4-84a5-07698b9f1070-kube-api-access-75v89\") pod \"volume-data-source-validator-5b8776669-mkpqg\" (UID: \"87c64fe1-ab49-4ec4-84a5-07698b9f1070\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-mkpqg" Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155709 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-tmp-dir\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155723 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-certificates\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155750 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9e6d019-2275-43d8-850b-f0ac2c4d805e-ca-trust-extracted\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155789 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-config-volume\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155797 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d2b40e4-a705-4d10-b565-a220c1d687c1-trusted-ca-bundle\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155846 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwxtc\" (UniqueName: \"kubernetes.io/projected/64209794-a5d5-4a29-82ef-bc6d8eecec0c-kube-api-access-fwxtc\") pod \"kube-storage-version-migrator-operator-7878f4b88c-l248c\" (UID: \"64209794-a5d5-4a29-82ef-bc6d8eecec0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.155855 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle podName:a2ee01dc-14aa-4625-8584-22a4d7c70dae nodeName:}" failed. No retries permitted until 2026-08-02 09:33:20.655838298 +0000 UTC m=+37.216993629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle") pod "router-default-68bf45c684-8lbrw" (UID: "a2ee01dc-14aa-4625-8584-22a4d7c70dae") : configmap references non-existent config key: service-ca.crt Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.155999 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-stats-auth\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.156072 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-tmp-dir\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.156105 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d2b40e4-a705-4d10-b565-a220c1d687c1-snapshots\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.157121 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.156119 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9e6d019-2275-43d8-850b-f0ac2c4d805e-ca-trust-extracted\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.157890 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.156145 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d2b40e4-a705-4d10-b565-a220c1d687c1-serving-cert\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.157890 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.157336 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9e6d019-2275-43d8-850b-f0ac2c4d805e-installation-pull-secrets\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.157890 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.157836 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-default-certificate\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.158290 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.158264 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9e6d019-2275-43d8-850b-f0ac2c4d805e-image-registry-private-configuration\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.158551 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.158536 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-stats-auth\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.162743 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.162718 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xlvh\" (UniqueName: \"kubernetes.io/projected/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-kube-api-access-7xlvh\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:20.163336 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.163225 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cjch\" (UniqueName: \"kubernetes.io/projected/a2ee01dc-14aa-4625-8584-22a4d7c70dae-kube-api-access-4cjch\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.163439 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.163411 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkmmj\" (UniqueName: \"kubernetes.io/projected/32ba520c-f409-4571-8260-1c321bbf4702-kube-api-access-mkmmj\") pod \"cluster-samples-operator-559cbf5745-7tgvl\" (UID: \"32ba520c-f409-4571-8260-1c321bbf4702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" Aug 02 09:33:20.163504 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.163435 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9pdt\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-kube-api-access-n9pdt\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.163900 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.163878 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-bound-sa-token\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.164612 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.164592 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75v89\" (UniqueName: \"kubernetes.io/projected/87c64fe1-ab49-4ec4-84a5-07698b9f1070-kube-api-access-75v89\") pod \"volume-data-source-validator-5b8776669-mkpqg\" (UID: \"87c64fe1-ab49-4ec4-84a5-07698b9f1070\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-mkpqg" Aug 02 09:33:20.178990 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.178968 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" Aug 02 09:33:20.251345 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.251313 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-mkpqg" Aug 02 09:33:20.256641 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.256620 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/981e1336-3fb3-4b90-87a1-94f963b6099b-cert\") pod \"ingress-canary-jgcm2\" (UID: \"981e1336-3fb3-4b90-87a1-94f963b6099b\") " pod="openshift-ingress-canary/ingress-canary-jgcm2" Aug 02 09:33:20.256703 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.256658 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d2b40e4-a705-4d10-b565-a220c1d687c1-service-ca-bundle\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.256703 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.256690 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-7x6tp\" (UID: \"bb3befea-d006-4ddb-a3b0-6ac4b6689fff\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" Aug 02 09:33:20.256808 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.256736 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:20.256808 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.256793 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64209794-a5d5-4a29-82ef-bc6d8eecec0c-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-l248c\" (UID: \"64209794-a5d5-4a29-82ef-bc6d8eecec0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" Aug 02 09:33:20.256899 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.256844 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4c65\" (UniqueName: \"kubernetes.io/projected/981e1336-3fb3-4b90-87a1-94f963b6099b-kube-api-access-v4c65\") pod \"ingress-canary-jgcm2\" (UID: \"981e1336-3fb3-4b90-87a1-94f963b6099b\") " pod="openshift-ingress-canary/ingress-canary-jgcm2" Aug 02 09:33:20.256899 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.256876 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 02 09:33:20.256981 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.256898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5qgb\" (UniqueName: \"kubernetes.io/projected/b992edc6-b2fd-4c99-abae-418014dc3ee2-kube-api-access-z5qgb\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:20.256981 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.256942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d2b40e4-a705-4d10-b565-a220c1d687c1-tmp\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.256981 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.256974 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b992edc6-b2fd-4c99-abae-418014dc3ee2-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:20.257103 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.257015 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33c29a7d-6149-4136-ac38-82c7f44fb4e1-serving-cert\") pod \"console-operator-5ccd6b445f-7rm2v\" (UID: \"33c29a7d-6149-4136-ac38-82c7f44fb4e1\") " pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:20.257103 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.257050 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls podName:b992edc6-b2fd-4c99-abae-418014dc3ee2 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:20.757031027 +0000 UTC m=+37.318186338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-bs6pm" (UID: "b992edc6-b2fd-4c99-abae-418014dc3ee2") : secret "cluster-monitoring-operator-tls" not found Aug 02 09:33:20.257103 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.257083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d2b40e4-a705-4d10-b565-a220c1d687c1-trusted-ca-bundle\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.257264 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.257109 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwxtc\" (UniqueName: \"kubernetes.io/projected/64209794-a5d5-4a29-82ef-bc6d8eecec0c-kube-api-access-fwxtc\") pod \"kube-storage-version-migrator-operator-7878f4b88c-l248c\" (UID: \"64209794-a5d5-4a29-82ef-bc6d8eecec0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" Aug 02 09:33:20.257264 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.257166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d2b40e4-a705-4d10-b565-a220c1d687c1-snapshots\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.257264 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.257194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d2b40e4-a705-4d10-b565-a220c1d687c1-serving-cert\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.257264 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.257225 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjlw8\" (UniqueName: \"kubernetes.io/projected/0d2b40e4-a705-4d10-b565-a220c1d687c1-kube-api-access-hjlw8\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.257449 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.257264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tprgv\" (UniqueName: \"kubernetes.io/projected/33c29a7d-6149-4136-ac38-82c7f44fb4e1-kube-api-access-tprgv\") pod \"console-operator-5ccd6b445f-7rm2v\" (UID: \"33c29a7d-6149-4136-ac38-82c7f44fb4e1\") " pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:20.257449 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.257322 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-7x6tp\" (UID: \"bb3befea-d006-4ddb-a3b0-6ac4b6689fff\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" Aug 02 09:33:20.257449 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.257329 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d2b40e4-a705-4d10-b565-a220c1d687c1-service-ca-bundle\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.257449 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.257386 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9j9r\" (UniqueName: \"kubernetes.io/projected/08087080-49ec-4fab-a6f4-07151ca3b16a-kube-api-access-z9j9r\") pod \"network-check-source-65bdbbff45-n6ngw\" (UID: \"08087080-49ec-4fab-a6f4-07151ca3b16a\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-n6ngw" Aug 02 09:33:20.257636 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.257483 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64209794-a5d5-4a29-82ef-bc6d8eecec0c-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-l248c\" (UID: \"64209794-a5d5-4a29-82ef-bc6d8eecec0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" Aug 02 09:33:20.257860 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.257833 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d2b40e4-a705-4d10-b565-a220c1d687c1-tmp\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.257985 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.257902 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33c29a7d-6149-4136-ac38-82c7f44fb4e1-trusted-ca\") pod \"console-operator-5ccd6b445f-7rm2v\" (UID: \"33c29a7d-6149-4136-ac38-82c7f44fb4e1\") " pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:20.257985 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.257902 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b992edc6-b2fd-4c99-abae-418014dc3ee2-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:20.258256 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.258233 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33c29a7d-6149-4136-ac38-82c7f44fb4e1-config\") pod \"console-operator-5ccd6b445f-7rm2v\" (UID: \"33c29a7d-6149-4136-ac38-82c7f44fb4e1\") " pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:20.258357 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.258276 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64209794-a5d5-4a29-82ef-bc6d8eecec0c-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-l248c\" (UID: \"64209794-a5d5-4a29-82ef-bc6d8eecec0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" Aug 02 09:33:20.258357 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.258329 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d2b40e4-a705-4d10-b565-a220c1d687c1-trusted-ca-bundle\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.258614 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.258589 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d2b40e4-a705-4d10-b565-a220c1d687c1-snapshots\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.258868 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.258834 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33c29a7d-6149-4136-ac38-82c7f44fb4e1-trusted-ca\") pod \"console-operator-5ccd6b445f-7rm2v\" (UID: \"33c29a7d-6149-4136-ac38-82c7f44fb4e1\") " pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:20.259024 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.259005 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33c29a7d-6149-4136-ac38-82c7f44fb4e1-config\") pod \"console-operator-5ccd6b445f-7rm2v\" (UID: \"33c29a7d-6149-4136-ac38-82c7f44fb4e1\") " pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:20.260238 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.260221 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33c29a7d-6149-4136-ac38-82c7f44fb4e1-serving-cert\") pod \"console-operator-5ccd6b445f-7rm2v\" (UID: \"33c29a7d-6149-4136-ac38-82c7f44fb4e1\") " pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:20.260315 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.260250 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/981e1336-3fb3-4b90-87a1-94f963b6099b-cert\") pod \"ingress-canary-jgcm2\" (UID: \"981e1336-3fb3-4b90-87a1-94f963b6099b\") " pod="openshift-ingress-canary/ingress-canary-jgcm2" Aug 02 09:33:20.260451 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.260435 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d2b40e4-a705-4d10-b565-a220c1d687c1-serving-cert\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.260539 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.260526 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64209794-a5d5-4a29-82ef-bc6d8eecec0c-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-l248c\" (UID: \"64209794-a5d5-4a29-82ef-bc6d8eecec0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" Aug 02 09:33:20.267155 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.267130 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5qgb\" (UniqueName: \"kubernetes.io/projected/b992edc6-b2fd-4c99-abae-418014dc3ee2-kube-api-access-z5qgb\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:20.267502 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.267485 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwxtc\" (UniqueName: \"kubernetes.io/projected/64209794-a5d5-4a29-82ef-bc6d8eecec0c-kube-api-access-fwxtc\") pod \"kube-storage-version-migrator-operator-7878f4b88c-l248c\" (UID: \"64209794-a5d5-4a29-82ef-bc6d8eecec0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" Aug 02 09:33:20.267604 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.267576 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4c65\" (UniqueName: \"kubernetes.io/projected/981e1336-3fb3-4b90-87a1-94f963b6099b-kube-api-access-v4c65\") pod \"ingress-canary-jgcm2\" (UID: \"981e1336-3fb3-4b90-87a1-94f963b6099b\") " pod="openshift-ingress-canary/ingress-canary-jgcm2" Aug 02 09:33:20.268104 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.268083 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tprgv\" (UniqueName: \"kubernetes.io/projected/33c29a7d-6149-4136-ac38-82c7f44fb4e1-kube-api-access-tprgv\") pod \"console-operator-5ccd6b445f-7rm2v\" (UID: \"33c29a7d-6149-4136-ac38-82c7f44fb4e1\") " pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:20.268227 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.268211 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjlw8\" (UniqueName: \"kubernetes.io/projected/0d2b40e4-a705-4d10-b565-a220c1d687c1-kube-api-access-hjlw8\") pod \"insights-operator-77696685b-rlxjx\" (UID: \"0d2b40e4-a705-4d10-b565-a220c1d687c1\") " pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.300454 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.300430 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-rlxjx" Aug 02 09:33:20.337019 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.336983 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:20.351133 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.351107 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" Aug 02 09:33:20.359465 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.359442 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9j9r\" (UniqueName: \"kubernetes.io/projected/08087080-49ec-4fab-a6f4-07151ca3b16a-kube-api-access-z9j9r\") pod \"network-check-source-65bdbbff45-n6ngw\" (UID: \"08087080-49ec-4fab-a6f4-07151ca3b16a\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-n6ngw" Aug 02 09:33:20.359586 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.359494 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-7x6tp\" (UID: \"bb3befea-d006-4ddb-a3b0-6ac4b6689fff\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" Aug 02 09:33:20.359660 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.359644 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-7x6tp\" (UID: \"bb3befea-d006-4ddb-a3b0-6ac4b6689fff\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" Aug 02 09:33:20.359718 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.359697 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 02 09:33:20.359804 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.359792 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert podName:bb3befea-d006-4ddb-a3b0-6ac4b6689fff nodeName:}" failed. No retries permitted until 2026-08-02 09:33:20.859745585 +0000 UTC m=+37.420901154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-7x6tp" (UID: "bb3befea-d006-4ddb-a3b0-6ac4b6689fff") : secret "networking-console-plugin-cert" not found Aug 02 09:33:20.360202 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.360185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-7x6tp\" (UID: \"bb3befea-d006-4ddb-a3b0-6ac4b6689fff\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" Aug 02 09:33:20.367203 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.367185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9j9r\" (UniqueName: \"kubernetes.io/projected/08087080-49ec-4fab-a6f4-07151ca3b16a-kube-api-access-z9j9r\") pod \"network-check-source-65bdbbff45-n6ngw\" (UID: \"08087080-49ec-4fab-a6f4-07151ca3b16a\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-n6ngw" Aug 02 09:33:20.374155 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.374138 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jgcm2" Aug 02 09:33:20.387339 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.387325 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-n6ngw" Aug 02 09:33:20.666104 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.663962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.666104 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.664511 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:20.666241 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.666135 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:20.666297 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.666252 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:20.666343 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.666300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-7tgvl\" (UID: \"32ba520c-f409-4571-8260-1c321bbf4702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" Aug 02 09:33:20.666743 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.666442 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 02 09:33:20.666743 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.666508 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls podName:32ba520c-f409-4571-8260-1c321bbf4702 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:21.666490422 +0000 UTC m=+38.227645735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-7tgvl" (UID: "32ba520c-f409-4571-8260-1c321bbf4702") : secret "samples-operator-tls" not found Aug 02 09:33:20.666743 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.666525 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle podName:a2ee01dc-14aa-4625-8584-22a4d7c70dae nodeName:}" failed. No retries permitted until 2026-08-02 09:33:21.666516962 +0000 UTC m=+38.227672261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle") pod "router-default-68bf45c684-8lbrw" (UID: "a2ee01dc-14aa-4625-8584-22a4d7c70dae") : configmap references non-existent config key: service-ca.crt Aug 02 09:33:20.666743 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.666584 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 09:33:20.666743 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.666595 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bccbf69c5-tv8vq: secret "image-registry-tls" not found Aug 02 09:33:20.666743 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.666625 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls podName:a9e6d019-2275-43d8-850b-f0ac2c4d805e nodeName:}" failed. No retries permitted until 2026-08-02 09:33:21.666615983 +0000 UTC m=+38.227771295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls") pod "image-registry-5bccbf69c5-tv8vq" (UID: "a9e6d019-2275-43d8-850b-f0ac2c4d805e") : secret "image-registry-tls" not found Aug 02 09:33:20.666743 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.666626 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 02 09:33:20.666743 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.666657 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs podName:a2ee01dc-14aa-4625-8584-22a4d7c70dae nodeName:}" failed. No retries permitted until 2026-08-02 09:33:21.666648307 +0000 UTC m=+38.227803622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs") pod "router-default-68bf45c684-8lbrw" (UID: "a2ee01dc-14aa-4625-8584-22a4d7c70dae") : secret "router-metrics-certs-default" not found Aug 02 09:33:20.666743 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.666671 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 09:33:20.666743 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.666700 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls podName:ed13e3aa-46af-43a9-8f01-3d84befb4b9a nodeName:}" failed. No retries permitted until 2026-08-02 09:33:21.66669177 +0000 UTC m=+38.227847080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls") pod "dns-default-7wlgl" (UID: "ed13e3aa-46af-43a9-8f01-3d84befb4b9a") : secret "dns-default-metrics-tls" not found Aug 02 09:33:20.696068 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:20.695885 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod981e1336_3fb3_4b90_87a1_94f963b6099b.slice/crio-1385c33ee1a62c2b54cc246cfc6f4dd1ce639b0d65b5a0f18ddc9132ee2f899f WatchSource:0}: Error finding container 1385c33ee1a62c2b54cc246cfc6f4dd1ce639b0d65b5a0f18ddc9132ee2f899f: Status 404 returned error can't find the container with id 1385c33ee1a62c2b54cc246cfc6f4dd1ce639b0d65b5a0f18ddc9132ee2f899f Aug 02 09:33:20.696564 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.696512 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jgcm2"] Aug 02 09:33:20.698218 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.698188 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-rlxjx"] Aug 02 09:33:20.705268 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.705244 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c"] Aug 02 09:33:20.712390 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.712366 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-mkpqg"] Aug 02 09:33:20.715691 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.715660 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54"] Aug 02 09:33:20.718638 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.718603 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-n6ngw"] Aug 02 09:33:20.719769 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.719751 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-7rm2v"] Aug 02 09:33:20.723388 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:20.723365 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64209794_a5d5_4a29_82ef_bc6d8eecec0c.slice/crio-97957d9c487d432877e74b926588b756b8531502d5008adc25b8addc623df18f WatchSource:0}: Error finding container 97957d9c487d432877e74b926588b756b8531502d5008adc25b8addc623df18f: Status 404 returned error can't find the container with id 97957d9c487d432877e74b926588b756b8531502d5008adc25b8addc623df18f Aug 02 09:33:20.723644 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:20.723604 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08087080_49ec_4fab_a6f4_07151ca3b16a.slice/crio-e8b70246b4c6a9cd85f8cc71497311b6bccf04b1406405de34213e02ed0b96c7 WatchSource:0}: Error finding container e8b70246b4c6a9cd85f8cc71497311b6bccf04b1406405de34213e02ed0b96c7: Status 404 returned error can't find the container with id e8b70246b4c6a9cd85f8cc71497311b6bccf04b1406405de34213e02ed0b96c7 Aug 02 09:33:20.724579 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:20.724542 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c64fe1_ab49_4ec4_84a5_07698b9f1070.slice/crio-e2e68b375ace3d957bcaf857f78f1efd855658e7e3c2c45067dacbdaa09a9afb WatchSource:0}: Error finding container e2e68b375ace3d957bcaf857f78f1efd855658e7e3c2c45067dacbdaa09a9afb: Status 404 returned error can't find the container with id e2e68b375ace3d957bcaf857f78f1efd855658e7e3c2c45067dacbdaa09a9afb Aug 02 09:33:20.726180 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:20.726146 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d2b40e4_a705_4d10_b565_a220c1d687c1.slice/crio-c810477a33efa935c32fd48c628e06b477a9f42e052b19617d361e620c842538 WatchSource:0}: Error finding container c810477a33efa935c32fd48c628e06b477a9f42e052b19617d361e620c842538: Status 404 returned error can't find the container with id c810477a33efa935c32fd48c628e06b477a9f42e052b19617d361e620c842538 Aug 02 09:33:20.727754 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:20.727632 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b57d9a_568e_4b0d_9017_4f02b3a832a5.slice/crio-766444cc67726c929bb6bb1b249c87acb373b282480ec097d0ade314a041602b WatchSource:0}: Error finding container 766444cc67726c929bb6bb1b249c87acb373b282480ec097d0ade314a041602b: Status 404 returned error can't find the container with id 766444cc67726c929bb6bb1b249c87acb373b282480ec097d0ade314a041602b Aug 02 09:33:20.727992 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:20.727952 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c29a7d_6149_4136_ac38_82c7f44fb4e1.slice/crio-fdd3c4de0a1ed38e8338b8e8f3452d29faf8059351d6141c514b63e6197c0190 WatchSource:0}: Error finding container fdd3c4de0a1ed38e8338b8e8f3452d29faf8059351d6141c514b63e6197c0190: Status 404 returned error can't find the container with id fdd3c4de0a1ed38e8338b8e8f3452d29faf8059351d6141c514b63e6197c0190 Aug 02 09:33:20.767623 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.767597 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:20.767757 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.767741 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 02 09:33:20.767848 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.767829 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls podName:b992edc6-b2fd-4c99-abae-418014dc3ee2 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:21.767808395 +0000 UTC m=+38.328963694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-bs6pm" (UID: "b992edc6-b2fd-4c99-abae-418014dc3ee2") : secret "cluster-monitoring-operator-tls" not found Aug 02 09:33:20.868460 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.868366 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-7x6tp\" (UID: \"bb3befea-d006-4ddb-a3b0-6ac4b6689fff\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" Aug 02 09:33:20.868614 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.868557 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 02 09:33:20.868670 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:20.868637 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert podName:bb3befea-d006-4ddb-a3b0-6ac4b6689fff nodeName:}" failed. No retries permitted until 2026-08-02 09:33:21.868616182 +0000 UTC m=+38.429771498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-7x6tp" (UID: "bb3befea-d006-4ddb-a3b0-6ac4b6689fff") : secret "networking-console-plugin-cert" not found Aug 02 09:33:20.950582 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.950551 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:20.950717 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.950550 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:20.950801 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.950557 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:20.952708 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.952665 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 02 09:33:20.953234 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.952748 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mbl9n\"" Aug 02 09:33:20.953234 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.952768 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xt8nz\"" Aug 02 09:33:20.953234 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:20.952916 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 02 09:33:21.198664 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.198585 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-n6ngw" event={"ID":"08087080-49ec-4fab-a6f4-07151ca3b16a","Type":"ContainerStarted","Data":"e8b70246b4c6a9cd85f8cc71497311b6bccf04b1406405de34213e02ed0b96c7"} Aug 02 09:33:21.199621 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.199598 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rlxjx" event={"ID":"0d2b40e4-a705-4d10-b565-a220c1d687c1","Type":"ContainerStarted","Data":"c810477a33efa935c32fd48c628e06b477a9f42e052b19617d361e620c842538"} Aug 02 09:33:21.204073 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.204044 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" event={"ID":"64209794-a5d5-4a29-82ef-bc6d8eecec0c","Type":"ContainerStarted","Data":"97957d9c487d432877e74b926588b756b8531502d5008adc25b8addc623df18f"} Aug 02 09:33:21.206822 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.206799 2575 generic.go:356] "Generic (PLEG): container finished" podID="1f4e25cd-d1a3-488f-a108-f358f6ea7c41" containerID="849d034635ebe4710522056bdf568f10e69c5a6a6e28c114d7af85ca599ce881" exitCode=0 Aug 02 09:33:21.206934 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.206889 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t2wd" event={"ID":"1f4e25cd-d1a3-488f-a108-f358f6ea7c41","Type":"ContainerDied","Data":"849d034635ebe4710522056bdf568f10e69c5a6a6e28c114d7af85ca599ce881"} Aug 02 09:33:21.207928 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.207910 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" event={"ID":"33c29a7d-6149-4136-ac38-82c7f44fb4e1","Type":"ContainerStarted","Data":"fdd3c4de0a1ed38e8338b8e8f3452d29faf8059351d6141c514b63e6197c0190"} Aug 02 09:33:21.209134 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.209106 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" event={"ID":"70b57d9a-568e-4b0d-9017-4f02b3a832a5","Type":"ContainerStarted","Data":"766444cc67726c929bb6bb1b249c87acb373b282480ec097d0ade314a041602b"} Aug 02 09:33:21.210504 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.210476 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jgcm2" event={"ID":"981e1336-3fb3-4b90-87a1-94f963b6099b","Type":"ContainerStarted","Data":"1385c33ee1a62c2b54cc246cfc6f4dd1ce639b0d65b5a0f18ddc9132ee2f899f"} Aug 02 09:33:21.211988 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.211964 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-mkpqg" event={"ID":"87c64fe1-ab49-4ec4-84a5-07698b9f1070","Type":"ContainerStarted","Data":"e2e68b375ace3d957bcaf857f78f1efd855658e7e3c2c45067dacbdaa09a9afb"} Aug 02 09:33:21.675037 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.674699 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:21.675195 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.675076 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:21.675195 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.675123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:21.675310 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.675221 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:21.675310 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.675264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-7tgvl\" (UID: \"32ba520c-f409-4571-8260-1c321bbf4702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" Aug 02 09:33:21.675417 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:21.675399 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 02 09:33:21.675467 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:21.675460 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls podName:32ba520c-f409-4571-8260-1c321bbf4702 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:23.675441623 +0000 UTC m=+40.236596923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-7tgvl" (UID: "32ba520c-f409-4571-8260-1c321bbf4702") : secret "samples-operator-tls" not found Aug 02 09:33:21.676371 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:21.676183 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 09:33:21.676371 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:21.676228 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle podName:a2ee01dc-14aa-4625-8584-22a4d7c70dae nodeName:}" failed. No retries permitted until 2026-08-02 09:33:23.676207901 +0000 UTC m=+40.237363203 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle") pod "router-default-68bf45c684-8lbrw" (UID: "a2ee01dc-14aa-4625-8584-22a4d7c70dae") : configmap references non-existent config key: service-ca.crt Aug 02 09:33:21.676371 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:21.676258 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls podName:ed13e3aa-46af-43a9-8f01-3d84befb4b9a nodeName:}" failed. No retries permitted until 2026-08-02 09:33:23.676246392 +0000 UTC m=+40.237401695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls") pod "dns-default-7wlgl" (UID: "ed13e3aa-46af-43a9-8f01-3d84befb4b9a") : secret "dns-default-metrics-tls" not found Aug 02 09:33:21.676371 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:21.676277 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 09:33:21.676371 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:21.676288 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bccbf69c5-tv8vq: secret "image-registry-tls" not found Aug 02 09:33:21.676371 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:21.676326 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls podName:a9e6d019-2275-43d8-850b-f0ac2c4d805e nodeName:}" failed. No retries permitted until 2026-08-02 09:33:23.676307855 +0000 UTC m=+40.237463176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls") pod "image-registry-5bccbf69c5-tv8vq" (UID: "a9e6d019-2275-43d8-850b-f0ac2c4d805e") : secret "image-registry-tls" not found Aug 02 09:33:21.676371 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:21.676332 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 02 09:33:21.676371 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:21.676366 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs podName:a2ee01dc-14aa-4625-8584-22a4d7c70dae nodeName:}" failed. No retries permitted until 2026-08-02 09:33:23.676356232 +0000 UTC m=+40.237511533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs") pod "router-default-68bf45c684-8lbrw" (UID: "a2ee01dc-14aa-4625-8584-22a4d7c70dae") : secret "router-metrics-certs-default" not found Aug 02 09:33:21.776549 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.776512 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:21.776848 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:21.776769 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 02 09:33:21.776941 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:21.776906 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls podName:b992edc6-b2fd-4c99-abae-418014dc3ee2 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:23.776885048 +0000 UTC m=+40.338040393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-bs6pm" (UID: "b992edc6-b2fd-4c99-abae-418014dc3ee2") : secret "cluster-monitoring-operator-tls" not found Aug 02 09:33:21.877986 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:21.877915 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-7x6tp\" (UID: \"bb3befea-d006-4ddb-a3b0-6ac4b6689fff\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" Aug 02 09:33:21.878177 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:21.878098 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 02 09:33:21.878177 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:21.878160 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert podName:bb3befea-d006-4ddb-a3b0-6ac4b6689fff nodeName:}" failed. No retries permitted until 2026-08-02 09:33:23.878141181 +0000 UTC m=+40.439296482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-7x6tp" (UID: "bb3befea-d006-4ddb-a3b0-6ac4b6689fff") : secret "networking-console-plugin-cert" not found Aug 02 09:33:22.222257 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:22.222223 2575 generic.go:356] "Generic (PLEG): container finished" podID="1f4e25cd-d1a3-488f-a108-f358f6ea7c41" containerID="cc4b5b9cd37ecd1e2d89dfdb956d4becf1e7d2ba0cf31f8102a960a1c418d595" exitCode=0 Aug 02 09:33:22.222712 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:22.222310 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t2wd" event={"ID":"1f4e25cd-d1a3-488f-a108-f358f6ea7c41","Type":"ContainerDied","Data":"cc4b5b9cd37ecd1e2d89dfdb956d4becf1e7d2ba0cf31f8102a960a1c418d595"} Aug 02 09:33:23.230568 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:23.230497 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6t2wd" event={"ID":"1f4e25cd-d1a3-488f-a108-f358f6ea7c41","Type":"ContainerStarted","Data":"a8fe49151c35dd98a681b5e609b282cae3a5bb88aabf268208a2d78d4c7bf031"} Aug 02 09:33:23.251869 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:23.251808 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6t2wd" podStartSLOduration=6.745118269 podStartE2EDuration="39.251785942s" totalImagesPullingTime="32.506667673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 09:32:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:23.250124038 +0000 UTC m=+39.811279363" watchObservedRunningTime="2026-08-02 09:33:23.251785942 +0000 UTC m=+39.812941254" Aug 02 09:33:23.698547 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:23.698476 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:23.698547 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:23.698548 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:23.698732 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:23.698576 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-7tgvl\" (UID: \"32ba520c-f409-4571-8260-1c321bbf4702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" Aug 02 09:33:23.698732 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:23.698650 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 02 09:33:23.698732 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:23.698656 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 09:33:23.698732 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:23.698676 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 02 09:33:23.698732 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:23.698701 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls podName:32ba520c-f409-4571-8260-1c321bbf4702 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:27.69868492 +0000 UTC m=+44.259840218 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-7tgvl" (UID: "32ba520c-f409-4571-8260-1c321bbf4702") : secret "samples-operator-tls" not found Aug 02 09:33:23.698732 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:23.698728 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls podName:ed13e3aa-46af-43a9-8f01-3d84befb4b9a nodeName:}" failed. No retries permitted until 2026-08-02 09:33:27.698707404 +0000 UTC m=+44.259862720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls") pod "dns-default-7wlgl" (UID: "ed13e3aa-46af-43a9-8f01-3d84befb4b9a") : secret "dns-default-metrics-tls" not found Aug 02 09:33:23.699006 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:23.698751 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:23.699006 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:23.698852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:23.699006 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:23.698865 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle podName:a2ee01dc-14aa-4625-8584-22a4d7c70dae nodeName:}" failed. No retries permitted until 2026-08-02 09:33:27.698853245 +0000 UTC m=+44.260008544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle") pod "router-default-68bf45c684-8lbrw" (UID: "a2ee01dc-14aa-4625-8584-22a4d7c70dae") : configmap references non-existent config key: service-ca.crt Aug 02 09:33:23.699006 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:23.698918 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 09:33:23.699006 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:23.698930 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs podName:a2ee01dc-14aa-4625-8584-22a4d7c70dae nodeName:}" failed. No retries permitted until 2026-08-02 09:33:27.698919967 +0000 UTC m=+44.260075266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs") pod "router-default-68bf45c684-8lbrw" (UID: "a2ee01dc-14aa-4625-8584-22a4d7c70dae") : secret "router-metrics-certs-default" not found Aug 02 09:33:23.699006 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:23.698931 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bccbf69c5-tv8vq: secret "image-registry-tls" not found Aug 02 09:33:23.699006 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:23.698999 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls podName:a9e6d019-2275-43d8-850b-f0ac2c4d805e nodeName:}" failed. No retries permitted until 2026-08-02 09:33:27.698989556 +0000 UTC m=+44.260144854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls") pod "image-registry-5bccbf69c5-tv8vq" (UID: "a9e6d019-2275-43d8-850b-f0ac2c4d805e") : secret "image-registry-tls" not found Aug 02 09:33:23.800362 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:23.800327 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:23.800541 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:23.800517 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 02 09:33:23.800619 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:23.800606 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls podName:b992edc6-b2fd-4c99-abae-418014dc3ee2 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:27.800583384 +0000 UTC m=+44.361738699 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-bs6pm" (UID: "b992edc6-b2fd-4c99-abae-418014dc3ee2") : secret "cluster-monitoring-operator-tls" not found Aug 02 09:33:23.900721 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:23.900689 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-7x6tp\" (UID: \"bb3befea-d006-4ddb-a3b0-6ac4b6689fff\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" Aug 02 09:33:23.900912 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:23.900877 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 02 09:33:23.900988 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:23.900970 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert podName:bb3befea-d006-4ddb-a3b0-6ac4b6689fff nodeName:}" failed. No retries permitted until 2026-08-02 09:33:27.900949007 +0000 UTC m=+44.462104325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-7x6tp" (UID: "bb3befea-d006-4ddb-a3b0-6ac4b6689fff") : secret "networking-console-plugin-cert" not found Aug 02 09:33:27.730891 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:27.730848 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:27.731557 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:27.730909 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:27.731557 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:27.730966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:27.731557 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:27.730989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-7tgvl\" (UID: \"32ba520c-f409-4571-8260-1c321bbf4702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" Aug 02 09:33:27.731557 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:27.731022 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:27.731557 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:27.731029 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 09:33:27.731557 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:27.731050 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bccbf69c5-tv8vq: secret "image-registry-tls" not found Aug 02 09:33:27.731557 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:27.731085 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 09:33:27.731557 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:27.731103 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 02 09:33:27.731557 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:27.731113 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls podName:a9e6d019-2275-43d8-850b-f0ac2c4d805e nodeName:}" failed. No retries permitted until 2026-08-02 09:33:35.731091506 +0000 UTC m=+52.292246822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls") pod "image-registry-5bccbf69c5-tv8vq" (UID: "a9e6d019-2275-43d8-850b-f0ac2c4d805e") : secret "image-registry-tls" not found Aug 02 09:33:27.731557 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:27.731131 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 02 09:33:27.731557 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:27.731138 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls podName:ed13e3aa-46af-43a9-8f01-3d84befb4b9a nodeName:}" failed. No retries permitted until 2026-08-02 09:33:35.73112189 +0000 UTC m=+52.292277194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls") pod "dns-default-7wlgl" (UID: "ed13e3aa-46af-43a9-8f01-3d84befb4b9a") : secret "dns-default-metrics-tls" not found Aug 02 09:33:27.731557 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:27.731202 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle podName:a2ee01dc-14aa-4625-8584-22a4d7c70dae nodeName:}" failed. No retries permitted until 2026-08-02 09:33:35.731186546 +0000 UTC m=+52.292341848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle") pod "router-default-68bf45c684-8lbrw" (UID: "a2ee01dc-14aa-4625-8584-22a4d7c70dae") : configmap references non-existent config key: service-ca.crt Aug 02 09:33:27.731557 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:27.731219 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs podName:a2ee01dc-14aa-4625-8584-22a4d7c70dae nodeName:}" failed. No retries permitted until 2026-08-02 09:33:35.731208522 +0000 UTC m=+52.292363826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs") pod "router-default-68bf45c684-8lbrw" (UID: "a2ee01dc-14aa-4625-8584-22a4d7c70dae") : secret "router-metrics-certs-default" not found Aug 02 09:33:27.731557 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:27.731232 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls podName:32ba520c-f409-4571-8260-1c321bbf4702 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:35.7312243 +0000 UTC m=+52.292379603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-7tgvl" (UID: "32ba520c-f409-4571-8260-1c321bbf4702") : secret "samples-operator-tls" not found Aug 02 09:33:27.832321 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:27.832280 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:27.832487 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:27.832438 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 02 09:33:27.832542 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:27.832520 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls podName:b992edc6-b2fd-4c99-abae-418014dc3ee2 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:35.832498202 +0000 UTC m=+52.393653500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-bs6pm" (UID: "b992edc6-b2fd-4c99-abae-418014dc3ee2") : secret "cluster-monitoring-operator-tls" not found Aug 02 09:33:27.934333 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:27.934238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-7x6tp\" (UID: \"bb3befea-d006-4ddb-a3b0-6ac4b6689fff\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" Aug 02 09:33:27.934802 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:27.934563 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 02 09:33:27.934802 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:27.934639 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert podName:bb3befea-d006-4ddb-a3b0-6ac4b6689fff nodeName:}" failed. No retries permitted until 2026-08-02 09:33:35.934613201 +0000 UTC m=+52.495768514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-7x6tp" (UID: "bb3befea-d006-4ddb-a3b0-6ac4b6689fff") : secret "networking-console-plugin-cert" not found Aug 02 09:33:29.247808 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.247755 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jgcm2" event={"ID":"981e1336-3fb3-4b90-87a1-94f963b6099b","Type":"ContainerStarted","Data":"db13a07f0f8a2378e044f55d4e2479201df0bb8a000ff65933ca2c391b83f30a"} Aug 02 09:33:29.249349 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.249297 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-mkpqg" event={"ID":"87c64fe1-ab49-4ec4-84a5-07698b9f1070","Type":"ContainerStarted","Data":"4ddce06231f33b50e2dc51e3d8fe2f99ca0a156f6f629befdecdd650eb20eb1c"} Aug 02 09:33:29.250873 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.250840 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-n6ngw" event={"ID":"08087080-49ec-4fab-a6f4-07151ca3b16a","Type":"ContainerStarted","Data":"85592f1e2f726d3d066b622d5a0b5409eb51edaa158e96f0829dafe7f1445afc"} Aug 02 09:33:29.252396 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.252370 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rlxjx" event={"ID":"0d2b40e4-a705-4d10-b565-a220c1d687c1","Type":"ContainerStarted","Data":"08f4f5a970a36f15ee99590b55f29fe3bd36c0334fa3a373f51131ccc6db80eb"} Aug 02 09:33:29.254277 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.254250 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" event={"ID":"64209794-a5d5-4a29-82ef-bc6d8eecec0c","Type":"ContainerStarted","Data":"9a8fde2d83e3852e573359b557c7abef2b11f96a6a70d7e6279794b99047e9ea"} Aug 02 09:33:29.255811 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.255792 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/0.log" Aug 02 09:33:29.255909 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.255828 2575 generic.go:356] "Generic (PLEG): container finished" podID="33c29a7d-6149-4136-ac38-82c7f44fb4e1" containerID="2cb45c98fd31bc8817ac89667d4d179bde606382c05bf9716ad32930ab63b872" exitCode=255 Aug 02 09:33:29.255972 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.255916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" event={"ID":"33c29a7d-6149-4136-ac38-82c7f44fb4e1","Type":"ContainerDied","Data":"2cb45c98fd31bc8817ac89667d4d179bde606382c05bf9716ad32930ab63b872"} Aug 02 09:33:29.256070 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.256054 2575 scope.go:117] "RemoveContainer" containerID="2cb45c98fd31bc8817ac89667d4d179bde606382c05bf9716ad32930ab63b872" Aug 02 09:33:29.257490 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.257467 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" event={"ID":"70b57d9a-568e-4b0d-9017-4f02b3a832a5","Type":"ContainerStarted","Data":"6cead29128c8d8c666cd96dbe3f191d993832d0735245514a6ba28911a092282"} Aug 02 09:33:29.285711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.285657 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jgcm2" podStartSLOduration=2.403530826 podStartE2EDuration="10.285637744s" totalImagesPullingTime="7.882106918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:29.268559617 +0000 UTC m=+45.829714937" watchObservedRunningTime="2026-08-02 09:33:29.285637744 +0000 UTC m=+45.846793065" Aug 02 09:33:29.305001 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.304952 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-mkpqg" podStartSLOduration=7.587518762 podStartE2EDuration="15.304934003s" totalImagesPullingTime="7.717415241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:29.286252739 +0000 UTC m=+45.847408061" watchObservedRunningTime="2026-08-02 09:33:29.304934003 +0000 UTC m=+45.866089325" Aug 02 09:33:29.305149 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.305114 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" podStartSLOduration=7.451338444 podStartE2EDuration="15.305105941s" totalImagesPullingTime="7.853767497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:29.304507029 +0000 UTC m=+45.865662353" watchObservedRunningTime="2026-08-02 09:33:29.305105941 +0000 UTC m=+45.866261242" Aug 02 09:33:29.338498 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.338194 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-n6ngw" podStartSLOduration=7.473451487 podStartE2EDuration="15.338174511s" totalImagesPullingTime="7.864723024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:29.322270891 +0000 UTC m=+45.883426214" watchObservedRunningTime="2026-08-02 09:33:29.338174511 +0000 UTC m=+45.899329828" Aug 02 09:33:29.365431 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.365261 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-rlxjx" podStartSLOduration=7.512820977 podStartE2EDuration="15.365241489s" totalImagesPullingTime="7.852420512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:29.365202936 +0000 UTC m=+45.926358256" watchObservedRunningTime="2026-08-02 09:33:29.365241489 +0000 UTC m=+45.926396806" Aug 02 09:33:29.374838 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.368397 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" podStartSLOduration=7.517295631 podStartE2EDuration="15.368377075s" totalImagesPullingTime="7.851081444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:29.339346514 +0000 UTC m=+45.900501835" watchObservedRunningTime="2026-08-02 09:33:29.368377075 +0000 UTC m=+45.929532402" Aug 02 09:33:29.790881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.790848 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8zfrl"] Aug 02 09:33:29.824013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.823982 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8zfrl"] Aug 02 09:33:29.824160 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.824082 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:29.826053 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.826034 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 02 09:33:29.826236 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.826212 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-49fv9\"" Aug 02 09:33:29.826350 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.826317 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 02 09:33:29.850845 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.850813 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:29.850951 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.850886 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/35bc561b-930b-4ed9-b2e8-55c13e48f507-data-volume\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:29.850951 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.850916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/35bc561b-930b-4ed9-b2e8-55c13e48f507-crio-socket\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:29.851075 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.850989 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:29.851075 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.851019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phs89\" (UniqueName: \"kubernetes.io/projected/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-api-access-phs89\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:29.951976 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.951940 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:29.951976 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.951978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phs89\" (UniqueName: \"kubernetes.io/projected/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-api-access-phs89\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:29.952224 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:29.952110 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 02 09:33:29.952224 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:29.952182 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls podName:35bc561b-930b-4ed9-b2e8-55c13e48f507 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:30.452159438 +0000 UTC m=+47.013314757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8zfrl" (UID: "35bc561b-930b-4ed9-b2e8-55c13e48f507") : secret "insights-runtime-extractor-tls" not found Aug 02 09:33:29.952224 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.952206 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:29.952386 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.952288 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/35bc561b-930b-4ed9-b2e8-55c13e48f507-data-volume\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:29.952386 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.952322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/35bc561b-930b-4ed9-b2e8-55c13e48f507-crio-socket\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:29.952386 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:29.952323 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 02 09:33:29.952386 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:29.952380 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm podName:35bc561b-930b-4ed9-b2e8-55c13e48f507 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:30.452364438 +0000 UTC m=+47.013519761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8zfrl" (UID: "35bc561b-930b-4ed9-b2e8-55c13e48f507") : configmap "kube-rbac-proxy" not found Aug 02 09:33:29.952562 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.952522 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/35bc561b-930b-4ed9-b2e8-55c13e48f507-crio-socket\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:29.952720 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.952700 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/35bc561b-930b-4ed9-b2e8-55c13e48f507-data-volume\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:29.961144 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:29.961122 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phs89\" (UniqueName: \"kubernetes.io/projected/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-api-access-phs89\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:30.262402 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.262328 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/1.log" Aug 02 09:33:30.262836 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.262813 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/0.log" Aug 02 09:33:30.262918 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.262853 2575 generic.go:356] "Generic (PLEG): container finished" podID="33c29a7d-6149-4136-ac38-82c7f44fb4e1" containerID="39cfe2bde81e92ffe6121aaae21eddbadbc030e64fd1b443a6f20c21c80697f9" exitCode=255 Aug 02 09:33:30.262969 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.262949 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" event={"ID":"33c29a7d-6149-4136-ac38-82c7f44fb4e1","Type":"ContainerDied","Data":"39cfe2bde81e92ffe6121aaae21eddbadbc030e64fd1b443a6f20c21c80697f9"} Aug 02 09:33:30.263040 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.263026 2575 scope.go:117] "RemoveContainer" containerID="2cb45c98fd31bc8817ac89667d4d179bde606382c05bf9716ad32930ab63b872" Aug 02 09:33:30.263227 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.263200 2575 scope.go:117] "RemoveContainer" containerID="39cfe2bde81e92ffe6121aaae21eddbadbc030e64fd1b443a6f20c21c80697f9" Aug 02 09:33:30.263413 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:30.263387 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-7rm2v_openshift-console-operator(33c29a7d-6149-4136-ac38-82c7f44fb4e1)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" podUID="33c29a7d-6149-4136-ac38-82c7f44fb4e1" Aug 02 09:33:30.337907 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.337884 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:30.338049 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.337931 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:30.402097 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.402066 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-z4qw4"] Aug 02 09:33:30.436076 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.436041 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-z4qw4"] Aug 02 09:33:30.436234 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.436164 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-z4qw4" Aug 02 09:33:30.438342 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.438317 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nwffz\"" Aug 02 09:33:30.438342 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.438331 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Aug 02 09:33:30.438531 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.438443 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Aug 02 09:33:30.456967 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.456943 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:30.457090 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:30.457061 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 02 09:33:30.457151 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.457107 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:30.457151 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:30.457131 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm podName:35bc561b-930b-4ed9-b2e8-55c13e48f507 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:31.457109346 +0000 UTC m=+48.018264643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8zfrl" (UID: "35bc561b-930b-4ed9-b2e8-55c13e48f507") : configmap "kube-rbac-proxy" not found Aug 02 09:33:30.457262 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:30.457176 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 02 09:33:30.457262 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.457200 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5nhn\" (UniqueName: \"kubernetes.io/projected/fa55447b-4fc2-449e-bb96-ee0242bbef1e-kube-api-access-p5nhn\") pod \"migrator-68bc745d87-z4qw4\" (UID: \"fa55447b-4fc2-449e-bb96-ee0242bbef1e\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-z4qw4" Aug 02 09:33:30.457262 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:30.457218 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls podName:35bc561b-930b-4ed9-b2e8-55c13e48f507 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:31.457206901 +0000 UTC m=+48.018362214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8zfrl" (UID: "35bc561b-930b-4ed9-b2e8-55c13e48f507") : secret "insights-runtime-extractor-tls" not found Aug 02 09:33:30.558346 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.558310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5nhn\" (UniqueName: \"kubernetes.io/projected/fa55447b-4fc2-449e-bb96-ee0242bbef1e-kube-api-access-p5nhn\") pod \"migrator-68bc745d87-z4qw4\" (UID: \"fa55447b-4fc2-449e-bb96-ee0242bbef1e\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-z4qw4" Aug 02 09:33:30.566204 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.566173 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5nhn\" (UniqueName: \"kubernetes.io/projected/fa55447b-4fc2-449e-bb96-ee0242bbef1e-kube-api-access-p5nhn\") pod \"migrator-68bc745d87-z4qw4\" (UID: \"fa55447b-4fc2-449e-bb96-ee0242bbef1e\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-z4qw4" Aug 02 09:33:30.746021 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.745993 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-z4qw4" Aug 02 09:33:30.752145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.752124 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2rnlq_0a3a2b26-2590-4283-bc30-bff9b47feeb6/dns-node-resolver/0.log" Aug 02 09:33:30.876683 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:30.876657 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-z4qw4"] Aug 02 09:33:30.879592 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:30.879567 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa55447b_4fc2_449e_bb96_ee0242bbef1e.slice/crio-cc0e08e5f258e4c0319b651bbcfca9cf501fe62ffb4139e810cfcc835694ccf8 WatchSource:0}: Error finding container cc0e08e5f258e4c0319b651bbcfca9cf501fe62ffb4139e810cfcc835694ccf8: Status 404 returned error can't find the container with id cc0e08e5f258e4c0319b651bbcfca9cf501fe62ffb4139e810cfcc835694ccf8 Aug 02 09:33:31.266498 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:31.266420 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-z4qw4" event={"ID":"fa55447b-4fc2-449e-bb96-ee0242bbef1e","Type":"ContainerStarted","Data":"cc0e08e5f258e4c0319b651bbcfca9cf501fe62ffb4139e810cfcc835694ccf8"} Aug 02 09:33:31.267829 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:31.267810 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/1.log" Aug 02 09:33:31.268158 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:31.268143 2575 scope.go:117] "RemoveContainer" containerID="39cfe2bde81e92ffe6121aaae21eddbadbc030e64fd1b443a6f20c21c80697f9" Aug 02 09:33:31.268292 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:31.268275 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-7rm2v_openshift-console-operator(33c29a7d-6149-4136-ac38-82c7f44fb4e1)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" podUID="33c29a7d-6149-4136-ac38-82c7f44fb4e1" Aug 02 09:33:31.467007 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:31.466965 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:31.467192 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:31.467086 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:31.467192 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:31.467115 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 02 09:33:31.467192 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:31.467179 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls podName:35bc561b-930b-4ed9-b2e8-55c13e48f507 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:33.467163689 +0000 UTC m=+50.028318987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8zfrl" (UID: "35bc561b-930b-4ed9-b2e8-55c13e48f507") : secret "insights-runtime-extractor-tls" not found Aug 02 09:33:31.467329 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:31.467193 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 02 09:33:31.467329 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:31.467241 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm podName:35bc561b-930b-4ed9-b2e8-55c13e48f507 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:33.467228719 +0000 UTC m=+50.028384017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8zfrl" (UID: "35bc561b-930b-4ed9-b2e8-55c13e48f507") : configmap "kube-rbac-proxy" not found Aug 02 09:33:31.747692 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:31.747663 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8cg55_a559e669-33cb-46af-b05a-24b0a9cd6b12/node-ca/0.log" Aug 02 09:33:32.271235 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:32.271208 2575 scope.go:117] "RemoveContainer" containerID="39cfe2bde81e92ffe6121aaae21eddbadbc030e64fd1b443a6f20c21c80697f9" Aug 02 09:33:32.271615 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:32.271396 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-7rm2v_openshift-console-operator(33c29a7d-6149-4136-ac38-82c7f44fb4e1)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" podUID="33c29a7d-6149-4136-ac38-82c7f44fb4e1" Aug 02 09:33:32.547316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:32.547297 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jgcm2_981e1336-3fb3-4b90-87a1-94f963b6099b/serve-healthcheck-canary/0.log" Aug 02 09:33:33.276103 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:33.276068 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-z4qw4" event={"ID":"fa55447b-4fc2-449e-bb96-ee0242bbef1e","Type":"ContainerStarted","Data":"3dc0f5785704f6a2f01fe70d9d2d133c7c127538ed1008832ee8e3256efb6608"} Aug 02 09:33:33.276506 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:33.276117 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-z4qw4" event={"ID":"fa55447b-4fc2-449e-bb96-ee0242bbef1e","Type":"ContainerStarted","Data":"8c6729e2e2e724a619b9e13463144ff7b550a587ddf976e49214edd90e6567f3"} Aug 02 09:33:33.292429 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:33.292380 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-z4qw4" podStartSLOduration=1.676997975 podStartE2EDuration="3.292364s" totalImagesPullingTime="1.615366025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:33:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:33.291058935 +0000 UTC m=+49.852214256" watchObservedRunningTime="2026-08-02 09:33:33.292364 +0000 UTC m=+49.853519360" Aug 02 09:33:33.483356 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:33.483319 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:33.483497 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:33.483475 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 02 09:33:33.483558 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:33.483533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:33.483558 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:33.483549 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls podName:35bc561b-930b-4ed9-b2e8-55c13e48f507 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:37.483529625 +0000 UTC m=+54.044684922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8zfrl" (UID: "35bc561b-930b-4ed9-b2e8-55c13e48f507") : secret "insights-runtime-extractor-tls" not found Aug 02 09:33:33.483646 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:33.483586 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 02 09:33:33.483646 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:33.483621 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm podName:35bc561b-930b-4ed9-b2e8-55c13e48f507 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:37.483613006 +0000 UTC m=+54.044768307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8zfrl" (UID: "35bc561b-930b-4ed9-b2e8-55c13e48f507") : configmap "kube-rbac-proxy" not found Aug 02 09:33:35.804639 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:35.804602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:35.805135 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:35.804652 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-7tgvl\" (UID: \"32ba520c-f409-4571-8260-1c321bbf4702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" Aug 02 09:33:35.805135 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:35.804678 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:35.805135 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:35.804814 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle podName:a2ee01dc-14aa-4625-8584-22a4d7c70dae nodeName:}" failed. No retries permitted until 2026-08-02 09:33:51.804799436 +0000 UTC m=+68.365954734 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle") pod "router-default-68bf45c684-8lbrw" (UID: "a2ee01dc-14aa-4625-8584-22a4d7c70dae") : configmap references non-existent config key: service-ca.crt Aug 02 09:33:35.805135 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:35.804841 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 02 09:33:35.805135 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:35.804869 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:35.805135 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:35.804926 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls podName:32ba520c-f409-4571-8260-1c321bbf4702 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:51.804901172 +0000 UTC m=+68.366056569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-7tgvl" (UID: "32ba520c-f409-4571-8260-1c321bbf4702") : secret "samples-operator-tls" not found Aug 02 09:33:35.805135 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:35.804960 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:35.805135 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:35.804956 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 02 09:33:35.805135 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:35.805030 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 09:33:35.805135 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:35.805042 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bccbf69c5-tv8vq: secret "image-registry-tls" not found Aug 02 09:33:35.805135 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:35.805049 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs podName:a2ee01dc-14aa-4625-8584-22a4d7c70dae nodeName:}" failed. No retries permitted until 2026-08-02 09:33:51.805018158 +0000 UTC m=+68.366173466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs") pod "router-default-68bf45c684-8lbrw" (UID: "a2ee01dc-14aa-4625-8584-22a4d7c70dae") : secret "router-metrics-certs-default" not found Aug 02 09:33:35.805135 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:35.805084 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls podName:a9e6d019-2275-43d8-850b-f0ac2c4d805e nodeName:}" failed. No retries permitted until 2026-08-02 09:33:51.805076337 +0000 UTC m=+68.366231635 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls") pod "image-registry-5bccbf69c5-tv8vq" (UID: "a9e6d019-2275-43d8-850b-f0ac2c4d805e") : secret "image-registry-tls" not found Aug 02 09:33:35.805135 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:35.805106 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 09:33:35.805135 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:35.805144 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls podName:ed13e3aa-46af-43a9-8f01-3d84befb4b9a nodeName:}" failed. No retries permitted until 2026-08-02 09:33:51.805132512 +0000 UTC m=+68.366287809 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls") pod "dns-default-7wlgl" (UID: "ed13e3aa-46af-43a9-8f01-3d84befb4b9a") : secret "dns-default-metrics-tls" not found Aug 02 09:33:35.906443 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:35.906406 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:35.906610 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:35.906564 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 02 09:33:35.907085 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:35.906636 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls podName:b992edc6-b2fd-4c99-abae-418014dc3ee2 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:51.906618137 +0000 UTC m=+68.467773451 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-bs6pm" (UID: "b992edc6-b2fd-4c99-abae-418014dc3ee2") : secret "cluster-monitoring-operator-tls" not found Aug 02 09:33:36.007886 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:36.007842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-7x6tp\" (UID: \"bb3befea-d006-4ddb-a3b0-6ac4b6689fff\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" Aug 02 09:33:36.008034 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:36.008000 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 02 09:33:36.008078 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:36.008067 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert podName:bb3befea-d006-4ddb-a3b0-6ac4b6689fff nodeName:}" failed. No retries permitted until 2026-08-02 09:33:52.008051685 +0000 UTC m=+68.569206984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-7x6tp" (UID: "bb3befea-d006-4ddb-a3b0-6ac4b6689fff") : secret "networking-console-plugin-cert" not found Aug 02 09:33:37.520154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:37.520114 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:37.520614 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:37.520356 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:37.520614 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:37.520479 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 02 09:33:37.520614 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:37.520534 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls podName:35bc561b-930b-4ed9-b2e8-55c13e48f507 nodeName:}" failed. No retries permitted until 2026-08-02 09:33:45.520522254 +0000 UTC m=+62.081677552 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8zfrl" (UID: "35bc561b-930b-4ed9-b2e8-55c13e48f507") : secret "insights-runtime-extractor-tls" not found Aug 02 09:33:37.520614 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:37.520608 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/35bc561b-930b-4ed9-b2e8-55c13e48f507-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:45.590047 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:45.590011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:45.592407 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:45.592382 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/35bc561b-930b-4ed9-b2e8-55c13e48f507-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zfrl\" (UID: \"35bc561b-930b-4ed9-b2e8-55c13e48f507\") " pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:45.737557 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:45.737529 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-49fv9\"" Aug 02 09:33:45.746148 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:45.746126 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8zfrl" Aug 02 09:33:45.866414 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:45.866393 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8zfrl"] Aug 02 09:33:45.868647 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:45.868609 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35bc561b_930b_4ed9_b2e8_55c13e48f507.slice/crio-d4ad8fb03286441959d20f79c898dc9d741adc82c58356484bbd0e76a31319fd WatchSource:0}: Error finding container d4ad8fb03286441959d20f79c898dc9d741adc82c58356484bbd0e76a31319fd: Status 404 returned error can't find the container with id d4ad8fb03286441959d20f79c898dc9d741adc82c58356484bbd0e76a31319fd Aug 02 09:33:45.950959 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:45.950939 2575 scope.go:117] "RemoveContainer" containerID="39cfe2bde81e92ffe6121aaae21eddbadbc030e64fd1b443a6f20c21c80697f9" Aug 02 09:33:46.197388 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:46.197312 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsbjf" Aug 02 09:33:46.317445 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:46.317412 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8zfrl" event={"ID":"35bc561b-930b-4ed9-b2e8-55c13e48f507","Type":"ContainerStarted","Data":"c338a0f466f417b3e8b310b68a6ea457fbec076a4f1cd3d1e55c001f4e32e118"} Aug 02 09:33:46.317642 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:46.317465 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8zfrl" event={"ID":"35bc561b-930b-4ed9-b2e8-55c13e48f507","Type":"ContainerStarted","Data":"d4ad8fb03286441959d20f79c898dc9d741adc82c58356484bbd0e76a31319fd"} Aug 02 09:33:46.318890 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:46.318870 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 09:33:46.319309 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:46.319293 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/1.log" Aug 02 09:33:46.319381 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:46.319324 2575 generic.go:356] "Generic (PLEG): container finished" podID="33c29a7d-6149-4136-ac38-82c7f44fb4e1" containerID="1adba9caf6bd1ba760d10d165e5137fff170fe9b98b789d8072cbcfc7f7bfbd3" exitCode=255 Aug 02 09:33:46.319381 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:46.319351 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" event={"ID":"33c29a7d-6149-4136-ac38-82c7f44fb4e1","Type":"ContainerDied","Data":"1adba9caf6bd1ba760d10d165e5137fff170fe9b98b789d8072cbcfc7f7bfbd3"} Aug 02 09:33:46.319488 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:46.319386 2575 scope.go:117] "RemoveContainer" containerID="39cfe2bde81e92ffe6121aaae21eddbadbc030e64fd1b443a6f20c21c80697f9" Aug 02 09:33:46.319676 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:46.319661 2575 scope.go:117] "RemoveContainer" containerID="1adba9caf6bd1ba760d10d165e5137fff170fe9b98b789d8072cbcfc7f7bfbd3" Aug 02 09:33:46.319869 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:46.319851 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-7rm2v_openshift-console-operator(33c29a7d-6149-4136-ac38-82c7f44fb4e1)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" podUID="33c29a7d-6149-4136-ac38-82c7f44fb4e1" Aug 02 09:33:47.325480 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:47.325440 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8zfrl" event={"ID":"35bc561b-930b-4ed9-b2e8-55c13e48f507","Type":"ContainerStarted","Data":"2cbf4076542e2debc15b6da09a4d6946c567a9e421ba15219bc0cc80b61710b2"} Aug 02 09:33:47.331108 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:47.331084 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 09:33:48.336336 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.336301 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8zfrl" event={"ID":"35bc561b-930b-4ed9-b2e8-55c13e48f507","Type":"ContainerStarted","Data":"73a952fb3e35205c2c3cc548012df3397cbce01fa90e0546b39d8067157f1a62"} Aug 02 09:33:48.355621 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.355565 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8zfrl" podStartSLOduration=17.160945975 podStartE2EDuration="19.355547953s" totalImagesPullingTime="2.194601978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 09:33:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:48.353657948 +0000 UTC m=+64.914813269" watchObservedRunningTime="2026-08-02 09:33:48.355547953 +0000 UTC m=+64.916703273" Aug 02 09:33:48.819665 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.819622 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c28bq\" (UniqueName: \"kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq\") pod \"network-check-target-8zj85\" (UID: \"45ab025b-b154-44d0-bc68-87769a1b3bf6\") " pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:48.819877 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.819673 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs\") pod \"network-metrics-daemon-g8skl\" (UID: \"672e5316-3afa-43ab-a9e5-672d12a1c26e\") " pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:48.819877 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.819761 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:48.822118 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.822096 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 02 09:33:48.822207 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.822096 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 02 09:33:48.822456 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.822433 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c28bq\" (UniqueName: \"kubernetes.io/projected/45ab025b-b154-44d0-bc68-87769a1b3bf6-kube-api-access-c28bq\") pod \"network-check-target-8zj85\" (UID: \"45ab025b-b154-44d0-bc68-87769a1b3bf6\") " pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:48.832103 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.832080 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ead495a-945d-4c39-954e-98e47d4976cf-original-pull-secret\") pod \"global-pull-secret-syncer-cfz4x\" (UID: \"5ead495a-945d-4c39-954e-98e47d4976cf\") " pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:48.832255 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.832239 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672e5316-3afa-43ab-a9e5-672d12a1c26e-metrics-certs\") pod \"network-metrics-daemon-g8skl\" (UID: \"672e5316-3afa-43ab-a9e5-672d12a1c26e\") " pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:48.862278 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.862251 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mbl9n\"" Aug 02 09:33:48.867733 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.867714 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xt8nz\"" Aug 02 09:33:48.870276 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.870263 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfz4x" Aug 02 09:33:48.871324 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.871308 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:48.876211 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:48.876195 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8skl" Aug 02 09:33:49.014245 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:49.014150 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cfz4x"] Aug 02 09:33:49.017059 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:49.017027 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ead495a_945d_4c39_954e_98e47d4976cf.slice/crio-1733037fcceeb3eed3076186e26ae6cc16a96b65998ba45bd9930f49bd958576 WatchSource:0}: Error finding container 1733037fcceeb3eed3076186e26ae6cc16a96b65998ba45bd9930f49bd958576: Status 404 returned error can't find the container with id 1733037fcceeb3eed3076186e26ae6cc16a96b65998ba45bd9930f49bd958576 Aug 02 09:33:49.238316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:49.238245 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g8skl"] Aug 02 09:33:49.240737 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:49.240716 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8zj85"] Aug 02 09:33:49.241366 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:49.241338 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672e5316_3afa_43ab_a9e5_672d12a1c26e.slice/crio-7caae16b8f073c23acd0d3f49cdafacc9e48e618b5fcb8f3aa517fc167152f74 WatchSource:0}: Error finding container 7caae16b8f073c23acd0d3f49cdafacc9e48e618b5fcb8f3aa517fc167152f74: Status 404 returned error can't find the container with id 7caae16b8f073c23acd0d3f49cdafacc9e48e618b5fcb8f3aa517fc167152f74 Aug 02 09:33:49.242933 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:49.242909 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ab025b_b154_44d0_bc68_87769a1b3bf6.slice/crio-0f43671f0aa3223766693c4c2efc4dc587ab70c0a9ba80d667bcd886178c19ef WatchSource:0}: Error finding container 0f43671f0aa3223766693c4c2efc4dc587ab70c0a9ba80d667bcd886178c19ef: Status 404 returned error can't find the container with id 0f43671f0aa3223766693c4c2efc4dc587ab70c0a9ba80d667bcd886178c19ef Aug 02 09:33:49.341176 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:49.341145 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8skl" event={"ID":"672e5316-3afa-43ab-a9e5-672d12a1c26e","Type":"ContainerStarted","Data":"7caae16b8f073c23acd0d3f49cdafacc9e48e618b5fcb8f3aa517fc167152f74"} Aug 02 09:33:49.342583 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:49.342556 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8zj85" event={"ID":"45ab025b-b154-44d0-bc68-87769a1b3bf6","Type":"ContainerStarted","Data":"85437ec6f2952fac7f859638251ae49cb18a12bb7866fb2387686aafac8390a4"} Aug 02 09:33:49.342716 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:49.342595 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8zj85" event={"ID":"45ab025b-b154-44d0-bc68-87769a1b3bf6","Type":"ContainerStarted","Data":"0f43671f0aa3223766693c4c2efc4dc587ab70c0a9ba80d667bcd886178c19ef"} Aug 02 09:33:49.342716 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:49.342638 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:33:49.343730 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:49.343709 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cfz4x" event={"ID":"5ead495a-945d-4c39-954e-98e47d4976cf","Type":"ContainerStarted","Data":"1733037fcceeb3eed3076186e26ae6cc16a96b65998ba45bd9930f49bd958576"} Aug 02 09:33:49.356204 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:49.356167 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8zj85" podStartSLOduration=65.35615515 podStartE2EDuration="1m5.35615515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:32:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:49.355721023 +0000 UTC m=+65.916876343" watchObservedRunningTime="2026-08-02 09:33:49.35615515 +0000 UTC m=+65.917310470" Aug 02 09:33:50.337598 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:50.337560 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:50.337962 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:50.337628 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:33:50.338055 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:50.338026 2575 scope.go:117] "RemoveContainer" containerID="1adba9caf6bd1ba760d10d165e5137fff170fe9b98b789d8072cbcfc7f7bfbd3" Aug 02 09:33:50.338269 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:33:50.338242 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-7rm2v_openshift-console-operator(33c29a7d-6149-4136-ac38-82c7f44fb4e1)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" podUID="33c29a7d-6149-4136-ac38-82c7f44fb4e1" Aug 02 09:33:51.357618 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.357581 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8skl" event={"ID":"672e5316-3afa-43ab-a9e5-672d12a1c26e","Type":"ContainerStarted","Data":"c25013190b1c9dd227fa9b6ac884e595835b50c9fb331707fb619eecc2563317"} Aug 02 09:33:51.358248 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.358218 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8skl" event={"ID":"672e5316-3afa-43ab-a9e5-672d12a1c26e","Type":"ContainerStarted","Data":"1b1ccce1b877eb7c3f5d37329b30e2d9523325bc566f37c584abc0a503db7301"} Aug 02 09:33:51.374334 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.374288 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g8skl" podStartSLOduration=65.194820391 podStartE2EDuration="1m6.37427614s" totalImagesPullingTime="1.179455749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:51.372956533 +0000 UTC m=+67.934111856" watchObservedRunningTime="2026-08-02 09:33:51.37427614 +0000 UTC m=+67.935431512" Aug 02 09:33:51.851893 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.851851 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:51.852088 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.851906 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:51.852088 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.851976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:51.852088 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.852014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-7tgvl\" (UID: \"32ba520c-f409-4571-8260-1c321bbf4702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" Aug 02 09:33:51.852088 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.852051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:51.852824 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.852767 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ee01dc-14aa-4625-8584-22a4d7c70dae-service-ca-bundle\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:51.854842 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.854790 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed13e3aa-46af-43a9-8f01-3d84befb4b9a-metrics-tls\") pod \"dns-default-7wlgl\" (UID: \"ed13e3aa-46af-43a9-8f01-3d84befb4b9a\") " pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:51.854963 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.854890 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls\") pod \"image-registry-5bccbf69c5-tv8vq\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:51.854963 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.854898 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ee01dc-14aa-4625-8584-22a4d7c70dae-metrics-certs\") pod \"router-default-68bf45c684-8lbrw\" (UID: \"a2ee01dc-14aa-4625-8584-22a4d7c70dae\") " pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:51.855079 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.855000 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/32ba520c-f409-4571-8260-1c321bbf4702-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-7tgvl\" (UID: \"32ba520c-f409-4571-8260-1c321bbf4702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" Aug 02 09:33:51.952608 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.952564 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:51.955711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.955685 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b992edc6-b2fd-4c99-abae-418014dc3ee2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bs6pm\" (UID: \"b992edc6-b2fd-4c99-abae-418014dc3ee2\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:51.996787 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:51.996738 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f75jg\"" Aug 02 09:33:52.005368 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:52.005338 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:52.010468 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:52.010441 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-csq7m\"" Aug 02 09:33:52.019203 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:52.019181 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" Aug 02 09:33:52.031164 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:52.031131 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t7hq9\"" Aug 02 09:33:52.040341 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:52.040317 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:52.052949 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:52.052929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-7x6tp\" (UID: \"bb3befea-d006-4ddb-a3b0-6ac4b6689fff\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" Aug 02 09:33:52.055447 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:52.055424 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb3befea-d006-4ddb-a3b0-6ac4b6689fff-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-7x6tp\" (UID: \"bb3befea-d006-4ddb-a3b0-6ac4b6689fff\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" Aug 02 09:33:52.076435 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:52.076410 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zv4ml\"" Aug 02 09:33:52.085103 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:52.085079 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:52.115287 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:52.115259 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cnsnj\"" Aug 02 09:33:52.123961 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:52.123924 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" Aug 02 09:33:52.204442 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:52.204410 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cszcj\"" Aug 02 09:33:52.213142 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:52.213117 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" Aug 02 09:33:53.208332 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:53.207700 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp"] Aug 02 09:33:53.251699 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:53.251307 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bccbf69c5-tv8vq"] Aug 02 09:33:53.253449 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:53.253407 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e6d019_2275_43d8_850b_f0ac2c4d805e.slice/crio-f5da16693f6f7d3b48f22fbfb878136dd05eee6462fff7e1dc872a6ea60931e5 WatchSource:0}: Error finding container f5da16693f6f7d3b48f22fbfb878136dd05eee6462fff7e1dc872a6ea60931e5: Status 404 returned error can't find the container with id f5da16693f6f7d3b48f22fbfb878136dd05eee6462fff7e1dc872a6ea60931e5 Aug 02 09:33:53.270733 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:53.270652 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm"] Aug 02 09:33:53.273416 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:53.273337 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb992edc6_b2fd_4c99_abae_418014dc3ee2.slice/crio-5d8d369ec99b8ddc5d29ab310c4a1ec75bc5915513a4c2965df62891fbbf4747 WatchSource:0}: Error finding container 5d8d369ec99b8ddc5d29ab310c4a1ec75bc5915513a4c2965df62891fbbf4747: Status 404 returned error can't find the container with id 5d8d369ec99b8ddc5d29ab310c4a1ec75bc5915513a4c2965df62891fbbf4747 Aug 02 09:33:53.366407 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:53.366368 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" event={"ID":"a9e6d019-2275-43d8-850b-f0ac2c4d805e","Type":"ContainerStarted","Data":"752c81d625a34b1618ea4a892423b5b9cc310b84de82b6c9651281624e978481"} Aug 02 09:33:53.366585 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:53.366443 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:33:53.366585 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:53.366467 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" event={"ID":"a9e6d019-2275-43d8-850b-f0ac2c4d805e","Type":"ContainerStarted","Data":"f5da16693f6f7d3b48f22fbfb878136dd05eee6462fff7e1dc872a6ea60931e5"} Aug 02 09:33:53.367638 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:53.367612 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" event={"ID":"b992edc6-b2fd-4c99-abae-418014dc3ee2","Type":"ContainerStarted","Data":"5d8d369ec99b8ddc5d29ab310c4a1ec75bc5915513a4c2965df62891fbbf4747"} Aug 02 09:33:53.368972 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:53.368942 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" event={"ID":"bb3befea-d006-4ddb-a3b0-6ac4b6689fff","Type":"ContainerStarted","Data":"4c137efcab023d863048567e345f09cd396b9398f8668244b8ec2b88f40fd125"} Aug 02 09:33:53.372915 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:53.372891 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cfz4x" event={"ID":"5ead495a-945d-4c39-954e-98e47d4976cf","Type":"ContainerStarted","Data":"1ed58b05973b315dab115f06fd3ad2029e8a35b44a501c00553667fea24e164f"} Aug 02 09:33:53.385052 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:53.385004 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" podStartSLOduration=68.384990076 podStartE2EDuration="1m8.384990076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:32:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:53.383561642 +0000 UTC m=+69.944716968" watchObservedRunningTime="2026-08-02 09:33:53.384990076 +0000 UTC m=+69.946145395" Aug 02 09:33:53.396694 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:53.396638 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cfz4x" podStartSLOduration=64.362860729 podStartE2EDuration="1m8.396618419s" totalImagesPullingTime="4.03375769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 09:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:53.395730375 +0000 UTC m=+69.956885696" watchObservedRunningTime="2026-08-02 09:33:53.396618419 +0000 UTC m=+69.957773741" Aug 02 09:33:53.496687 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:53.496654 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7wlgl"] Aug 02 09:33:53.499988 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:53.499954 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl"] Aug 02 09:33:53.500272 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:53.500209 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded13e3aa_46af_43a9_8f01_3d84befb4b9a.slice/crio-f59c33d95b890dea7da89abe16faf241ac1e1338b35fb431fc3f8009e5b362e1 WatchSource:0}: Error finding container f59c33d95b890dea7da89abe16faf241ac1e1338b35fb431fc3f8009e5b362e1: Status 404 returned error can't find the container with id f59c33d95b890dea7da89abe16faf241ac1e1338b35fb431fc3f8009e5b362e1 Aug 02 09:33:53.501478 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:53.501453 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68bf45c684-8lbrw"] Aug 02 09:33:53.503799 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:33:53.503757 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ee01dc_14aa_4625_8584_22a4d7c70dae.slice/crio-3d1b17d46628145a2ebdefad67587f8df31f87914913f2a22e73575c5310ee85 WatchSource:0}: Error finding container 3d1b17d46628145a2ebdefad67587f8df31f87914913f2a22e73575c5310ee85: Status 404 returned error can't find the container with id 3d1b17d46628145a2ebdefad67587f8df31f87914913f2a22e73575c5310ee85 Aug 02 09:33:54.382092 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:54.381841 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68bf45c684-8lbrw" event={"ID":"a2ee01dc-14aa-4625-8584-22a4d7c70dae","Type":"ContainerStarted","Data":"8aefeb64e7c8dfe4c015b2b2abea335970c40311b3cec2c6401392ce9e68a5a2"} Aug 02 09:33:54.382092 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:54.381970 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68bf45c684-8lbrw" event={"ID":"a2ee01dc-14aa-4625-8584-22a4d7c70dae","Type":"ContainerStarted","Data":"3d1b17d46628145a2ebdefad67587f8df31f87914913f2a22e73575c5310ee85"} Aug 02 09:33:54.384868 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:54.384836 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" event={"ID":"32ba520c-f409-4571-8260-1c321bbf4702","Type":"ContainerStarted","Data":"7afb9652d527fdea1e3926d28ad04ec8426539f0f49d6e99b6d4a317c10f02e4"} Aug 02 09:33:54.387336 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:54.387306 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7wlgl" event={"ID":"ed13e3aa-46af-43a9-8f01-3d84befb4b9a","Type":"ContainerStarted","Data":"f59c33d95b890dea7da89abe16faf241ac1e1338b35fb431fc3f8009e5b362e1"} Aug 02 09:33:54.400938 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:54.400855 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-68bf45c684-8lbrw" podStartSLOduration=40.400834433 podStartE2EDuration="40.400834433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:33:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:54.398706013 +0000 UTC m=+70.959861334" watchObservedRunningTime="2026-08-02 09:33:54.400834433 +0000 UTC m=+70.961989755" Aug 02 09:33:55.040796 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:55.040740 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:55.043721 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:55.043691 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:55.391796 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:55.391703 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:55.393138 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:55.393106 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-68bf45c684-8lbrw" Aug 02 09:33:56.402990 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:56.402650 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" event={"ID":"bb3befea-d006-4ddb-a3b0-6ac4b6689fff","Type":"ContainerStarted","Data":"82a7518cbb6da0243301595ac5af3845ca2b211718a27214668982a0a5c9ef8b"} Aug 02 09:33:56.406361 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:56.406293 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" event={"ID":"b992edc6-b2fd-4c99-abae-418014dc3ee2","Type":"ContainerStarted","Data":"b227e1110077cb9c3a8f30b59b003a35f86c005c1a509fc943bc7f0e5ebff913"} Aug 02 09:33:56.409903 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:56.409819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" event={"ID":"32ba520c-f409-4571-8260-1c321bbf4702","Type":"ContainerStarted","Data":"1756ac39ec1fb2fd97dd302cbdd414640194020cf842645926dcaca8de6b6849"} Aug 02 09:33:56.412951 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:56.412885 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7wlgl" event={"ID":"ed13e3aa-46af-43a9-8f01-3d84befb4b9a","Type":"ContainerStarted","Data":"ceffd18a9e700fa42a40bdeefc74c44eaa11e699dc6084190ccaada882ddcbc6"} Aug 02 09:33:56.418880 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:56.418740 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-7x6tp" podStartSLOduration=34.361123687 podStartE2EDuration="37.418720477s" totalImagesPullingTime="3.05759679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:56.417520037 +0000 UTC m=+72.978675356" watchObservedRunningTime="2026-08-02 09:33:56.418720477 +0000 UTC m=+72.979875798" Aug 02 09:33:56.438380 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:56.437666 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bs6pm" podStartSLOduration=39.430195568 podStartE2EDuration="42.437642694s" totalImagesPullingTime="3.007447126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:56.437231472 +0000 UTC m=+72.998386816" watchObservedRunningTime="2026-08-02 09:33:56.437642694 +0000 UTC m=+72.998798015" Aug 02 09:33:57.425448 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:57.425407 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" event={"ID":"32ba520c-f409-4571-8260-1c321bbf4702","Type":"ContainerStarted","Data":"ffa47661859f69cf32c7ca72d1fa1c6a8588aeffcd91733f293e5e32061f5c94"} Aug 02 09:33:57.427673 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:57.427642 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7wlgl" event={"ID":"ed13e3aa-46af-43a9-8f01-3d84befb4b9a","Type":"ContainerStarted","Data":"31eaa53c6b51a0d5fbcf6d0dc96162a89570d435ea1f696fbfa4719c8cbedddc"} Aug 02 09:33:57.428051 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:57.428032 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7wlgl" Aug 02 09:33:57.441854 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:57.441794 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-7tgvl" podStartSLOduration=40.709767206 podStartE2EDuration="43.441762784s" totalImagesPullingTime="2.731995578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:57.439927769 +0000 UTC m=+74.001083092" watchObservedRunningTime="2026-08-02 09:33:57.441762784 +0000 UTC m=+74.002918106" Aug 02 09:33:57.454031 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:33:57.453989 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7wlgl" podStartSLOduration=35.677290374 podStartE2EDuration="38.453973555s" totalImagesPullingTime="2.776683181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:33:57.453216956 +0000 UTC m=+74.014372276" watchObservedRunningTime="2026-08-02 09:33:57.453973555 +0000 UTC m=+74.015128936" Aug 02 09:34:03.952034 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:03.952004 2575 scope.go:117] "RemoveContainer" containerID="1adba9caf6bd1ba760d10d165e5137fff170fe9b98b789d8072cbcfc7f7bfbd3" Aug 02 09:34:03.952883 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:34:03.952853 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-7rm2v_openshift-console-operator(33c29a7d-6149-4136-ac38-82c7f44fb4e1)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" podUID="33c29a7d-6149-4136-ac38-82c7f44fb4e1" Aug 02 09:34:04.229744 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.229651 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9z5vs"] Aug 02 09:34:04.243870 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.243841 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.246175 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.246134 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 02 09:34:04.246327 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.246193 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vw8xp\"" Aug 02 09:34:04.246327 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.246139 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 02 09:34:04.246327 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.246143 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 02 09:34:04.246928 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.246908 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 02 09:34:04.359367 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.359327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9158ab6e-d442-446d-930c-2539387d774f-root\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.359367 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.359367 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9158ab6e-d442-446d-930c-2539387d774f-metrics-client-ca\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.359564 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.359404 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-tls\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.359564 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.359428 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9158ab6e-d442-446d-930c-2539387d774f-sys\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.359564 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.359468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-textfile\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.359564 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.359488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.359564 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.359523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-accelerators-collector-config\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.359564 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.359548 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b89js\" (UniqueName: \"kubernetes.io/projected/9158ab6e-d442-446d-930c-2539387d774f-kube-api-access-b89js\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.359749 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.359569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-wtmp\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.460835 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.460803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-textfile\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.460835 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.460841 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.461079 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.460870 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-accelerators-collector-config\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.461079 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.460905 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b89js\" (UniqueName: \"kubernetes.io/projected/9158ab6e-d442-446d-930c-2539387d774f-kube-api-access-b89js\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.461079 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.460927 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-wtmp\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.461079 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.460951 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9158ab6e-d442-446d-930c-2539387d774f-root\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.461079 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.460973 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9158ab6e-d442-446d-930c-2539387d774f-metrics-client-ca\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.461079 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.461022 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-tls\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.461079 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.461046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9158ab6e-d442-446d-930c-2539387d774f-sys\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.461435 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.461117 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9158ab6e-d442-446d-930c-2539387d774f-sys\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.461435 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.461117 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-wtmp\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.461435 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.461179 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-textfile\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.461586 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.461504 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9158ab6e-d442-446d-930c-2539387d774f-root\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.461746 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.461726 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-accelerators-collector-config\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.463293 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.463270 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.464897 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.464880 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9158ab6e-d442-446d-930c-2539387d774f-metrics-client-ca\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.467702 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.467681 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b89js\" (UniqueName: \"kubernetes.io/projected/9158ab6e-d442-446d-930c-2539387d774f-kube-api-access-b89js\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.477562 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.477540 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9158ab6e-d442-446d-930c-2539387d774f-node-exporter-tls\") pod \"node-exporter-9z5vs\" (UID: \"9158ab6e-d442-446d-930c-2539387d774f\") " pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.553981 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:04.553945 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9z5vs" Aug 02 09:34:04.580227 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:34:04.580193 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9158ab6e_d442_446d_930c_2539387d774f.slice/crio-c036310bc03faf849eb229d187334414a7b0c6b3eeccfebf22b9d6e097f22d4b WatchSource:0}: Error finding container c036310bc03faf849eb229d187334414a7b0c6b3eeccfebf22b9d6e097f22d4b: Status 404 returned error can't find the container with id c036310bc03faf849eb229d187334414a7b0c6b3eeccfebf22b9d6e097f22d4b Aug 02 09:34:05.460734 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:05.460700 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9z5vs" event={"ID":"9158ab6e-d442-446d-930c-2539387d774f","Type":"ContainerStarted","Data":"c036310bc03faf849eb229d187334414a7b0c6b3eeccfebf22b9d6e097f22d4b"} Aug 02 09:34:06.466130 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:06.466015 2575 generic.go:356] "Generic (PLEG): container finished" podID="9158ab6e-d442-446d-930c-2539387d774f" containerID="0b3c01278b2ecbc251b864fc4a7370094062483d9ec2234e1b283b7682c18e88" exitCode=0 Aug 02 09:34:06.466130 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:06.466100 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9z5vs" event={"ID":"9158ab6e-d442-446d-930c-2539387d774f","Type":"ContainerDied","Data":"0b3c01278b2ecbc251b864fc4a7370094062483d9ec2234e1b283b7682c18e88"} Aug 02 09:34:07.472003 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:07.471964 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9z5vs" event={"ID":"9158ab6e-d442-446d-930c-2539387d774f","Type":"ContainerStarted","Data":"8d703f853eab3f0cc80a370e7989c4fd56156a09c8f73b6ba189271eec1c2003"} Aug 02 09:34:07.472400 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:07.472053 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9z5vs" event={"ID":"9158ab6e-d442-446d-930c-2539387d774f","Type":"ContainerStarted","Data":"1d5dce028bc7485ca277d23ab1bafc797242750018ad1d0d4536f287d3eab80f"} Aug 02 09:34:07.489159 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:07.489113 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9z5vs" podStartSLOduration=2.443507812 podStartE2EDuration="3.489096288s" totalImagesPullingTime="982.273743ms" totalInitContainerRuntime="63.314733ms" isStatefulPod=true podCreationTimestamp="2026-08-02 09:34:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:34:07.487909839 +0000 UTC m=+84.049065159" watchObservedRunningTime="2026-08-02 09:34:07.489096288 +0000 UTC m=+84.050251608" Aug 02 09:34:08.437466 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:08.437432 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7wlgl" Aug 02 09:34:14.253208 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:14.253174 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bccbf69c5-tv8vq"] Aug 02 09:34:14.257303 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:14.257279 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:34:18.950024 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:18.949993 2575 scope.go:117] "RemoveContainer" containerID="1adba9caf6bd1ba760d10d165e5137fff170fe9b98b789d8072cbcfc7f7bfbd3" Aug 02 09:34:19.517243 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:19.517215 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 09:34:19.517409 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:19.517295 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" event={"ID":"33c29a7d-6149-4136-ac38-82c7f44fb4e1","Type":"ContainerStarted","Data":"30d0025c4f85daaf03726a9513d78aa22bc35ad9300d0276d664bd2f24d122d0"} Aug 02 09:34:19.517669 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:19.517650 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:34:19.533872 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:19.533827 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" podStartSLOduration=57.683679251 podStartE2EDuration="1m5.533811873s" totalImagesPullingTime="7.850132622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:34:19.533088271 +0000 UTC m=+96.094243589" watchObservedRunningTime="2026-08-02 09:34:19.533811873 +0000 UTC m=+96.094967192" Aug 02 09:34:19.999710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:19.999680 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-7rm2v" Aug 02 09:34:20.165299 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:20.165266 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-bhjh2"] Aug 02 09:34:20.170976 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:20.170954 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-bhjh2" Aug 02 09:34:20.172965 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:20.172947 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-pkhpr\"" Aug 02 09:34:20.173071 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:20.172953 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Aug 02 09:34:20.173071 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:20.172998 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Aug 02 09:34:20.180282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:20.180262 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-bhjh2"] Aug 02 09:34:20.256606 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:20.256532 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z977s\" (UniqueName: \"kubernetes.io/projected/308d2130-6ee1-4575-8134-a154eca3edac-kube-api-access-z977s\") pod \"downloads-77c974ffcf-bhjh2\" (UID: \"308d2130-6ee1-4575-8134-a154eca3edac\") " pod="openshift-console/downloads-77c974ffcf-bhjh2" Aug 02 09:34:20.350751 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:20.350726 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8zj85" Aug 02 09:34:20.357636 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:20.357615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z977s\" (UniqueName: \"kubernetes.io/projected/308d2130-6ee1-4575-8134-a154eca3edac-kube-api-access-z977s\") pod \"downloads-77c974ffcf-bhjh2\" (UID: \"308d2130-6ee1-4575-8134-a154eca3edac\") " pod="openshift-console/downloads-77c974ffcf-bhjh2" Aug 02 09:34:20.367809 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:20.367764 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z977s\" (UniqueName: \"kubernetes.io/projected/308d2130-6ee1-4575-8134-a154eca3edac-kube-api-access-z977s\") pod \"downloads-77c974ffcf-bhjh2\" (UID: \"308d2130-6ee1-4575-8134-a154eca3edac\") " pod="openshift-console/downloads-77c974ffcf-bhjh2" Aug 02 09:34:20.480632 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:20.480600 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-bhjh2" Aug 02 09:34:20.611160 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:20.611126 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-bhjh2"] Aug 02 09:34:20.614244 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:34:20.614205 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308d2130_6ee1_4575_8134_a154eca3edac.slice/crio-3b5cd9fba8d5a1ff51c126857304a02c62175ccf55ca62f795a058a114bdc590 WatchSource:0}: Error finding container 3b5cd9fba8d5a1ff51c126857304a02c62175ccf55ca62f795a058a114bdc590: Status 404 returned error can't find the container with id 3b5cd9fba8d5a1ff51c126857304a02c62175ccf55ca62f795a058a114bdc590 Aug 02 09:34:21.530554 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:21.530510 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-bhjh2" event={"ID":"308d2130-6ee1-4575-8134-a154eca3edac","Type":"ContainerStarted","Data":"3b5cd9fba8d5a1ff51c126857304a02c62175ccf55ca62f795a058a114bdc590"} Aug 02 09:34:29.199629 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.199590 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cdff4bbdf-zsvp7"] Aug 02 09:34:29.213875 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.213842 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cdff4bbdf-zsvp7"] Aug 02 09:34:29.214031 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.213964 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.216401 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.216344 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Aug 02 09:34:29.216550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.216407 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Aug 02 09:34:29.216550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.216477 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Aug 02 09:34:29.216550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.216530 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fk8zm\"" Aug 02 09:34:29.216818 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.216624 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Aug 02 09:34:29.217021 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.217004 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Aug 02 09:34:29.231647 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.231622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-oauth-serving-cert\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.231788 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.231655 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-service-ca\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.231788 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.231694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-config\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.231870 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.231767 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-oauth-config\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.231870 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.231810 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt9dj\" (UniqueName: \"kubernetes.io/projected/bf653f5e-776b-49b8-9f74-6e416adf00f8-kube-api-access-qt9dj\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.231870 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.231829 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-serving-cert\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.332678 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.332648 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-oauth-serving-cert\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.332678 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.332690 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-service-ca\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.332946 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.332731 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-config\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.332946 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.332797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-oauth-config\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.332946 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.332824 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt9dj\" (UniqueName: \"kubernetes.io/projected/bf653f5e-776b-49b8-9f74-6e416adf00f8-kube-api-access-qt9dj\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.332946 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.332853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-serving-cert\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.333613 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.333551 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-oauth-serving-cert\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.333613 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.333589 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-config\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.333812 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.333589 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-service-ca\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.335576 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.335555 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-oauth-config\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.335685 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.335636 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-serving-cert\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.340426 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.340403 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt9dj\" (UniqueName: \"kubernetes.io/projected/bf653f5e-776b-49b8-9f74-6e416adf00f8-kube-api-access-qt9dj\") pod \"console-6cdff4bbdf-zsvp7\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:29.524346 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:29.524265 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:36.284711 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:36.284682 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cdff4bbdf-zsvp7"] Aug 02 09:34:36.295985 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:34:36.295955 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf653f5e_776b_49b8_9f74_6e416adf00f8.slice/crio-cb442846daf625a0c501ca1325cf8227a0165fbbf349a761df1998326cec7307 WatchSource:0}: Error finding container cb442846daf625a0c501ca1325cf8227a0165fbbf349a761df1998326cec7307: Status 404 returned error can't find the container with id cb442846daf625a0c501ca1325cf8227a0165fbbf349a761df1998326cec7307 Aug 02 09:34:36.596843 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:36.596800 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-bhjh2" event={"ID":"308d2130-6ee1-4575-8134-a154eca3edac","Type":"ContainerStarted","Data":"79657455b6312c47d58574bbb0ac0a24593f6e372725d8e9ad04fde029ae7a90"} Aug 02 09:34:36.597105 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:36.597081 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-bhjh2" Aug 02 09:34:36.598371 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:36.598345 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdff4bbdf-zsvp7" event={"ID":"bf653f5e-776b-49b8-9f74-6e416adf00f8","Type":"ContainerStarted","Data":"cb442846daf625a0c501ca1325cf8227a0165fbbf349a761df1998326cec7307"} Aug 02 09:34:36.611683 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:36.611629 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-bhjh2" podStartSLOduration=0.968106983 podStartE2EDuration="16.611609971s" totalImagesPullingTime="15.643502988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:34:36.610639552 +0000 UTC m=+113.171794871" watchObservedRunningTime="2026-08-02 09:34:36.611609971 +0000 UTC m=+113.172765293" Aug 02 09:34:36.613187 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:36.613165 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-bhjh2" Aug 02 09:34:38.280202 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.278757 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75695568b7-ql6w6"] Aug 02 09:34:38.282659 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.282635 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.291120 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.290960 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Aug 02 09:34:38.296797 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.296743 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75695568b7-ql6w6"] Aug 02 09:34:38.312881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.312527 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-service-ca\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.312881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.312588 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-trusted-ca-bundle\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.312881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.312635 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g7xp\" (UniqueName: \"kubernetes.io/projected/b41d4bba-df97-4061-8192-47d9eb6d7f71-kube-api-access-5g7xp\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.312881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.312656 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-serving-cert\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.312881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.312670 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-config\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.312881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.312698 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-oauth-config\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.312881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.312724 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-oauth-serving-cert\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.414486 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.414049 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-oauth-serving-cert\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.414486 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.414103 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-service-ca\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.414486 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.414148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-trusted-ca-bundle\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.414486 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.414203 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g7xp\" (UniqueName: \"kubernetes.io/projected/b41d4bba-df97-4061-8192-47d9eb6d7f71-kube-api-access-5g7xp\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.414486 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.414246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-serving-cert\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.414486 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.414266 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-config\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.414486 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.414311 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-oauth-config\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.414955 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.414885 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-service-ca\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.414955 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.414883 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-oauth-serving-cert\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.415747 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.415717 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-trusted-ca-bundle\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.416230 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.415917 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-config\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.418263 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.418164 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-oauth-config\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.418442 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.418309 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-serving-cert\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.423974 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.423872 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g7xp\" (UniqueName: \"kubernetes.io/projected/b41d4bba-df97-4061-8192-47d9eb6d7f71-kube-api-access-5g7xp\") pod \"console-75695568b7-ql6w6\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:38.600531 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:38.600469 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:39.272669 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:39.272582 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" podUID="a9e6d019-2275-43d8-850b-f0ac2c4d805e" containerName="registry" containerID="cri-o://752c81d625a34b1618ea4a892423b5b9cc310b84de82b6c9651281624e978481" gracePeriod=30 Aug 02 09:34:39.901224 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:39.901197 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:34:40.030053 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.029971 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls\") pod \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " Aug 02 09:34:40.030053 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.030047 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9e6d019-2275-43d8-850b-f0ac2c4d805e-trusted-ca\") pod \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " Aug 02 09:34:40.030285 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.030080 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9e6d019-2275-43d8-850b-f0ac2c4d805e-installation-pull-secrets\") pod \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " Aug 02 09:34:40.030285 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.030108 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9e6d019-2275-43d8-850b-f0ac2c4d805e-image-registry-private-configuration\") pod \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " Aug 02 09:34:40.030285 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.030146 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-bound-sa-token\") pod \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " Aug 02 09:34:40.030285 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.030174 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9pdt\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-kube-api-access-n9pdt\") pod \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " Aug 02 09:34:40.030285 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.030231 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-certificates\") pod \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " Aug 02 09:34:40.030285 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.030265 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9e6d019-2275-43d8-850b-f0ac2c4d805e-ca-trust-extracted\") pod \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\" (UID: \"a9e6d019-2275-43d8-850b-f0ac2c4d805e\") " Aug 02 09:34:40.030603 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.030478 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9e6d019-2275-43d8-850b-f0ac2c4d805e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a9e6d019-2275-43d8-850b-f0ac2c4d805e" (UID: "a9e6d019-2275-43d8-850b-f0ac2c4d805e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:34:40.033141 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.030867 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a9e6d019-2275-43d8-850b-f0ac2c4d805e" (UID: "a9e6d019-2275-43d8-850b-f0ac2c4d805e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:34:40.033277 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.033202 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a9e6d019-2275-43d8-850b-f0ac2c4d805e" (UID: "a9e6d019-2275-43d8-850b-f0ac2c4d805e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:34:40.033606 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.033377 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9e6d019-2275-43d8-850b-f0ac2c4d805e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a9e6d019-2275-43d8-850b-f0ac2c4d805e" (UID: "a9e6d019-2275-43d8-850b-f0ac2c4d805e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:34:40.033606 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.033462 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a9e6d019-2275-43d8-850b-f0ac2c4d805e" (UID: "a9e6d019-2275-43d8-850b-f0ac2c4d805e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:34:40.033878 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.033686 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-kube-api-access-n9pdt" (OuterVolumeSpecName: "kube-api-access-n9pdt") pod "a9e6d019-2275-43d8-850b-f0ac2c4d805e" (UID: "a9e6d019-2275-43d8-850b-f0ac2c4d805e"). InnerVolumeSpecName "kube-api-access-n9pdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:34:40.036316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.036274 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9e6d019-2275-43d8-850b-f0ac2c4d805e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a9e6d019-2275-43d8-850b-f0ac2c4d805e" (UID: "a9e6d019-2275-43d8-850b-f0ac2c4d805e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:34:40.036567 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.036443 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75695568b7-ql6w6"] Aug 02 09:34:40.042884 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.042857 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9e6d019-2275-43d8-850b-f0ac2c4d805e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a9e6d019-2275-43d8-850b-f0ac2c4d805e" (UID: "a9e6d019-2275-43d8-850b-f0ac2c4d805e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:34:40.114079 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:34:40.114043 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41d4bba_df97_4061_8192_47d9eb6d7f71.slice/crio-04f4e4263b9c5846534e8ba44e5785195322cd388e32f65047f455bf8a32a55c WatchSource:0}: Error finding container 04f4e4263b9c5846534e8ba44e5785195322cd388e32f65047f455bf8a32a55c: Status 404 returned error can't find the container with id 04f4e4263b9c5846534e8ba44e5785195322cd388e32f65047f455bf8a32a55c Aug 02 09:34:40.131450 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.131414 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9e6d019-2275-43d8-850b-f0ac2c4d805e-trusted-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:34:40.131450 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.131451 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9e6d019-2275-43d8-850b-f0ac2c4d805e-installation-pull-secrets\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:34:40.131629 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.131468 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9e6d019-2275-43d8-850b-f0ac2c4d805e-image-registry-private-configuration\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:34:40.131629 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.131482 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-bound-sa-token\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:34:40.131629 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.131492 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9pdt\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-kube-api-access-n9pdt\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:34:40.131629 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.131499 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-certificates\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:34:40.131629 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.131508 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9e6d019-2275-43d8-850b-f0ac2c4d805e-ca-trust-extracted\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:34:40.131629 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.131516 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9e6d019-2275-43d8-850b-f0ac2c4d805e-registry-tls\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:34:40.619216 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.619175 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdff4bbdf-zsvp7" event={"ID":"bf653f5e-776b-49b8-9f74-6e416adf00f8","Type":"ContainerStarted","Data":"ccb05102b2e3b163850f33046f29cf683962b42d1c8f53c0c4478481e3431f14"} Aug 02 09:34:40.621068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.621032 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75695568b7-ql6w6" event={"ID":"b41d4bba-df97-4061-8192-47d9eb6d7f71","Type":"ContainerStarted","Data":"f6f2ff4a254bb215727777165e4a61b40d8af511c40a7074bf4e71248cc54591"} Aug 02 09:34:40.621213 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.621085 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75695568b7-ql6w6" event={"ID":"b41d4bba-df97-4061-8192-47d9eb6d7f71","Type":"ContainerStarted","Data":"04f4e4263b9c5846534e8ba44e5785195322cd388e32f65047f455bf8a32a55c"} Aug 02 09:34:40.622451 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.622425 2575 generic.go:356] "Generic (PLEG): container finished" podID="a9e6d019-2275-43d8-850b-f0ac2c4d805e" containerID="752c81d625a34b1618ea4a892423b5b9cc310b84de82b6c9651281624e978481" exitCode=0 Aug 02 09:34:40.622594 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.622461 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" event={"ID":"a9e6d019-2275-43d8-850b-f0ac2c4d805e","Type":"ContainerDied","Data":"752c81d625a34b1618ea4a892423b5b9cc310b84de82b6c9651281624e978481"} Aug 02 09:34:40.622594 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.622464 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" Aug 02 09:34:40.622594 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.622499 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bccbf69c5-tv8vq" event={"ID":"a9e6d019-2275-43d8-850b-f0ac2c4d805e","Type":"ContainerDied","Data":"f5da16693f6f7d3b48f22fbfb878136dd05eee6462fff7e1dc872a6ea60931e5"} Aug 02 09:34:40.622594 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.622530 2575 scope.go:117] "RemoveContainer" containerID="752c81d625a34b1618ea4a892423b5b9cc310b84de82b6c9651281624e978481" Aug 02 09:34:40.632964 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.632939 2575 scope.go:117] "RemoveContainer" containerID="752c81d625a34b1618ea4a892423b5b9cc310b84de82b6c9651281624e978481" Aug 02 09:34:40.633322 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:34:40.633290 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"752c81d625a34b1618ea4a892423b5b9cc310b84de82b6c9651281624e978481\": container with ID starting with 752c81d625a34b1618ea4a892423b5b9cc310b84de82b6c9651281624e978481 not found: ID does not exist" containerID="752c81d625a34b1618ea4a892423b5b9cc310b84de82b6c9651281624e978481" Aug 02 09:34:40.633427 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.633329 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752c81d625a34b1618ea4a892423b5b9cc310b84de82b6c9651281624e978481"} err="failed to get container status \"752c81d625a34b1618ea4a892423b5b9cc310b84de82b6c9651281624e978481\": rpc error: code = NotFound desc = could not find container \"752c81d625a34b1618ea4a892423b5b9cc310b84de82b6c9651281624e978481\": container with ID starting with 752c81d625a34b1618ea4a892423b5b9cc310b84de82b6c9651281624e978481 not found: ID does not exist" Aug 02 09:34:40.634620 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.634576 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cdff4bbdf-zsvp7" podStartSLOduration=7.787537474 podStartE2EDuration="11.634563342s" totalImagesPullingTime="3.847025868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:34:40.633521067 +0000 UTC m=+117.194676388" watchObservedRunningTime="2026-08-02 09:34:40.634563342 +0000 UTC m=+117.195718661" Aug 02 09:34:40.646015 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.645990 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bccbf69c5-tv8vq"] Aug 02 09:34:40.652229 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.652207 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bccbf69c5-tv8vq"] Aug 02 09:34:40.672941 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:40.672883 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75695568b7-ql6w6" podStartSLOduration=2.672866599 podStartE2EDuration="2.672866599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:34:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:34:40.67211075 +0000 UTC m=+117.233266071" watchObservedRunningTime="2026-08-02 09:34:40.672866599 +0000 UTC m=+117.234021920" Aug 02 09:34:41.955992 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:41.955954 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9e6d019-2275-43d8-850b-f0ac2c4d805e" path="/var/lib/kubelet/pods/a9e6d019-2275-43d8-850b-f0ac2c4d805e/volumes" Aug 02 09:34:48.601553 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:48.601509 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:48.602005 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:48.601580 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:48.606351 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:48.606328 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:48.662345 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:48.662317 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:34:48.706054 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:48.706023 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cdff4bbdf-zsvp7"] Aug 02 09:34:49.524822 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:49.524732 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:34:49.663019 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:49.662985 2575 generic.go:356] "Generic (PLEG): container finished" podID="0d2b40e4-a705-4d10-b565-a220c1d687c1" containerID="08f4f5a970a36f15ee99590b55f29fe3bd36c0334fa3a373f51131ccc6db80eb" exitCode=0 Aug 02 09:34:49.663507 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:49.663061 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rlxjx" event={"ID":"0d2b40e4-a705-4d10-b565-a220c1d687c1","Type":"ContainerDied","Data":"08f4f5a970a36f15ee99590b55f29fe3bd36c0334fa3a373f51131ccc6db80eb"} Aug 02 09:34:49.663507 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:49.663435 2575 scope.go:117] "RemoveContainer" containerID="08f4f5a970a36f15ee99590b55f29fe3bd36c0334fa3a373f51131ccc6db80eb" Aug 02 09:34:50.668182 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:50.668152 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rlxjx" event={"ID":"0d2b40e4-a705-4d10-b565-a220c1d687c1","Type":"ContainerStarted","Data":"59696f3612b28b07a329f40be547fcb6811ced6756eb30d5c6f82a38f86e227f"} Aug 02 09:34:51.544130 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:51.544102 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-bs6pm_b992edc6-b2fd-4c99-abae-418014dc3ee2/cluster-monitoring-operator/0.log" Aug 02 09:34:53.942539 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:53.942510 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9z5vs_9158ab6e-d442-446d-930c-2539387d774f/init-textfile/0.log" Aug 02 09:34:54.143601 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:54.143573 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9z5vs_9158ab6e-d442-446d-930c-2539387d774f/node-exporter/0.log" Aug 02 09:34:54.342427 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:54.342403 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9z5vs_9158ab6e-d442-446d-930c-2539387d774f/kube-rbac-proxy/0.log" Aug 02 09:34:54.688871 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:54.688770 2575 generic.go:356] "Generic (PLEG): container finished" podID="70b57d9a-568e-4b0d-9017-4f02b3a832a5" containerID="6cead29128c8d8c666cd96dbe3f191d993832d0735245514a6ba28911a092282" exitCode=0 Aug 02 09:34:54.688871 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:54.688844 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" event={"ID":"70b57d9a-568e-4b0d-9017-4f02b3a832a5","Type":"ContainerDied","Data":"6cead29128c8d8c666cd96dbe3f191d993832d0735245514a6ba28911a092282"} Aug 02 09:34:54.689214 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:54.689197 2575 scope.go:117] "RemoveContainer" containerID="6cead29128c8d8c666cd96dbe3f191d993832d0735245514a6ba28911a092282" Aug 02 09:34:55.694525 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:55.694491 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-tvg54" event={"ID":"70b57d9a-568e-4b0d-9017-4f02b3a832a5","Type":"ContainerStarted","Data":"13b4e8857cd1848c226a9ff0b308f7da7328ba6d46fc191b25e6dc1ca863e1ca"} Aug 02 09:34:58.342564 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:58.342532 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-7x6tp_bb3befea-d006-4ddb-a3b0-6ac4b6689fff/networking-console-plugin/0.log" Aug 02 09:34:58.542451 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:58.542425 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 09:34:58.743810 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:58.743720 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/3.log" Aug 02 09:34:58.943117 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:58.943088 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cdff4bbdf-zsvp7_bf653f5e-776b-49b8-9f74-6e416adf00f8/console/0.log" Aug 02 09:34:59.143142 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:59.143116 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75695568b7-ql6w6_b41d4bba-df97-4061-8192-47d9eb6d7f71/console/0.log" Aug 02 09:34:59.344032 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:34:59.344007 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-bhjh2_308d2130-6ee1-4575-8134-a154eca3edac/download-server/0.log" Aug 02 09:35:00.714424 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:00.714393 2575 generic.go:356] "Generic (PLEG): container finished" podID="64209794-a5d5-4a29-82ef-bc6d8eecec0c" containerID="9a8fde2d83e3852e573359b557c7abef2b11f96a6a70d7e6279794b99047e9ea" exitCode=0 Aug 02 09:35:00.715157 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:00.714456 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" event={"ID":"64209794-a5d5-4a29-82ef-bc6d8eecec0c","Type":"ContainerDied","Data":"9a8fde2d83e3852e573359b557c7abef2b11f96a6a70d7e6279794b99047e9ea"} Aug 02 09:35:00.715157 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:00.714809 2575 scope.go:117] "RemoveContainer" containerID="9a8fde2d83e3852e573359b557c7abef2b11f96a6a70d7e6279794b99047e9ea" Aug 02 09:35:01.720904 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:01.720875 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-l248c" event={"ID":"64209794-a5d5-4a29-82ef-bc6d8eecec0c","Type":"ContainerStarted","Data":"6e31147c4e506ef44e9de0cb2b3f36a52e100c90208a7c57f6b3fd41ab713b3c"} Aug 02 09:35:13.726270 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:13.726227 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6cdff4bbdf-zsvp7" podUID="bf653f5e-776b-49b8-9f74-6e416adf00f8" containerName="console" containerID="cri-o://ccb05102b2e3b163850f33046f29cf683962b42d1c8f53c0c4478481e3431f14" gracePeriod=15 Aug 02 09:35:14.016551 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.016520 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:35:14.116311 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.116270 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-oauth-config\") pod \"bf653f5e-776b-49b8-9f74-6e416adf00f8\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " Aug 02 09:35:14.116311 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.116312 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-serving-cert\") pod \"bf653f5e-776b-49b8-9f74-6e416adf00f8\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " Aug 02 09:35:14.116535 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.116347 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-service-ca\") pod \"bf653f5e-776b-49b8-9f74-6e416adf00f8\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " Aug 02 09:35:14.116535 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.116492 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt9dj\" (UniqueName: \"kubernetes.io/projected/bf653f5e-776b-49b8-9f74-6e416adf00f8-kube-api-access-qt9dj\") pod \"bf653f5e-776b-49b8-9f74-6e416adf00f8\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " Aug 02 09:35:14.116614 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.116536 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-config\") pod \"bf653f5e-776b-49b8-9f74-6e416adf00f8\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " Aug 02 09:35:14.116692 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.116669 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-service-ca" (OuterVolumeSpecName: "service-ca") pod "bf653f5e-776b-49b8-9f74-6e416adf00f8" (UID: "bf653f5e-776b-49b8-9f74-6e416adf00f8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:35:14.116951 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.116851 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:35:14.116951 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.116917 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-config" (OuterVolumeSpecName: "console-config") pod "bf653f5e-776b-49b8-9f74-6e416adf00f8" (UID: "bf653f5e-776b-49b8-9f74-6e416adf00f8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:35:14.118735 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.118700 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf653f5e-776b-49b8-9f74-6e416adf00f8-kube-api-access-qt9dj" (OuterVolumeSpecName: "kube-api-access-qt9dj") pod "bf653f5e-776b-49b8-9f74-6e416adf00f8" (UID: "bf653f5e-776b-49b8-9f74-6e416adf00f8"). InnerVolumeSpecName "kube-api-access-qt9dj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:35:14.118996 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.118971 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bf653f5e-776b-49b8-9f74-6e416adf00f8" (UID: "bf653f5e-776b-49b8-9f74-6e416adf00f8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:35:14.119098 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.119007 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bf653f5e-776b-49b8-9f74-6e416adf00f8" (UID: "bf653f5e-776b-49b8-9f74-6e416adf00f8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:35:14.217339 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.217306 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-oauth-serving-cert\") pod \"bf653f5e-776b-49b8-9f74-6e416adf00f8\" (UID: \"bf653f5e-776b-49b8-9f74-6e416adf00f8\") " Aug 02 09:35:14.217531 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.217513 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-oauth-config\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:35:14.217604 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.217539 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-serving-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:35:14.217604 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.217553 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt9dj\" (UniqueName: \"kubernetes.io/projected/bf653f5e-776b-49b8-9f74-6e416adf00f8-kube-api-access-qt9dj\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:35:14.217604 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.217566 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-console-config\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:35:14.217745 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.217630 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bf653f5e-776b-49b8-9f74-6e416adf00f8" (UID: "bf653f5e-776b-49b8-9f74-6e416adf00f8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:35:14.318192 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.318162 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf653f5e-776b-49b8-9f74-6e416adf00f8-oauth-serving-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:35:14.773905 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.773824 2575 generic.go:356] "Generic (PLEG): container finished" podID="bf653f5e-776b-49b8-9f74-6e416adf00f8" containerID="ccb05102b2e3b163850f33046f29cf683962b42d1c8f53c0c4478481e3431f14" exitCode=0 Aug 02 09:35:14.773905 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.773880 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdff4bbdf-zsvp7" event={"ID":"bf653f5e-776b-49b8-9f74-6e416adf00f8","Type":"ContainerDied","Data":"ccb05102b2e3b163850f33046f29cf683962b42d1c8f53c0c4478481e3431f14"} Aug 02 09:35:14.773905 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.773899 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdff4bbdf-zsvp7" Aug 02 09:35:14.774416 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.773964 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdff4bbdf-zsvp7" event={"ID":"bf653f5e-776b-49b8-9f74-6e416adf00f8","Type":"ContainerDied","Data":"cb442846daf625a0c501ca1325cf8227a0165fbbf349a761df1998326cec7307"} Aug 02 09:35:14.774416 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.773995 2575 scope.go:117] "RemoveContainer" containerID="ccb05102b2e3b163850f33046f29cf683962b42d1c8f53c0c4478481e3431f14" Aug 02 09:35:14.782501 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.782484 2575 scope.go:117] "RemoveContainer" containerID="ccb05102b2e3b163850f33046f29cf683962b42d1c8f53c0c4478481e3431f14" Aug 02 09:35:14.782750 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:35:14.782726 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccb05102b2e3b163850f33046f29cf683962b42d1c8f53c0c4478481e3431f14\": container with ID starting with ccb05102b2e3b163850f33046f29cf683962b42d1c8f53c0c4478481e3431f14 not found: ID does not exist" containerID="ccb05102b2e3b163850f33046f29cf683962b42d1c8f53c0c4478481e3431f14" Aug 02 09:35:14.782829 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.782761 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb05102b2e3b163850f33046f29cf683962b42d1c8f53c0c4478481e3431f14"} err="failed to get container status \"ccb05102b2e3b163850f33046f29cf683962b42d1c8f53c0c4478481e3431f14\": rpc error: code = NotFound desc = could not find container \"ccb05102b2e3b163850f33046f29cf683962b42d1c8f53c0c4478481e3431f14\": container with ID starting with ccb05102b2e3b163850f33046f29cf683962b42d1c8f53c0c4478481e3431f14 not found: ID does not exist" Aug 02 09:35:14.794284 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.794264 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cdff4bbdf-zsvp7"] Aug 02 09:35:14.797435 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:14.797416 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cdff4bbdf-zsvp7"] Aug 02 09:35:15.954748 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:15.954715 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf653f5e-776b-49b8-9f74-6e416adf00f8" path="/var/lib/kubelet/pods/bf653f5e-776b-49b8-9f74-6e416adf00f8/volumes" Aug 02 09:35:31.840983 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.840951 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d4d68766b-z7rls"] Aug 02 09:35:31.841486 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.841443 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9e6d019-2275-43d8-850b-f0ac2c4d805e" containerName="registry" Aug 02 09:35:31.841486 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.841461 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9e6d019-2275-43d8-850b-f0ac2c4d805e" containerName="registry" Aug 02 09:35:31.841486 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.841484 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf653f5e-776b-49b8-9f74-6e416adf00f8" containerName="console" Aug 02 09:35:31.841629 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.841493 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf653f5e-776b-49b8-9f74-6e416adf00f8" containerName="console" Aug 02 09:35:31.841629 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.841561 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9e6d019-2275-43d8-850b-f0ac2c4d805e" containerName="registry" Aug 02 09:35:31.841629 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.841571 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf653f5e-776b-49b8-9f74-6e416adf00f8" containerName="console" Aug 02 09:35:31.844841 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.844815 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:31.859669 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.859646 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d4d68766b-z7rls"] Aug 02 09:35:31.948075 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.948040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-oauth-config\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:31.948269 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.948087 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-serving-cert\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:31.948269 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.948107 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-service-ca\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:31.948269 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.948179 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-config\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:31.948269 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.948244 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-trusted-ca-bundle\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:31.948452 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.948297 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpnwh\" (UniqueName: \"kubernetes.io/projected/c487c395-e0b6-4cc3-8458-c88f13e5e088-kube-api-access-fpnwh\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:31.948452 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:31.948324 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-oauth-serving-cert\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.049129 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.049096 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-oauth-config\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.049129 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.049137 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-serving-cert\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.049331 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.049154 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-service-ca\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.049371 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.049341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-config\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.049430 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.049411 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-trusted-ca-bundle\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.049490 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.049474 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpnwh\" (UniqueName: \"kubernetes.io/projected/c487c395-e0b6-4cc3-8458-c88f13e5e088-kube-api-access-fpnwh\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.049548 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.049507 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-oauth-serving-cert\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.049936 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.049909 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-service-ca\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.050073 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.050049 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-config\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.050150 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.050135 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-oauth-serving-cert\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.050232 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.050214 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-trusted-ca-bundle\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.052102 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.052083 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-serving-cert\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.052229 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.052209 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-oauth-config\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.057290 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.057268 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpnwh\" (UniqueName: \"kubernetes.io/projected/c487c395-e0b6-4cc3-8458-c88f13e5e088-kube-api-access-fpnwh\") pod \"console-7d4d68766b-z7rls\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.154962 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.154871 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:32.288688 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.288663 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d4d68766b-z7rls"] Aug 02 09:35:32.291399 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:35:32.291369 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc487c395_e0b6_4cc3_8458_c88f13e5e088.slice/crio-4276ce3785c85b8f145ac2667bb837e5874525ae92f76458c3579f16b4649220 WatchSource:0}: Error finding container 4276ce3785c85b8f145ac2667bb837e5874525ae92f76458c3579f16b4649220: Status 404 returned error can't find the container with id 4276ce3785c85b8f145ac2667bb837e5874525ae92f76458c3579f16b4649220 Aug 02 09:35:32.843409 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.843375 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4d68766b-z7rls" event={"ID":"c487c395-e0b6-4cc3-8458-c88f13e5e088","Type":"ContainerStarted","Data":"fae498f82fd3368c31afe5e46da9b64cf09ddcd7b6b963fedebde912afc1bec7"} Aug 02 09:35:32.843409 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.843424 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4d68766b-z7rls" event={"ID":"c487c395-e0b6-4cc3-8458-c88f13e5e088","Type":"ContainerStarted","Data":"4276ce3785c85b8f145ac2667bb837e5874525ae92f76458c3579f16b4649220"} Aug 02 09:35:32.859713 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:32.859663 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d4d68766b-z7rls" podStartSLOduration=1.859647801 podStartE2EDuration="1.859647801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:35:32.858758065 +0000 UTC m=+169.419913386" watchObservedRunningTime="2026-08-02 09:35:32.859647801 +0000 UTC m=+169.420803120" Aug 02 09:35:42.155329 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:42.155228 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:42.155329 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:42.155307 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:42.160075 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:42.160052 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:42.882904 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:42.882878 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:35:42.923644 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:35:42.923615 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75695568b7-ql6w6"] Aug 02 09:36:07.948814 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:07.948757 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75695568b7-ql6w6" podUID="b41d4bba-df97-4061-8192-47d9eb6d7f71" containerName="console" containerID="cri-o://f6f2ff4a254bb215727777165e4a61b40d8af511c40a7074bf4e71248cc54591" gracePeriod=15 Aug 02 09:36:08.190713 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.190687 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:36:08.323373 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.323340 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g7xp\" (UniqueName: \"kubernetes.io/projected/b41d4bba-df97-4061-8192-47d9eb6d7f71-kube-api-access-5g7xp\") pod \"b41d4bba-df97-4061-8192-47d9eb6d7f71\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " Aug 02 09:36:08.323534 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.323389 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-serving-cert\") pod \"b41d4bba-df97-4061-8192-47d9eb6d7f71\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " Aug 02 09:36:08.323534 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.323414 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-oauth-config\") pod \"b41d4bba-df97-4061-8192-47d9eb6d7f71\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " Aug 02 09:36:08.323534 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.323449 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-trusted-ca-bundle\") pod \"b41d4bba-df97-4061-8192-47d9eb6d7f71\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " Aug 02 09:36:08.323534 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.323470 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-config\") pod \"b41d4bba-df97-4061-8192-47d9eb6d7f71\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " Aug 02 09:36:08.323534 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.323501 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-oauth-serving-cert\") pod \"b41d4bba-df97-4061-8192-47d9eb6d7f71\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " Aug 02 09:36:08.323534 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.323530 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-service-ca\") pod \"b41d4bba-df97-4061-8192-47d9eb6d7f71\" (UID: \"b41d4bba-df97-4061-8192-47d9eb6d7f71\") " Aug 02 09:36:08.323991 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.323960 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-config" (OuterVolumeSpecName: "console-config") pod "b41d4bba-df97-4061-8192-47d9eb6d7f71" (UID: "b41d4bba-df97-4061-8192-47d9eb6d7f71"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:36:08.323991 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.323976 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b41d4bba-df97-4061-8192-47d9eb6d7f71" (UID: "b41d4bba-df97-4061-8192-47d9eb6d7f71"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:36:08.323991 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.323981 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b41d4bba-df97-4061-8192-47d9eb6d7f71" (UID: "b41d4bba-df97-4061-8192-47d9eb6d7f71"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:36:08.324183 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.324054 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-service-ca" (OuterVolumeSpecName: "service-ca") pod "b41d4bba-df97-4061-8192-47d9eb6d7f71" (UID: "b41d4bba-df97-4061-8192-47d9eb6d7f71"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:36:08.325496 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.325476 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b41d4bba-df97-4061-8192-47d9eb6d7f71" (UID: "b41d4bba-df97-4061-8192-47d9eb6d7f71"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:36:08.325566 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.325551 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b41d4bba-df97-4061-8192-47d9eb6d7f71" (UID: "b41d4bba-df97-4061-8192-47d9eb6d7f71"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:36:08.325612 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.325590 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b41d4bba-df97-4061-8192-47d9eb6d7f71-kube-api-access-5g7xp" (OuterVolumeSpecName: "kube-api-access-5g7xp") pod "b41d4bba-df97-4061-8192-47d9eb6d7f71" (UID: "b41d4bba-df97-4061-8192-47d9eb6d7f71"). InnerVolumeSpecName "kube-api-access-5g7xp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:36:08.424265 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.424230 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g7xp\" (UniqueName: \"kubernetes.io/projected/b41d4bba-df97-4061-8192-47d9eb6d7f71-kube-api-access-5g7xp\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:36:08.424265 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.424258 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-serving-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:36:08.424265 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.424268 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-oauth-config\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:36:08.424477 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.424276 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-trusted-ca-bundle\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:36:08.424477 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.424285 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-console-config\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:36:08.424477 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.424294 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-oauth-serving-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:36:08.424477 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.424302 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b41d4bba-df97-4061-8192-47d9eb6d7f71-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:36:08.975338 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.975302 2575 generic.go:356] "Generic (PLEG): container finished" podID="b41d4bba-df97-4061-8192-47d9eb6d7f71" containerID="f6f2ff4a254bb215727777165e4a61b40d8af511c40a7074bf4e71248cc54591" exitCode=0 Aug 02 09:36:08.975734 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.975347 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75695568b7-ql6w6" Aug 02 09:36:08.975734 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.975389 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75695568b7-ql6w6" event={"ID":"b41d4bba-df97-4061-8192-47d9eb6d7f71","Type":"ContainerDied","Data":"f6f2ff4a254bb215727777165e4a61b40d8af511c40a7074bf4e71248cc54591"} Aug 02 09:36:08.975734 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.975439 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75695568b7-ql6w6" event={"ID":"b41d4bba-df97-4061-8192-47d9eb6d7f71","Type":"ContainerDied","Data":"04f4e4263b9c5846534e8ba44e5785195322cd388e32f65047f455bf8a32a55c"} Aug 02 09:36:08.975734 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.975479 2575 scope.go:117] "RemoveContainer" containerID="f6f2ff4a254bb215727777165e4a61b40d8af511c40a7074bf4e71248cc54591" Aug 02 09:36:08.984275 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.984258 2575 scope.go:117] "RemoveContainer" containerID="f6f2ff4a254bb215727777165e4a61b40d8af511c40a7074bf4e71248cc54591" Aug 02 09:36:08.984508 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:36:08.984491 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6f2ff4a254bb215727777165e4a61b40d8af511c40a7074bf4e71248cc54591\": container with ID starting with f6f2ff4a254bb215727777165e4a61b40d8af511c40a7074bf4e71248cc54591 not found: ID does not exist" containerID="f6f2ff4a254bb215727777165e4a61b40d8af511c40a7074bf4e71248cc54591" Aug 02 09:36:08.984547 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.984518 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6f2ff4a254bb215727777165e4a61b40d8af511c40a7074bf4e71248cc54591"} err="failed to get container status \"f6f2ff4a254bb215727777165e4a61b40d8af511c40a7074bf4e71248cc54591\": rpc error: code = NotFound desc = could not find container \"f6f2ff4a254bb215727777165e4a61b40d8af511c40a7074bf4e71248cc54591\": container with ID starting with f6f2ff4a254bb215727777165e4a61b40d8af511c40a7074bf4e71248cc54591 not found: ID does not exist" Aug 02 09:36:08.994138 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.994116 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75695568b7-ql6w6"] Aug 02 09:36:08.996884 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:08.996865 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75695568b7-ql6w6"] Aug 02 09:36:09.954905 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:09.954873 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b41d4bba-df97-4061-8192-47d9eb6d7f71" path="/var/lib/kubelet/pods/b41d4bba-df97-4061-8192-47d9eb6d7f71/volumes" Aug 02 09:36:53.069885 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.069846 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-677d9bc96b-7b4g2"] Aug 02 09:36:53.070648 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.070376 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b41d4bba-df97-4061-8192-47d9eb6d7f71" containerName="console" Aug 02 09:36:53.070648 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.070415 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b41d4bba-df97-4061-8192-47d9eb6d7f71" containerName="console" Aug 02 09:36:53.070648 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.070494 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b41d4bba-df97-4061-8192-47d9eb6d7f71" containerName="console" Aug 02 09:36:53.077971 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.077949 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.085421 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.085398 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677d9bc96b-7b4g2"] Aug 02 09:36:53.161854 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.161816 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-serving-cert\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.161854 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.161859 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-trusted-ca-bundle\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.162069 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.161878 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-service-ca\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.162069 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.161943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-oauth-config\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.162069 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.161974 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-oauth-serving-cert\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.162069 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.161998 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb7nq\" (UniqueName: \"kubernetes.io/projected/91988a50-00a0-4939-b50f-8480f1d0e7e5-kube-api-access-pb7nq\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.162069 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.162026 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-config\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.263004 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.262968 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-service-ca\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.263004 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.263005 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-oauth-config\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.263306 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.263022 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-oauth-serving-cert\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.263306 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.263047 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb7nq\" (UniqueName: \"kubernetes.io/projected/91988a50-00a0-4939-b50f-8480f1d0e7e5-kube-api-access-pb7nq\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.263306 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.263084 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-config\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.263306 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.263137 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-serving-cert\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.263306 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.263171 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-trusted-ca-bundle\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.263856 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.263828 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-service-ca\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.263953 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.263832 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-oauth-serving-cert\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.263953 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.263886 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-config\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.264102 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.264080 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-trusted-ca-bundle\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.265541 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.265519 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-oauth-config\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.265802 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.265764 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-serving-cert\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.273295 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.273268 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb7nq\" (UniqueName: \"kubernetes.io/projected/91988a50-00a0-4939-b50f-8480f1d0e7e5-kube-api-access-pb7nq\") pod \"console-677d9bc96b-7b4g2\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.389135 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.389041 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:36:53.519808 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:53.519643 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677d9bc96b-7b4g2"] Aug 02 09:36:53.522443 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:36:53.522418 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91988a50_00a0_4939_b50f_8480f1d0e7e5.slice/crio-5e9c5bd4414f9eb2ec480df7d9a6d19caef2eda969085bea027cf40666c28b3c WatchSource:0}: Error finding container 5e9c5bd4414f9eb2ec480df7d9a6d19caef2eda969085bea027cf40666c28b3c: Status 404 returned error can't find the container with id 5e9c5bd4414f9eb2ec480df7d9a6d19caef2eda969085bea027cf40666c28b3c Aug 02 09:36:54.138527 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:54.138482 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677d9bc96b-7b4g2" event={"ID":"91988a50-00a0-4939-b50f-8480f1d0e7e5","Type":"ContainerStarted","Data":"3b909b4ab3d86ff4c6c96317db1f7887d35ebb63c51f3ca8c314cb449afdf025"} Aug 02 09:36:54.138942 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:54.138540 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677d9bc96b-7b4g2" event={"ID":"91988a50-00a0-4939-b50f-8480f1d0e7e5","Type":"ContainerStarted","Data":"5e9c5bd4414f9eb2ec480df7d9a6d19caef2eda969085bea027cf40666c28b3c"} Aug 02 09:36:54.155420 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:36:54.155372 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-677d9bc96b-7b4g2" podStartSLOduration=1.155356211 podStartE2EDuration="1.155356211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:36:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:36:54.153928921 +0000 UTC m=+250.715084261" watchObservedRunningTime="2026-08-02 09:36:54.155356211 +0000 UTC m=+250.716511575" Aug 02 09:37:03.389223 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:03.389185 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:37:03.389638 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:03.389269 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:37:03.394107 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:03.394083 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:37:04.178298 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:04.178270 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:37:04.219307 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:04.219268 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d4d68766b-z7rls"] Aug 02 09:37:29.241362 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.241300 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d4d68766b-z7rls" podUID="c487c395-e0b6-4cc3-8458-c88f13e5e088" containerName="console" containerID="cri-o://fae498f82fd3368c31afe5e46da9b64cf09ddcd7b6b963fedebde912afc1bec7" gracePeriod=15 Aug 02 09:37:29.480868 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.480841 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:37:29.673144 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.673107 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-oauth-serving-cert\") pod \"c487c395-e0b6-4cc3-8458-c88f13e5e088\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " Aug 02 09:37:29.673358 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.673191 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpnwh\" (UniqueName: \"kubernetes.io/projected/c487c395-e0b6-4cc3-8458-c88f13e5e088-kube-api-access-fpnwh\") pod \"c487c395-e0b6-4cc3-8458-c88f13e5e088\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " Aug 02 09:37:29.673358 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.673234 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-serving-cert\") pod \"c487c395-e0b6-4cc3-8458-c88f13e5e088\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " Aug 02 09:37:29.673358 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.673271 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-oauth-config\") pod \"c487c395-e0b6-4cc3-8458-c88f13e5e088\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " Aug 02 09:37:29.673358 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.673321 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-trusted-ca-bundle\") pod \"c487c395-e0b6-4cc3-8458-c88f13e5e088\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " Aug 02 09:37:29.673358 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.673348 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-service-ca\") pod \"c487c395-e0b6-4cc3-8458-c88f13e5e088\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " Aug 02 09:37:29.673609 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.673372 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-config\") pod \"c487c395-e0b6-4cc3-8458-c88f13e5e088\" (UID: \"c487c395-e0b6-4cc3-8458-c88f13e5e088\") " Aug 02 09:37:29.673609 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.673532 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c487c395-e0b6-4cc3-8458-c88f13e5e088" (UID: "c487c395-e0b6-4cc3-8458-c88f13e5e088"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:37:29.673868 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.673837 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-service-ca" (OuterVolumeSpecName: "service-ca") pod "c487c395-e0b6-4cc3-8458-c88f13e5e088" (UID: "c487c395-e0b6-4cc3-8458-c88f13e5e088"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:37:29.673868 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.673854 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c487c395-e0b6-4cc3-8458-c88f13e5e088" (UID: "c487c395-e0b6-4cc3-8458-c88f13e5e088"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:37:29.674032 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.673995 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-config" (OuterVolumeSpecName: "console-config") pod "c487c395-e0b6-4cc3-8458-c88f13e5e088" (UID: "c487c395-e0b6-4cc3-8458-c88f13e5e088"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:37:29.675497 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.675474 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c487c395-e0b6-4cc3-8458-c88f13e5e088" (UID: "c487c395-e0b6-4cc3-8458-c88f13e5e088"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:37:29.675568 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.675516 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c487c395-e0b6-4cc3-8458-c88f13e5e088-kube-api-access-fpnwh" (OuterVolumeSpecName: "kube-api-access-fpnwh") pod "c487c395-e0b6-4cc3-8458-c88f13e5e088" (UID: "c487c395-e0b6-4cc3-8458-c88f13e5e088"). InnerVolumeSpecName "kube-api-access-fpnwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:37:29.675607 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.675561 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c487c395-e0b6-4cc3-8458-c88f13e5e088" (UID: "c487c395-e0b6-4cc3-8458-c88f13e5e088"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:37:29.774631 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.774590 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpnwh\" (UniqueName: \"kubernetes.io/projected/c487c395-e0b6-4cc3-8458-c88f13e5e088-kube-api-access-fpnwh\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:37:29.774631 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.774622 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-serving-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:37:29.774631 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.774635 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-oauth-config\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:37:29.774937 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.774647 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-trusted-ca-bundle\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:37:29.774937 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.774658 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:37:29.774937 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.774670 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-console-config\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:37:29.774937 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:29.774682 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c487c395-e0b6-4cc3-8458-c88f13e5e088-oauth-serving-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:37:30.272835 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:30.272725 2575 generic.go:356] "Generic (PLEG): container finished" podID="c487c395-e0b6-4cc3-8458-c88f13e5e088" containerID="fae498f82fd3368c31afe5e46da9b64cf09ddcd7b6b963fedebde912afc1bec7" exitCode=0 Aug 02 09:37:30.272835 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:30.272765 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4d68766b-z7rls" Aug 02 09:37:30.272835 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:30.272813 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4d68766b-z7rls" event={"ID":"c487c395-e0b6-4cc3-8458-c88f13e5e088","Type":"ContainerDied","Data":"fae498f82fd3368c31afe5e46da9b64cf09ddcd7b6b963fedebde912afc1bec7"} Aug 02 09:37:30.273329 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:30.272873 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4d68766b-z7rls" event={"ID":"c487c395-e0b6-4cc3-8458-c88f13e5e088","Type":"ContainerDied","Data":"4276ce3785c85b8f145ac2667bb837e5874525ae92f76458c3579f16b4649220"} Aug 02 09:37:30.273329 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:30.272900 2575 scope.go:117] "RemoveContainer" containerID="fae498f82fd3368c31afe5e46da9b64cf09ddcd7b6b963fedebde912afc1bec7" Aug 02 09:37:30.280942 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:30.280927 2575 scope.go:117] "RemoveContainer" containerID="fae498f82fd3368c31afe5e46da9b64cf09ddcd7b6b963fedebde912afc1bec7" Aug 02 09:37:30.281161 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:37:30.281144 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fae498f82fd3368c31afe5e46da9b64cf09ddcd7b6b963fedebde912afc1bec7\": container with ID starting with fae498f82fd3368c31afe5e46da9b64cf09ddcd7b6b963fedebde912afc1bec7 not found: ID does not exist" containerID="fae498f82fd3368c31afe5e46da9b64cf09ddcd7b6b963fedebde912afc1bec7" Aug 02 09:37:30.281214 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:30.281170 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fae498f82fd3368c31afe5e46da9b64cf09ddcd7b6b963fedebde912afc1bec7"} err="failed to get container status \"fae498f82fd3368c31afe5e46da9b64cf09ddcd7b6b963fedebde912afc1bec7\": rpc error: code = NotFound desc = could not find container \"fae498f82fd3368c31afe5e46da9b64cf09ddcd7b6b963fedebde912afc1bec7\": container with ID starting with fae498f82fd3368c31afe5e46da9b64cf09ddcd7b6b963fedebde912afc1bec7 not found: ID does not exist" Aug 02 09:37:30.287123 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:30.287101 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d4d68766b-z7rls"] Aug 02 09:37:30.290298 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:30.290280 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d4d68766b-z7rls"] Aug 02 09:37:31.955042 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:31.955006 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c487c395-e0b6-4cc3-8458-c88f13e5e088" path="/var/lib/kubelet/pods/c487c395-e0b6-4cc3-8458-c88f13e5e088/volumes" Aug 02 09:37:43.856876 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:43.856838 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 09:37:43.860397 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:43.860373 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 09:37:43.863620 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:43.863602 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 09:37:43.867410 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:43.867391 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 09:37:43.867967 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:43.867943 2575 kubelet.go:1648] "Image garbage collection succeeded" Aug 02 09:37:46.550217 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.550179 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr"] Aug 02 09:37:46.552642 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.550589 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c487c395-e0b6-4cc3-8458-c88f13e5e088" containerName="console" Aug 02 09:37:46.552642 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.550608 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c487c395-e0b6-4cc3-8458-c88f13e5e088" containerName="console" Aug 02 09:37:46.552642 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.550692 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c487c395-e0b6-4cc3-8458-c88f13e5e088" containerName="console" Aug 02 09:37:46.553645 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.553625 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" Aug 02 09:37:46.556029 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.556005 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 02 09:37:46.556136 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.556102 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 02 09:37:46.556671 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.556657 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cv7v4\"" Aug 02 09:37:46.561619 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.561588 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr"] Aug 02 09:37:46.597902 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.597871 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e694971-21a8-4271-ba1d-ce8735d3bc34-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr\" (UID: \"4e694971-21a8-4271-ba1d-ce8735d3bc34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" Aug 02 09:37:46.598089 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.597909 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjnct\" (UniqueName: \"kubernetes.io/projected/4e694971-21a8-4271-ba1d-ce8735d3bc34-kube-api-access-qjnct\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr\" (UID: \"4e694971-21a8-4271-ba1d-ce8735d3bc34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" Aug 02 09:37:46.598089 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.597933 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e694971-21a8-4271-ba1d-ce8735d3bc34-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr\" (UID: \"4e694971-21a8-4271-ba1d-ce8735d3bc34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" Aug 02 09:37:46.698925 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.698882 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjnct\" (UniqueName: \"kubernetes.io/projected/4e694971-21a8-4271-ba1d-ce8735d3bc34-kube-api-access-qjnct\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr\" (UID: \"4e694971-21a8-4271-ba1d-ce8735d3bc34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" Aug 02 09:37:46.699104 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.698930 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e694971-21a8-4271-ba1d-ce8735d3bc34-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr\" (UID: \"4e694971-21a8-4271-ba1d-ce8735d3bc34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" Aug 02 09:37:46.699104 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.699021 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e694971-21a8-4271-ba1d-ce8735d3bc34-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr\" (UID: \"4e694971-21a8-4271-ba1d-ce8735d3bc34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" Aug 02 09:37:46.699345 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.699324 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e694971-21a8-4271-ba1d-ce8735d3bc34-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr\" (UID: \"4e694971-21a8-4271-ba1d-ce8735d3bc34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" Aug 02 09:37:46.699412 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.699394 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e694971-21a8-4271-ba1d-ce8735d3bc34-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr\" (UID: \"4e694971-21a8-4271-ba1d-ce8735d3bc34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" Aug 02 09:37:46.707578 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.707556 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjnct\" (UniqueName: \"kubernetes.io/projected/4e694971-21a8-4271-ba1d-ce8735d3bc34-kube-api-access-qjnct\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr\" (UID: \"4e694971-21a8-4271-ba1d-ce8735d3bc34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" Aug 02 09:37:46.863220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.863134 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" Aug 02 09:37:46.988506 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.988481 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr"] Aug 02 09:37:46.990189 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:37:46.990166 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e694971_21a8_4271_ba1d_ce8735d3bc34.slice/crio-3982776b9ace441fac7505d31637f7358732dcfcfcb6a579e0d3d531c8e1f6aa WatchSource:0}: Error finding container 3982776b9ace441fac7505d31637f7358732dcfcfcb6a579e0d3d531c8e1f6aa: Status 404 returned error can't find the container with id 3982776b9ace441fac7505d31637f7358732dcfcfcb6a579e0d3d531c8e1f6aa Aug 02 09:37:46.992250 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:46.992233 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 02 09:37:47.337503 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:47.337472 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" event={"ID":"4e694971-21a8-4271-ba1d-ce8735d3bc34","Type":"ContainerStarted","Data":"3982776b9ace441fac7505d31637f7358732dcfcfcb6a579e0d3d531c8e1f6aa"} Aug 02 09:37:53.363075 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:53.363034 2575 generic.go:356] "Generic (PLEG): container finished" podID="4e694971-21a8-4271-ba1d-ce8735d3bc34" containerID="482a73e645319f5857cf656a14462a48f6cbcf331e30d7fb5b9c332f3e5839f9" exitCode=0 Aug 02 09:37:53.363542 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:53.363081 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" event={"ID":"4e694971-21a8-4271-ba1d-ce8735d3bc34","Type":"ContainerDied","Data":"482a73e645319f5857cf656a14462a48f6cbcf331e30d7fb5b9c332f3e5839f9"} Aug 02 09:37:56.376825 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:56.376766 2575 generic.go:356] "Generic (PLEG): container finished" podID="4e694971-21a8-4271-ba1d-ce8735d3bc34" containerID="9759c771afe9df7a32d7892c77bc59fea8b139c6e4a1f29dc936ac7059202e25" exitCode=0 Aug 02 09:37:56.376825 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:37:56.376807 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" event={"ID":"4e694971-21a8-4271-ba1d-ce8735d3bc34","Type":"ContainerDied","Data":"9759c771afe9df7a32d7892c77bc59fea8b139c6e4a1f29dc936ac7059202e25"} Aug 02 09:38:04.410549 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:04.410513 2575 generic.go:356] "Generic (PLEG): container finished" podID="4e694971-21a8-4271-ba1d-ce8735d3bc34" containerID="1e3bca610eb78e8ec968898f9d6e2ccc5f43f1917084007a625bbc1a6c316eed" exitCode=0 Aug 02 09:38:04.410969 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:04.410581 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" event={"ID":"4e694971-21a8-4271-ba1d-ce8735d3bc34","Type":"ContainerDied","Data":"1e3bca610eb78e8ec968898f9d6e2ccc5f43f1917084007a625bbc1a6c316eed"} Aug 02 09:38:05.537508 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:05.537484 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" Aug 02 09:38:05.668410 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:05.668329 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e694971-21a8-4271-ba1d-ce8735d3bc34-bundle\") pod \"4e694971-21a8-4271-ba1d-ce8735d3bc34\" (UID: \"4e694971-21a8-4271-ba1d-ce8735d3bc34\") " Aug 02 09:38:05.668563 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:05.668427 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjnct\" (UniqueName: \"kubernetes.io/projected/4e694971-21a8-4271-ba1d-ce8735d3bc34-kube-api-access-qjnct\") pod \"4e694971-21a8-4271-ba1d-ce8735d3bc34\" (UID: \"4e694971-21a8-4271-ba1d-ce8735d3bc34\") " Aug 02 09:38:05.668563 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:05.668454 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e694971-21a8-4271-ba1d-ce8735d3bc34-util\") pod \"4e694971-21a8-4271-ba1d-ce8735d3bc34\" (UID: \"4e694971-21a8-4271-ba1d-ce8735d3bc34\") " Aug 02 09:38:05.669119 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:05.669087 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e694971-21a8-4271-ba1d-ce8735d3bc34-bundle" (OuterVolumeSpecName: "bundle") pod "4e694971-21a8-4271-ba1d-ce8735d3bc34" (UID: "4e694971-21a8-4271-ba1d-ce8735d3bc34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:38:05.670641 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:05.670613 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e694971-21a8-4271-ba1d-ce8735d3bc34-kube-api-access-qjnct" (OuterVolumeSpecName: "kube-api-access-qjnct") pod "4e694971-21a8-4271-ba1d-ce8735d3bc34" (UID: "4e694971-21a8-4271-ba1d-ce8735d3bc34"). InnerVolumeSpecName "kube-api-access-qjnct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:38:05.672769 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:05.672743 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e694971-21a8-4271-ba1d-ce8735d3bc34-util" (OuterVolumeSpecName: "util") pod "4e694971-21a8-4271-ba1d-ce8735d3bc34" (UID: "4e694971-21a8-4271-ba1d-ce8735d3bc34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:38:05.769110 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:05.769081 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjnct\" (UniqueName: \"kubernetes.io/projected/4e694971-21a8-4271-ba1d-ce8735d3bc34-kube-api-access-qjnct\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:38:05.769110 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:05.769108 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e694971-21a8-4271-ba1d-ce8735d3bc34-util\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:38:05.769110 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:05.769117 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e694971-21a8-4271-ba1d-ce8735d3bc34-bundle\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:38:06.419446 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:06.419420 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" Aug 02 09:38:06.419446 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:06.419442 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4jvr" event={"ID":"4e694971-21a8-4271-ba1d-ce8735d3bc34","Type":"ContainerDied","Data":"3982776b9ace441fac7505d31637f7358732dcfcfcb6a579e0d3d531c8e1f6aa"} Aug 02 09:38:06.419807 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:06.419485 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3982776b9ace441fac7505d31637f7358732dcfcfcb6a579e0d3d531c8e1f6aa" Aug 02 09:38:09.422715 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.422685 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5jbw"] Aug 02 09:38:09.423117 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.422970 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e694971-21a8-4271-ba1d-ce8735d3bc34" containerName="extract" Aug 02 09:38:09.423117 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.422981 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e694971-21a8-4271-ba1d-ce8735d3bc34" containerName="extract" Aug 02 09:38:09.423117 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.422988 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e694971-21a8-4271-ba1d-ce8735d3bc34" containerName="util" Aug 02 09:38:09.423117 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.422993 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e694971-21a8-4271-ba1d-ce8735d3bc34" containerName="util" Aug 02 09:38:09.423117 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.423002 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e694971-21a8-4271-ba1d-ce8735d3bc34" containerName="pull" Aug 02 09:38:09.423117 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.423007 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e694971-21a8-4271-ba1d-ce8735d3bc34" containerName="pull" Aug 02 09:38:09.423117 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.423053 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e694971-21a8-4271-ba1d-ce8735d3bc34" containerName="extract" Aug 02 09:38:09.425048 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.425029 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5jbw" Aug 02 09:38:09.427522 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.427498 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Aug 02 09:38:09.427662 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.427565 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Aug 02 09:38:09.427662 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.427606 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xz8zm\"" Aug 02 09:38:09.438342 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.438312 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5jbw"] Aug 02 09:38:09.496247 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.496212 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwfhq\" (UniqueName: \"kubernetes.io/projected/b9a70252-8968-497e-b047-02dc0f2d7792-kube-api-access-kwfhq\") pod \"cert-manager-operator-controller-manager-55c444bf86-x5jbw\" (UID: \"b9a70252-8968-497e-b047-02dc0f2d7792\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5jbw" Aug 02 09:38:09.496397 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.496293 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9a70252-8968-497e-b047-02dc0f2d7792-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-x5jbw\" (UID: \"b9a70252-8968-497e-b047-02dc0f2d7792\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5jbw" Aug 02 09:38:09.596710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.596679 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9a70252-8968-497e-b047-02dc0f2d7792-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-x5jbw\" (UID: \"b9a70252-8968-497e-b047-02dc0f2d7792\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5jbw" Aug 02 09:38:09.596863 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.596738 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwfhq\" (UniqueName: \"kubernetes.io/projected/b9a70252-8968-497e-b047-02dc0f2d7792-kube-api-access-kwfhq\") pod \"cert-manager-operator-controller-manager-55c444bf86-x5jbw\" (UID: \"b9a70252-8968-497e-b047-02dc0f2d7792\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5jbw" Aug 02 09:38:09.597084 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.597063 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9a70252-8968-497e-b047-02dc0f2d7792-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-x5jbw\" (UID: \"b9a70252-8968-497e-b047-02dc0f2d7792\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5jbw" Aug 02 09:38:09.608273 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.608251 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwfhq\" (UniqueName: \"kubernetes.io/projected/b9a70252-8968-497e-b047-02dc0f2d7792-kube-api-access-kwfhq\") pod \"cert-manager-operator-controller-manager-55c444bf86-x5jbw\" (UID: \"b9a70252-8968-497e-b047-02dc0f2d7792\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5jbw" Aug 02 09:38:09.734482 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.734410 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5jbw" Aug 02 09:38:09.863888 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:09.863865 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5jbw"] Aug 02 09:38:09.866843 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:38:09.866813 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a70252_8968_497e_b047_02dc0f2d7792.slice/crio-6fb4bdbd55a11e1b57d611c6b3c68aa55dd8125113f3ccfa4d4182aa6c567865 WatchSource:0}: Error finding container 6fb4bdbd55a11e1b57d611c6b3c68aa55dd8125113f3ccfa4d4182aa6c567865: Status 404 returned error can't find the container with id 6fb4bdbd55a11e1b57d611c6b3c68aa55dd8125113f3ccfa4d4182aa6c567865 Aug 02 09:38:10.436114 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:10.436078 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5jbw" event={"ID":"b9a70252-8968-497e-b047-02dc0f2d7792","Type":"ContainerStarted","Data":"6fb4bdbd55a11e1b57d611c6b3c68aa55dd8125113f3ccfa4d4182aa6c567865"} Aug 02 09:38:12.446180 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:12.446133 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5jbw" event={"ID":"b9a70252-8968-497e-b047-02dc0f2d7792","Type":"ContainerStarted","Data":"d8fcb5ec4814cd1125ff0a87d63cbd5aebed80795759803380e8797856f6dc98"} Aug 02 09:38:12.466538 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:12.466492 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5jbw" podStartSLOduration=1.75743776 podStartE2EDuration="3.466475421s" totalImagesPullingTime="1.709037661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:38:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:38:12.464618068 +0000 UTC m=+329.025773389" watchObservedRunningTime="2026-08-02 09:38:12.466475421 +0000 UTC m=+329.027630748" Aug 02 09:38:13.373967 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.373934 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf"] Aug 02 09:38:13.377347 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.377332 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" Aug 02 09:38:13.379739 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.379722 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cv7v4\"" Aug 02 09:38:13.379824 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.379736 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 02 09:38:13.380880 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.380857 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 02 09:38:13.385643 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.385622 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf"] Aug 02 09:38:13.500886 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.500848 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xphfp"] Aug 02 09:38:13.504007 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.503991 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xphfp" Aug 02 09:38:13.506085 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.506066 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-thbvk\"" Aug 02 09:38:13.506304 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.506286 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Aug 02 09:38:13.506355 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.506286 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Aug 02 09:38:13.513438 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.513418 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xphfp"] Aug 02 09:38:13.529710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.529679 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb0d07d2-2e82-4928-948f-87a34e3dec24-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf\" (UID: \"cb0d07d2-2e82-4928-948f-87a34e3dec24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" Aug 02 09:38:13.529859 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.529742 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb0d07d2-2e82-4928-948f-87a34e3dec24-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf\" (UID: \"cb0d07d2-2e82-4928-948f-87a34e3dec24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" Aug 02 09:38:13.529859 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.529771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4dvt\" (UniqueName: \"kubernetes.io/projected/cb0d07d2-2e82-4928-948f-87a34e3dec24-kube-api-access-s4dvt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf\" (UID: \"cb0d07d2-2e82-4928-948f-87a34e3dec24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" Aug 02 09:38:13.631077 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.630997 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7c8866b-105d-4625-905e-504c47080a52-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xphfp\" (UID: \"c7c8866b-105d-4625-905e-504c47080a52\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xphfp" Aug 02 09:38:13.631077 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.631039 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb0d07d2-2e82-4928-948f-87a34e3dec24-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf\" (UID: \"cb0d07d2-2e82-4928-948f-87a34e3dec24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" Aug 02 09:38:13.631077 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.631075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhtvk\" (UniqueName: \"kubernetes.io/projected/c7c8866b-105d-4625-905e-504c47080a52-kube-api-access-xhtvk\") pod \"cert-manager-webhook-6486ffd997-xphfp\" (UID: \"c7c8866b-105d-4625-905e-504c47080a52\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xphfp" Aug 02 09:38:13.631324 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.631102 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb0d07d2-2e82-4928-948f-87a34e3dec24-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf\" (UID: \"cb0d07d2-2e82-4928-948f-87a34e3dec24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" Aug 02 09:38:13.631324 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.631120 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4dvt\" (UniqueName: \"kubernetes.io/projected/cb0d07d2-2e82-4928-948f-87a34e3dec24-kube-api-access-s4dvt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf\" (UID: \"cb0d07d2-2e82-4928-948f-87a34e3dec24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" Aug 02 09:38:13.631440 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.631364 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb0d07d2-2e82-4928-948f-87a34e3dec24-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf\" (UID: \"cb0d07d2-2e82-4928-948f-87a34e3dec24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" Aug 02 09:38:13.631496 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.631466 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb0d07d2-2e82-4928-948f-87a34e3dec24-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf\" (UID: \"cb0d07d2-2e82-4928-948f-87a34e3dec24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" Aug 02 09:38:13.638603 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.638579 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4dvt\" (UniqueName: \"kubernetes.io/projected/cb0d07d2-2e82-4928-948f-87a34e3dec24-kube-api-access-s4dvt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf\" (UID: \"cb0d07d2-2e82-4928-948f-87a34e3dec24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" Aug 02 09:38:13.686708 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.686681 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" Aug 02 09:38:13.731972 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.731935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7c8866b-105d-4625-905e-504c47080a52-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xphfp\" (UID: \"c7c8866b-105d-4625-905e-504c47080a52\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xphfp" Aug 02 09:38:13.732121 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.732031 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhtvk\" (UniqueName: \"kubernetes.io/projected/c7c8866b-105d-4625-905e-504c47080a52-kube-api-access-xhtvk\") pod \"cert-manager-webhook-6486ffd997-xphfp\" (UID: \"c7c8866b-105d-4625-905e-504c47080a52\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xphfp" Aug 02 09:38:13.741379 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.741325 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7c8866b-105d-4625-905e-504c47080a52-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xphfp\" (UID: \"c7c8866b-105d-4625-905e-504c47080a52\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xphfp" Aug 02 09:38:13.742171 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.742139 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhtvk\" (UniqueName: \"kubernetes.io/projected/c7c8866b-105d-4625-905e-504c47080a52-kube-api-access-xhtvk\") pod \"cert-manager-webhook-6486ffd997-xphfp\" (UID: \"c7c8866b-105d-4625-905e-504c47080a52\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xphfp" Aug 02 09:38:13.822785 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.822747 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf"] Aug 02 09:38:13.824679 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.824648 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xphfp" Aug 02 09:38:13.824812 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:38:13.824712 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb0d07d2_2e82_4928_948f_87a34e3dec24.slice/crio-8666bf6ade12f2818d5449c4feabffe6d9797d986bf72bad5d9f47ec7e39245e WatchSource:0}: Error finding container 8666bf6ade12f2818d5449c4feabffe6d9797d986bf72bad5d9f47ec7e39245e: Status 404 returned error can't find the container with id 8666bf6ade12f2818d5449c4feabffe6d9797d986bf72bad5d9f47ec7e39245e Aug 02 09:38:13.956270 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:13.956250 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xphfp"] Aug 02 09:38:13.989730 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:38:13.989703 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7c8866b_105d_4625_905e_504c47080a52.slice/crio-1fae49251aba940a7b6a7206347a9d976c73ab799f4e878269bb69e7deff7f12 WatchSource:0}: Error finding container 1fae49251aba940a7b6a7206347a9d976c73ab799f4e878269bb69e7deff7f12: Status 404 returned error can't find the container with id 1fae49251aba940a7b6a7206347a9d976c73ab799f4e878269bb69e7deff7f12 Aug 02 09:38:14.456644 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:14.456615 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xphfp" event={"ID":"c7c8866b-105d-4625-905e-504c47080a52","Type":"ContainerStarted","Data":"1fae49251aba940a7b6a7206347a9d976c73ab799f4e878269bb69e7deff7f12"} Aug 02 09:38:14.458079 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:14.458052 2575 generic.go:356] "Generic (PLEG): container finished" podID="cb0d07d2-2e82-4928-948f-87a34e3dec24" containerID="db3800ee38dc58b328ce4c3ed191a1f22449ae7856f99097147176bf2794d74d" exitCode=0 Aug 02 09:38:14.458173 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:14.458094 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" event={"ID":"cb0d07d2-2e82-4928-948f-87a34e3dec24","Type":"ContainerDied","Data":"db3800ee38dc58b328ce4c3ed191a1f22449ae7856f99097147176bf2794d74d"} Aug 02 09:38:14.458173 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:14.458122 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" event={"ID":"cb0d07d2-2e82-4928-948f-87a34e3dec24","Type":"ContainerStarted","Data":"8666bf6ade12f2818d5449c4feabffe6d9797d986bf72bad5d9f47ec7e39245e"} Aug 02 09:38:25.511109 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:25.511074 2575 generic.go:356] "Generic (PLEG): container finished" podID="cb0d07d2-2e82-4928-948f-87a34e3dec24" containerID="fb06d87ebf44b09e8ae062dec5bd28ef863400dded6375ebccfd1fa2bafad630" exitCode=0 Aug 02 09:38:25.511580 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:25.511163 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" event={"ID":"cb0d07d2-2e82-4928-948f-87a34e3dec24","Type":"ContainerDied","Data":"fb06d87ebf44b09e8ae062dec5bd28ef863400dded6375ebccfd1fa2bafad630"} Aug 02 09:38:26.518737 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:26.518703 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" event={"ID":"cb0d07d2-2e82-4928-948f-87a34e3dec24","Type":"ContainerStarted","Data":"e700342b04a3df4b349a85308ecd6e9055539f099483b147aa0f0b8109b2c94c"} Aug 02 09:38:26.535750 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:26.535687 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" podStartSLOduration=3.3804165250000002 podStartE2EDuration="13.535660272s" totalImagesPullingTime="10.155243747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:38:26.534687787 +0000 UTC m=+343.095843108" watchObservedRunningTime="2026-08-02 09:38:26.535660272 +0000 UTC m=+343.096815593" Aug 02 09:38:27.529202 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:27.529165 2575 generic.go:356] "Generic (PLEG): container finished" podID="cb0d07d2-2e82-4928-948f-87a34e3dec24" containerID="e700342b04a3df4b349a85308ecd6e9055539f099483b147aa0f0b8109b2c94c" exitCode=0 Aug 02 09:38:27.529619 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:27.529259 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" event={"ID":"cb0d07d2-2e82-4928-948f-87a34e3dec24","Type":"ContainerDied","Data":"e700342b04a3df4b349a85308ecd6e9055539f099483b147aa0f0b8109b2c94c"} Aug 02 09:38:27.530759 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:27.530736 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xphfp" event={"ID":"c7c8866b-105d-4625-905e-504c47080a52","Type":"ContainerStarted","Data":"4c52a457be8ad56bba83aa0fe75da42bec2e8bf11b930f9dd93fcc4317dee0f7"} Aug 02 09:38:27.530877 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:27.530798 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xphfp" Aug 02 09:38:27.559040 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:27.558998 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xphfp" podStartSLOduration=1.9334519129999999 podStartE2EDuration="14.558984175s" totalImagesPullingTime="12.625532262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:38:27.557685188 +0000 UTC m=+344.118840509" watchObservedRunningTime="2026-08-02 09:38:27.558984175 +0000 UTC m=+344.120139495" Aug 02 09:38:28.659710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:28.659687 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" Aug 02 09:38:28.749751 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:28.749716 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4dvt\" (UniqueName: \"kubernetes.io/projected/cb0d07d2-2e82-4928-948f-87a34e3dec24-kube-api-access-s4dvt\") pod \"cb0d07d2-2e82-4928-948f-87a34e3dec24\" (UID: \"cb0d07d2-2e82-4928-948f-87a34e3dec24\") " Aug 02 09:38:28.749971 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:28.749813 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb0d07d2-2e82-4928-948f-87a34e3dec24-bundle\") pod \"cb0d07d2-2e82-4928-948f-87a34e3dec24\" (UID: \"cb0d07d2-2e82-4928-948f-87a34e3dec24\") " Aug 02 09:38:28.749971 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:28.749860 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb0d07d2-2e82-4928-948f-87a34e3dec24-util\") pod \"cb0d07d2-2e82-4928-948f-87a34e3dec24\" (UID: \"cb0d07d2-2e82-4928-948f-87a34e3dec24\") " Aug 02 09:38:28.750220 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:28.750198 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb0d07d2-2e82-4928-948f-87a34e3dec24-bundle" (OuterVolumeSpecName: "bundle") pod "cb0d07d2-2e82-4928-948f-87a34e3dec24" (UID: "cb0d07d2-2e82-4928-948f-87a34e3dec24"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:38:28.751892 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:28.751867 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb0d07d2-2e82-4928-948f-87a34e3dec24-kube-api-access-s4dvt" (OuterVolumeSpecName: "kube-api-access-s4dvt") pod "cb0d07d2-2e82-4928-948f-87a34e3dec24" (UID: "cb0d07d2-2e82-4928-948f-87a34e3dec24"). InnerVolumeSpecName "kube-api-access-s4dvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:38:28.754488 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:28.754462 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb0d07d2-2e82-4928-948f-87a34e3dec24-util" (OuterVolumeSpecName: "util") pod "cb0d07d2-2e82-4928-948f-87a34e3dec24" (UID: "cb0d07d2-2e82-4928-948f-87a34e3dec24"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:38:28.850669 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:28.850636 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb0d07d2-2e82-4928-948f-87a34e3dec24-bundle\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:38:28.850669 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:28.850668 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb0d07d2-2e82-4928-948f-87a34e3dec24-util\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:38:28.850885 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:28.850680 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4dvt\" (UniqueName: \"kubernetes.io/projected/cb0d07d2-2e82-4928-948f-87a34e3dec24-kube-api-access-s4dvt\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:38:29.541466 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:29.541437 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" Aug 02 09:38:29.541664 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:29.541443 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdmwrf" event={"ID":"cb0d07d2-2e82-4928-948f-87a34e3dec24","Type":"ContainerDied","Data":"8666bf6ade12f2818d5449c4feabffe6d9797d986bf72bad5d9f47ec7e39245e"} Aug 02 09:38:29.541664 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:29.541547 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8666bf6ade12f2818d5449c4feabffe6d9797d986bf72bad5d9f47ec7e39245e" Aug 02 09:38:33.537072 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:33.537041 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xphfp" Aug 02 09:38:33.956037 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:33.956008 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mlr67"] Aug 02 09:38:33.956303 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:33.956290 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb0d07d2-2e82-4928-948f-87a34e3dec24" containerName="util" Aug 02 09:38:33.956348 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:33.956305 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb0d07d2-2e82-4928-948f-87a34e3dec24" containerName="util" Aug 02 09:38:33.956348 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:33.956318 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb0d07d2-2e82-4928-948f-87a34e3dec24" containerName="pull" Aug 02 09:38:33.956348 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:33.956324 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb0d07d2-2e82-4928-948f-87a34e3dec24" containerName="pull" Aug 02 09:38:33.956348 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:33.956331 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb0d07d2-2e82-4928-948f-87a34e3dec24" containerName="extract" Aug 02 09:38:33.956348 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:33.956337 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb0d07d2-2e82-4928-948f-87a34e3dec24" containerName="extract" Aug 02 09:38:33.956498 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:33.956393 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb0d07d2-2e82-4928-948f-87a34e3dec24" containerName="extract" Aug 02 09:38:33.959368 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:33.959349 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mlr67" Aug 02 09:38:33.961533 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:33.961508 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-776qb\"" Aug 02 09:38:33.964267 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:33.964245 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mlr67"] Aug 02 09:38:34.090898 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:34.090859 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41b1b7f1-2978-41b6-afe5-bad4a1eecb32-bound-sa-token\") pod \"cert-manager-55b4d954d5-mlr67\" (UID: \"41b1b7f1-2978-41b6-afe5-bad4a1eecb32\") " pod="cert-manager/cert-manager-55b4d954d5-mlr67" Aug 02 09:38:34.090898 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:34.090900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz6kp\" (UniqueName: \"kubernetes.io/projected/41b1b7f1-2978-41b6-afe5-bad4a1eecb32-kube-api-access-kz6kp\") pod \"cert-manager-55b4d954d5-mlr67\" (UID: \"41b1b7f1-2978-41b6-afe5-bad4a1eecb32\") " pod="cert-manager/cert-manager-55b4d954d5-mlr67" Aug 02 09:38:34.192526 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:34.192480 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41b1b7f1-2978-41b6-afe5-bad4a1eecb32-bound-sa-token\") pod \"cert-manager-55b4d954d5-mlr67\" (UID: \"41b1b7f1-2978-41b6-afe5-bad4a1eecb32\") " pod="cert-manager/cert-manager-55b4d954d5-mlr67" Aug 02 09:38:34.192686 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:34.192533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz6kp\" (UniqueName: \"kubernetes.io/projected/41b1b7f1-2978-41b6-afe5-bad4a1eecb32-kube-api-access-kz6kp\") pod \"cert-manager-55b4d954d5-mlr67\" (UID: \"41b1b7f1-2978-41b6-afe5-bad4a1eecb32\") " pod="cert-manager/cert-manager-55b4d954d5-mlr67" Aug 02 09:38:34.199835 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:34.199805 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41b1b7f1-2978-41b6-afe5-bad4a1eecb32-bound-sa-token\") pod \"cert-manager-55b4d954d5-mlr67\" (UID: \"41b1b7f1-2978-41b6-afe5-bad4a1eecb32\") " pod="cert-manager/cert-manager-55b4d954d5-mlr67" Aug 02 09:38:34.199965 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:34.199870 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz6kp\" (UniqueName: \"kubernetes.io/projected/41b1b7f1-2978-41b6-afe5-bad4a1eecb32-kube-api-access-kz6kp\") pod \"cert-manager-55b4d954d5-mlr67\" (UID: \"41b1b7f1-2978-41b6-afe5-bad4a1eecb32\") " pod="cert-manager/cert-manager-55b4d954d5-mlr67" Aug 02 09:38:34.269692 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:34.269603 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mlr67" Aug 02 09:38:34.399143 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:34.399119 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mlr67"] Aug 02 09:38:34.401738 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:38:34.401716 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41b1b7f1_2978_41b6_afe5_bad4a1eecb32.slice/crio-238dd919ac602ed883b70534c61df1b7140c491589947036e026801174e68317 WatchSource:0}: Error finding container 238dd919ac602ed883b70534c61df1b7140c491589947036e026801174e68317: Status 404 returned error can't find the container with id 238dd919ac602ed883b70534c61df1b7140c491589947036e026801174e68317 Aug 02 09:38:34.564125 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:34.564092 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mlr67" event={"ID":"41b1b7f1-2978-41b6-afe5-bad4a1eecb32","Type":"ContainerStarted","Data":"13d948a94b835787d2403752f871ffc4d03bcbd509028db08503a5749eaa603a"} Aug 02 09:38:34.564522 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:34.564135 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mlr67" event={"ID":"41b1b7f1-2978-41b6-afe5-bad4a1eecb32","Type":"ContainerStarted","Data":"238dd919ac602ed883b70534c61df1b7140c491589947036e026801174e68317"} Aug 02 09:38:34.578217 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:34.578170 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mlr67" podStartSLOduration=1.578155442 podStartE2EDuration="1.578155442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:38:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:38:34.577640254 +0000 UTC m=+351.138795574" watchObservedRunningTime="2026-08-02 09:38:34.578155442 +0000 UTC m=+351.139310761" Aug 02 09:38:37.534709 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:37.534616 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6nhq"] Aug 02 09:38:37.552498 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:37.552474 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6nhq"] Aug 02 09:38:37.552694 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:37.552555 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6nhq" Aug 02 09:38:37.555030 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:37.555008 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Aug 02 09:38:37.555154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:37.555050 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Aug 02 09:38:37.555616 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:37.555594 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-dd6ft\"" Aug 02 09:38:37.718145 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:37.718103 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f70c96a-dfae-4d42-ba6c-ecce707814c2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d6nhq\" (UID: \"7f70c96a-dfae-4d42-ba6c-ecce707814c2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6nhq" Aug 02 09:38:37.718337 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:37.718182 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2pw6\" (UniqueName: \"kubernetes.io/projected/7f70c96a-dfae-4d42-ba6c-ecce707814c2-kube-api-access-c2pw6\") pod \"openshift-lws-operator-fd8ccff4c-d6nhq\" (UID: \"7f70c96a-dfae-4d42-ba6c-ecce707814c2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6nhq" Aug 02 09:38:37.818897 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:37.818850 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2pw6\" (UniqueName: \"kubernetes.io/projected/7f70c96a-dfae-4d42-ba6c-ecce707814c2-kube-api-access-c2pw6\") pod \"openshift-lws-operator-fd8ccff4c-d6nhq\" (UID: \"7f70c96a-dfae-4d42-ba6c-ecce707814c2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6nhq" Aug 02 09:38:37.819070 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:37.818910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f70c96a-dfae-4d42-ba6c-ecce707814c2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d6nhq\" (UID: \"7f70c96a-dfae-4d42-ba6c-ecce707814c2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6nhq" Aug 02 09:38:37.819243 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:37.819227 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f70c96a-dfae-4d42-ba6c-ecce707814c2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d6nhq\" (UID: \"7f70c96a-dfae-4d42-ba6c-ecce707814c2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6nhq" Aug 02 09:38:37.826226 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:37.826205 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2pw6\" (UniqueName: \"kubernetes.io/projected/7f70c96a-dfae-4d42-ba6c-ecce707814c2-kube-api-access-c2pw6\") pod \"openshift-lws-operator-fd8ccff4c-d6nhq\" (UID: \"7f70c96a-dfae-4d42-ba6c-ecce707814c2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6nhq" Aug 02 09:38:37.862089 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:37.862051 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6nhq" Aug 02 09:38:38.016921 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:38.016718 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6nhq"] Aug 02 09:38:38.019583 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:38:38.019550 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f70c96a_dfae_4d42_ba6c_ecce707814c2.slice/crio-8cda7c030b111279ae8306fee4d58ffe491b8233028a352ee5aba53fefb0eb29 WatchSource:0}: Error finding container 8cda7c030b111279ae8306fee4d58ffe491b8233028a352ee5aba53fefb0eb29: Status 404 returned error can't find the container with id 8cda7c030b111279ae8306fee4d58ffe491b8233028a352ee5aba53fefb0eb29 Aug 02 09:38:38.582395 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:38.582359 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6nhq" event={"ID":"7f70c96a-dfae-4d42-ba6c-ecce707814c2","Type":"ContainerStarted","Data":"8cda7c030b111279ae8306fee4d58ffe491b8233028a352ee5aba53fefb0eb29"} Aug 02 09:38:40.594097 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:40.594054 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6nhq" event={"ID":"7f70c96a-dfae-4d42-ba6c-ecce707814c2","Type":"ContainerStarted","Data":"97deaa2aca5e6882cbe5af5f9506c106a944749b1ef3447bf641a50e42ec889a"} Aug 02 09:38:40.609409 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:40.609346 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6nhq" podStartSLOduration=1.783929004 podStartE2EDuration="3.60932996s" totalImagesPullingTime="1.825400956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:38:40.608459211 +0000 UTC m=+357.169614533" watchObservedRunningTime="2026-08-02 09:38:40.60932996 +0000 UTC m=+357.170485280" Aug 02 09:38:44.181403 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.181372 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z"] Aug 02 09:38:44.185960 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.185937 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" Aug 02 09:38:44.188154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.188078 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 02 09:38:44.188154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.188112 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cv7v4\"" Aug 02 09:38:44.188154 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.188151 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 02 09:38:44.191769 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.191731 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z"] Aug 02 09:38:44.268187 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.268152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ed0659c-01b1-48cb-be86-67c7994664b1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z\" (UID: \"3ed0659c-01b1-48cb-be86-67c7994664b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" Aug 02 09:38:44.268187 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.268187 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxhc6\" (UniqueName: \"kubernetes.io/projected/3ed0659c-01b1-48cb-be86-67c7994664b1-kube-api-access-xxhc6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z\" (UID: \"3ed0659c-01b1-48cb-be86-67c7994664b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" Aug 02 09:38:44.268415 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.268213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ed0659c-01b1-48cb-be86-67c7994664b1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z\" (UID: \"3ed0659c-01b1-48cb-be86-67c7994664b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" Aug 02 09:38:44.369502 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.369469 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ed0659c-01b1-48cb-be86-67c7994664b1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z\" (UID: \"3ed0659c-01b1-48cb-be86-67c7994664b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" Aug 02 09:38:44.369502 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.369506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxhc6\" (UniqueName: \"kubernetes.io/projected/3ed0659c-01b1-48cb-be86-67c7994664b1-kube-api-access-xxhc6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z\" (UID: \"3ed0659c-01b1-48cb-be86-67c7994664b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" Aug 02 09:38:44.369806 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.369533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ed0659c-01b1-48cb-be86-67c7994664b1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z\" (UID: \"3ed0659c-01b1-48cb-be86-67c7994664b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" Aug 02 09:38:44.369992 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.369970 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ed0659c-01b1-48cb-be86-67c7994664b1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z\" (UID: \"3ed0659c-01b1-48cb-be86-67c7994664b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" Aug 02 09:38:44.370061 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.369976 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ed0659c-01b1-48cb-be86-67c7994664b1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z\" (UID: \"3ed0659c-01b1-48cb-be86-67c7994664b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" Aug 02 09:38:44.376895 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.376873 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxhc6\" (UniqueName: \"kubernetes.io/projected/3ed0659c-01b1-48cb-be86-67c7994664b1-kube-api-access-xxhc6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z\" (UID: \"3ed0659c-01b1-48cb-be86-67c7994664b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" Aug 02 09:38:44.496627 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.496538 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" Aug 02 09:38:44.628622 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:44.628598 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z"] Aug 02 09:38:44.631048 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:38:44.631011 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed0659c_01b1_48cb_be86_67c7994664b1.slice/crio-01989fae1ed7244e601aa90764b4b855142082cea5833031b4e9c443b3e5d637 WatchSource:0}: Error finding container 01989fae1ed7244e601aa90764b4b855142082cea5833031b4e9c443b3e5d637: Status 404 returned error can't find the container with id 01989fae1ed7244e601aa90764b4b855142082cea5833031b4e9c443b3e5d637 Aug 02 09:38:45.618152 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:45.618122 2575 generic.go:356] "Generic (PLEG): container finished" podID="3ed0659c-01b1-48cb-be86-67c7994664b1" containerID="935740977ed589501d5271f1486f0a7249b77f58112d809522341f6457f88f9b" exitCode=0 Aug 02 09:38:45.618535 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:45.618243 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" event={"ID":"3ed0659c-01b1-48cb-be86-67c7994664b1","Type":"ContainerDied","Data":"935740977ed589501d5271f1486f0a7249b77f58112d809522341f6457f88f9b"} Aug 02 09:38:45.618535 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:45.618289 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" event={"ID":"3ed0659c-01b1-48cb-be86-67c7994664b1","Type":"ContainerStarted","Data":"01989fae1ed7244e601aa90764b4b855142082cea5833031b4e9c443b3e5d637"} Aug 02 09:38:46.624897 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:46.624860 2575 generic.go:356] "Generic (PLEG): container finished" podID="3ed0659c-01b1-48cb-be86-67c7994664b1" containerID="04e42a2e853bec3e1d6588c97dee93753eab422bcaea3f472d83983f5c00b770" exitCode=0 Aug 02 09:38:46.625349 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:46.624940 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" event={"ID":"3ed0659c-01b1-48cb-be86-67c7994664b1","Type":"ContainerDied","Data":"04e42a2e853bec3e1d6588c97dee93753eab422bcaea3f472d83983f5c00b770"} Aug 02 09:38:47.632070 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:47.632036 2575 generic.go:356] "Generic (PLEG): container finished" podID="3ed0659c-01b1-48cb-be86-67c7994664b1" containerID="d7f93757e10ac027386e33c18eed6805fdc8f65dec3f61ca3fdcbb32e6c84117" exitCode=0 Aug 02 09:38:47.632465 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:47.632115 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" event={"ID":"3ed0659c-01b1-48cb-be86-67c7994664b1","Type":"ContainerDied","Data":"d7f93757e10ac027386e33c18eed6805fdc8f65dec3f61ca3fdcbb32e6c84117"} Aug 02 09:38:48.765536 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:48.765505 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" Aug 02 09:38:48.807404 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:48.807368 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxhc6\" (UniqueName: \"kubernetes.io/projected/3ed0659c-01b1-48cb-be86-67c7994664b1-kube-api-access-xxhc6\") pod \"3ed0659c-01b1-48cb-be86-67c7994664b1\" (UID: \"3ed0659c-01b1-48cb-be86-67c7994664b1\") " Aug 02 09:38:48.807586 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:48.807411 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ed0659c-01b1-48cb-be86-67c7994664b1-util\") pod \"3ed0659c-01b1-48cb-be86-67c7994664b1\" (UID: \"3ed0659c-01b1-48cb-be86-67c7994664b1\") " Aug 02 09:38:48.807586 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:48.807451 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ed0659c-01b1-48cb-be86-67c7994664b1-bundle\") pod \"3ed0659c-01b1-48cb-be86-67c7994664b1\" (UID: \"3ed0659c-01b1-48cb-be86-67c7994664b1\") " Aug 02 09:38:48.808177 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:48.808151 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ed0659c-01b1-48cb-be86-67c7994664b1-bundle" (OuterVolumeSpecName: "bundle") pod "3ed0659c-01b1-48cb-be86-67c7994664b1" (UID: "3ed0659c-01b1-48cb-be86-67c7994664b1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:38:48.809503 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:48.809482 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ed0659c-01b1-48cb-be86-67c7994664b1-kube-api-access-xxhc6" (OuterVolumeSpecName: "kube-api-access-xxhc6") pod "3ed0659c-01b1-48cb-be86-67c7994664b1" (UID: "3ed0659c-01b1-48cb-be86-67c7994664b1"). InnerVolumeSpecName "kube-api-access-xxhc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:38:48.813062 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:48.813034 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ed0659c-01b1-48cb-be86-67c7994664b1-util" (OuterVolumeSpecName: "util") pod "3ed0659c-01b1-48cb-be86-67c7994664b1" (UID: "3ed0659c-01b1-48cb-be86-67c7994664b1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:38:48.908281 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:48.908177 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxhc6\" (UniqueName: \"kubernetes.io/projected/3ed0659c-01b1-48cb-be86-67c7994664b1-kube-api-access-xxhc6\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:38:48.908281 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:48.908225 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ed0659c-01b1-48cb-be86-67c7994664b1-util\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:38:48.908281 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:48.908236 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ed0659c-01b1-48cb-be86-67c7994664b1-bundle\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:38:49.642289 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:49.642258 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" Aug 02 09:38:49.642289 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:49.642268 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtw9z" event={"ID":"3ed0659c-01b1-48cb-be86-67c7994664b1","Type":"ContainerDied","Data":"01989fae1ed7244e601aa90764b4b855142082cea5833031b4e9c443b3e5d637"} Aug 02 09:38:49.642492 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:49.642316 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01989fae1ed7244e601aa90764b4b855142082cea5833031b4e9c443b3e5d637" Aug 02 09:38:56.271366 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.271330 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht"] Aug 02 09:38:56.271860 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.271637 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ed0659c-01b1-48cb-be86-67c7994664b1" containerName="pull" Aug 02 09:38:56.271860 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.271649 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ed0659c-01b1-48cb-be86-67c7994664b1" containerName="pull" Aug 02 09:38:56.271860 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.271660 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ed0659c-01b1-48cb-be86-67c7994664b1" containerName="extract" Aug 02 09:38:56.271860 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.271666 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ed0659c-01b1-48cb-be86-67c7994664b1" containerName="extract" Aug 02 09:38:56.271860 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.271673 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ed0659c-01b1-48cb-be86-67c7994664b1" containerName="util" Aug 02 09:38:56.271860 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.271678 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ed0659c-01b1-48cb-be86-67c7994664b1" containerName="util" Aug 02 09:38:56.271860 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.271724 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ed0659c-01b1-48cb-be86-67c7994664b1" containerName="extract" Aug 02 09:38:56.277459 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.277441 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.279920 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.279893 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Aug 02 09:38:56.280035 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.279931 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Aug 02 09:38:56.280035 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.279960 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Aug 02 09:38:56.280035 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.279931 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Aug 02 09:38:56.280202 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.280188 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m9s7z\"" Aug 02 09:38:56.289496 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.289474 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht"] Aug 02 09:38:56.370499 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.370469 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57e67437-16bb-4d6b-a4ed-ef930e72751c-tmp\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.370681 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.370513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/57e67437-16bb-4d6b-a4ed-ef930e72751c-manifests\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.370681 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.370530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pnw8\" (UniqueName: \"kubernetes.io/projected/57e67437-16bb-4d6b-a4ed-ef930e72751c-kube-api-access-5pnw8\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.370681 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.370603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57e67437-16bb-4d6b-a4ed-ef930e72751c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.370681 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.370638 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/57e67437-16bb-4d6b-a4ed-ef930e72751c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.471904 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.471852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/57e67437-16bb-4d6b-a4ed-ef930e72751c-manifests\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.471904 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.471902 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pnw8\" (UniqueName: \"kubernetes.io/projected/57e67437-16bb-4d6b-a4ed-ef930e72751c-kube-api-access-5pnw8\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.472170 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.471926 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57e67437-16bb-4d6b-a4ed-ef930e72751c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.472170 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.471950 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/57e67437-16bb-4d6b-a4ed-ef930e72751c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.472170 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.471998 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57e67437-16bb-4d6b-a4ed-ef930e72751c-tmp\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.472399 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.472378 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/57e67437-16bb-4d6b-a4ed-ef930e72751c-manifests\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.474423 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.474382 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57e67437-16bb-4d6b-a4ed-ef930e72751c-tmp\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.474561 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.474448 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/57e67437-16bb-4d6b-a4ed-ef930e72751c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.474561 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.474475 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57e67437-16bb-4d6b-a4ed-ef930e72751c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.478950 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.478926 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pnw8\" (UniqueName: \"kubernetes.io/projected/57e67437-16bb-4d6b-a4ed-ef930e72751c-kube-api-access-5pnw8\") pod \"opendatahub-operator-controller-manager-5694fb54d4-xfwht\" (UID: \"57e67437-16bb-4d6b-a4ed-ef930e72751c\") " pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.588329 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.588293 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:38:56.737743 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:56.737711 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht"] Aug 02 09:38:56.740914 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:38:56.740890 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e67437_16bb_4d6b_a4ed_ef930e72751c.slice/crio-9441ef35e8305327659babb15eaa25e1142db3d2ff3816d457ceb14d5f2a726d WatchSource:0}: Error finding container 9441ef35e8305327659babb15eaa25e1142db3d2ff3816d457ceb14d5f2a726d: Status 404 returned error can't find the container with id 9441ef35e8305327659babb15eaa25e1142db3d2ff3816d457ceb14d5f2a726d Aug 02 09:38:57.683529 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:38:57.683496 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" event={"ID":"57e67437-16bb-4d6b-a4ed-ef930e72751c","Type":"ContainerStarted","Data":"9441ef35e8305327659babb15eaa25e1142db3d2ff3816d457ceb14d5f2a726d"} Aug 02 09:39:00.703912 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:00.703869 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" event={"ID":"57e67437-16bb-4d6b-a4ed-ef930e72751c","Type":"ContainerStarted","Data":"10c7d8120af5e638eb082f207973ce8e8636dcbfb064d6150e17c752b28a1353"} Aug 02 09:39:01.710093 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:01.710008 2575 generic.go:356] "Generic (PLEG): container finished" podID="57e67437-16bb-4d6b-a4ed-ef930e72751c" containerID="10c7d8120af5e638eb082f207973ce8e8636dcbfb064d6150e17c752b28a1353" exitCode=0 Aug 02 09:39:01.710093 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:01.710057 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" event={"ID":"57e67437-16bb-4d6b-a4ed-ef930e72751c","Type":"ContainerDied","Data":"10c7d8120af5e638eb082f207973ce8e8636dcbfb064d6150e17c752b28a1353"} Aug 02 09:39:02.716950 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:02.716916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" event={"ID":"57e67437-16bb-4d6b-a4ed-ef930e72751c","Type":"ContainerStarted","Data":"22b6022587f940119b9bda1cd778730b1aa0c7615d8313137d5f9d29afdb6918"} Aug 02 09:39:02.717351 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:02.716990 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:39:02.738265 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:02.738205 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" podStartSLOduration=1.987106742 podStartE2EDuration="6.73818764s" totalImagesPullingTime="3.698351447s" totalInitContainerRuntime="1.052729451s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:38:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:39:02.735939569 +0000 UTC m=+379.297094942" watchObservedRunningTime="2026-08-02 09:39:02.73818764 +0000 UTC m=+379.299343017" Aug 02 09:39:13.723344 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:13.723310 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5694fb54d4-xfwht" Aug 02 09:39:15.756959 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.756925 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z"] Aug 02 09:39:15.761542 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.761517 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z" Aug 02 09:39:15.764120 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.764094 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Aug 02 09:39:15.764861 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.764843 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Aug 02 09:39:15.764970 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.764950 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kqtwm\"" Aug 02 09:39:15.772570 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.772509 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z"] Aug 02 09:39:15.838493 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.838451 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1c81e0e-dced-4292-a925-e41f4499c571-tmp\") pod \"kube-auth-proxy-7569d6b956-v7w2z\" (UID: \"c1c81e0e-dced-4292-a925-e41f4499c571\") " pod="openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z" Aug 02 09:39:15.838493 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.838501 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6ndf\" (UniqueName: \"kubernetes.io/projected/c1c81e0e-dced-4292-a925-e41f4499c571-kube-api-access-c6ndf\") pod \"kube-auth-proxy-7569d6b956-v7w2z\" (UID: \"c1c81e0e-dced-4292-a925-e41f4499c571\") " pod="openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z" Aug 02 09:39:15.838707 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.838530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c81e0e-dced-4292-a925-e41f4499c571-tls-certs\") pod \"kube-auth-proxy-7569d6b956-v7w2z\" (UID: \"c1c81e0e-dced-4292-a925-e41f4499c571\") " pod="openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z" Aug 02 09:39:15.939511 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.939471 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1c81e0e-dced-4292-a925-e41f4499c571-tmp\") pod \"kube-auth-proxy-7569d6b956-v7w2z\" (UID: \"c1c81e0e-dced-4292-a925-e41f4499c571\") " pod="openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z" Aug 02 09:39:15.939687 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.939522 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ndf\" (UniqueName: \"kubernetes.io/projected/c1c81e0e-dced-4292-a925-e41f4499c571-kube-api-access-c6ndf\") pod \"kube-auth-proxy-7569d6b956-v7w2z\" (UID: \"c1c81e0e-dced-4292-a925-e41f4499c571\") " pod="openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z" Aug 02 09:39:15.939687 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.939560 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c81e0e-dced-4292-a925-e41f4499c571-tls-certs\") pod \"kube-auth-proxy-7569d6b956-v7w2z\" (UID: \"c1c81e0e-dced-4292-a925-e41f4499c571\") " pod="openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z" Aug 02 09:39:15.941939 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.941915 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1c81e0e-dced-4292-a925-e41f4499c571-tmp\") pod \"kube-auth-proxy-7569d6b956-v7w2z\" (UID: \"c1c81e0e-dced-4292-a925-e41f4499c571\") " pod="openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z" Aug 02 09:39:15.942095 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.942076 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c81e0e-dced-4292-a925-e41f4499c571-tls-certs\") pod \"kube-auth-proxy-7569d6b956-v7w2z\" (UID: \"c1c81e0e-dced-4292-a925-e41f4499c571\") " pod="openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z" Aug 02 09:39:15.947474 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:15.947450 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6ndf\" (UniqueName: \"kubernetes.io/projected/c1c81e0e-dced-4292-a925-e41f4499c571-kube-api-access-c6ndf\") pod \"kube-auth-proxy-7569d6b956-v7w2z\" (UID: \"c1c81e0e-dced-4292-a925-e41f4499c571\") " pod="openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z" Aug 02 09:39:16.034853 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.034760 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-g7xjz"] Aug 02 09:39:16.039018 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.038998 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-g7xjz" Aug 02 09:39:16.042470 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.042449 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5spkb\"" Aug 02 09:39:16.042792 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.042759 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Aug 02 09:39:16.056323 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.056297 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-g7xjz"] Aug 02 09:39:16.072122 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.072098 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z" Aug 02 09:39:16.141584 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.141553 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/378db9e4-56a1-4ac3-be87-370d6b9fda89-cert\") pod \"odh-model-controller-7998c67dc4-g7xjz\" (UID: \"378db9e4-56a1-4ac3-be87-370d6b9fda89\") " pod="opendatahub/odh-model-controller-7998c67dc4-g7xjz" Aug 02 09:39:16.141748 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.141679 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmwhr\" (UniqueName: \"kubernetes.io/projected/378db9e4-56a1-4ac3-be87-370d6b9fda89-kube-api-access-wmwhr\") pod \"odh-model-controller-7998c67dc4-g7xjz\" (UID: \"378db9e4-56a1-4ac3-be87-370d6b9fda89\") " pod="opendatahub/odh-model-controller-7998c67dc4-g7xjz" Aug 02 09:39:16.210947 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.210924 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z"] Aug 02 09:39:16.212512 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:39:16.212486 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1c81e0e_dced_4292_a925_e41f4499c571.slice/crio-407fddd09a7452aae693ba889426d544fe630883146d6596c495bde172d010da WatchSource:0}: Error finding container 407fddd09a7452aae693ba889426d544fe630883146d6596c495bde172d010da: Status 404 returned error can't find the container with id 407fddd09a7452aae693ba889426d544fe630883146d6596c495bde172d010da Aug 02 09:39:16.242794 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.242749 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/378db9e4-56a1-4ac3-be87-370d6b9fda89-cert\") pod \"odh-model-controller-7998c67dc4-g7xjz\" (UID: \"378db9e4-56a1-4ac3-be87-370d6b9fda89\") " pod="opendatahub/odh-model-controller-7998c67dc4-g7xjz" Aug 02 09:39:16.242937 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.242836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmwhr\" (UniqueName: \"kubernetes.io/projected/378db9e4-56a1-4ac3-be87-370d6b9fda89-kube-api-access-wmwhr\") pod \"odh-model-controller-7998c67dc4-g7xjz\" (UID: \"378db9e4-56a1-4ac3-be87-370d6b9fda89\") " pod="opendatahub/odh-model-controller-7998c67dc4-g7xjz" Aug 02 09:39:16.242937 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:39:16.242910 2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Aug 02 09:39:16.243015 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:39:16.242980 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/378db9e4-56a1-4ac3-be87-370d6b9fda89-cert podName:378db9e4-56a1-4ac3-be87-370d6b9fda89 nodeName:}" failed. No retries permitted until 2026-08-02 09:39:16.742962498 +0000 UTC m=+393.304117796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/378db9e4-56a1-4ac3-be87-370d6b9fda89-cert") pod "odh-model-controller-7998c67dc4-g7xjz" (UID: "378db9e4-56a1-4ac3-be87-370d6b9fda89") : secret "odh-model-controller-webhook-cert" not found Aug 02 09:39:16.257806 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.257759 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmwhr\" (UniqueName: \"kubernetes.io/projected/378db9e4-56a1-4ac3-be87-370d6b9fda89-kube-api-access-wmwhr\") pod \"odh-model-controller-7998c67dc4-g7xjz\" (UID: \"378db9e4-56a1-4ac3-be87-370d6b9fda89\") " pod="opendatahub/odh-model-controller-7998c67dc4-g7xjz" Aug 02 09:39:16.748504 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.748463 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/378db9e4-56a1-4ac3-be87-370d6b9fda89-cert\") pod \"odh-model-controller-7998c67dc4-g7xjz\" (UID: \"378db9e4-56a1-4ac3-be87-370d6b9fda89\") " pod="opendatahub/odh-model-controller-7998c67dc4-g7xjz" Aug 02 09:39:16.750853 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.750832 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/378db9e4-56a1-4ac3-be87-370d6b9fda89-cert\") pod \"odh-model-controller-7998c67dc4-g7xjz\" (UID: \"378db9e4-56a1-4ac3-be87-370d6b9fda89\") " pod="opendatahub/odh-model-controller-7998c67dc4-g7xjz" Aug 02 09:39:16.780985 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.780953 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z" event={"ID":"c1c81e0e-dced-4292-a925-e41f4499c571","Type":"ContainerStarted","Data":"407fddd09a7452aae693ba889426d544fe630883146d6596c495bde172d010da"} Aug 02 09:39:16.815744 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.815703 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7kz4n"] Aug 02 09:39:16.820624 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.820600 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7kz4n" Aug 02 09:39:16.823077 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.823057 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wrr2d\"" Aug 02 09:39:16.823216 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.823100 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Aug 02 09:39:16.832205 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.832180 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7kz4n"] Aug 02 09:39:16.949638 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.949292 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-g7xjz" Aug 02 09:39:16.951929 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.951719 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5adcbcf-aaa5-4f96-b239-334e9e0f3553-tls-certs\") pod \"model-serving-api-54d89bd5fc-7kz4n\" (UID: \"d5adcbcf-aaa5-4f96-b239-334e9e0f3553\") " pod="opendatahub/model-serving-api-54d89bd5fc-7kz4n" Aug 02 09:39:16.951929 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:16.951851 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shb5g\" (UniqueName: \"kubernetes.io/projected/d5adcbcf-aaa5-4f96-b239-334e9e0f3553-kube-api-access-shb5g\") pod \"model-serving-api-54d89bd5fc-7kz4n\" (UID: \"d5adcbcf-aaa5-4f96-b239-334e9e0f3553\") " pod="opendatahub/model-serving-api-54d89bd5fc-7kz4n" Aug 02 09:39:17.002651 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.002569 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh"] Aug 02 09:39:17.006764 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.006738 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.009636 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.009605 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Aug 02 09:39:17.009877 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.009853 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Aug 02 09:39:17.010365 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.010077 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Aug 02 09:39:17.010365 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.010151 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-844d4\"" Aug 02 09:39:17.010365 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.010184 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Aug 02 09:39:17.022350 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.022320 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh"] Aug 02 09:39:17.053565 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.052386 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shb5g\" (UniqueName: \"kubernetes.io/projected/d5adcbcf-aaa5-4f96-b239-334e9e0f3553-kube-api-access-shb5g\") pod \"model-serving-api-54d89bd5fc-7kz4n\" (UID: \"d5adcbcf-aaa5-4f96-b239-334e9e0f3553\") " pod="opendatahub/model-serving-api-54d89bd5fc-7kz4n" Aug 02 09:39:17.053565 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.052465 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5adcbcf-aaa5-4f96-b239-334e9e0f3553-tls-certs\") pod \"model-serving-api-54d89bd5fc-7kz4n\" (UID: \"d5adcbcf-aaa5-4f96-b239-334e9e0f3553\") " pod="opendatahub/model-serving-api-54d89bd5fc-7kz4n" Aug 02 09:39:17.056829 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.055605 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5adcbcf-aaa5-4f96-b239-334e9e0f3553-tls-certs\") pod \"model-serving-api-54d89bd5fc-7kz4n\" (UID: \"d5adcbcf-aaa5-4f96-b239-334e9e0f3553\") " pod="opendatahub/model-serving-api-54d89bd5fc-7kz4n" Aug 02 09:39:17.061630 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.061599 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shb5g\" (UniqueName: \"kubernetes.io/projected/d5adcbcf-aaa5-4f96-b239-334e9e0f3553-kube-api-access-shb5g\") pod \"model-serving-api-54d89bd5fc-7kz4n\" (UID: \"d5adcbcf-aaa5-4f96-b239-334e9e0f3553\") " pod="opendatahub/model-serving-api-54d89bd5fc-7kz4n" Aug 02 09:39:17.131947 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.131902 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7kz4n" Aug 02 09:39:17.144491 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.144460 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-g7xjz"] Aug 02 09:39:17.149355 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:39:17.149322 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod378db9e4_56a1_4ac3_be87_370d6b9fda89.slice/crio-52686c57f3e9564ce829e9f4534e49fd782625ef7d7b3e64a0cf26a003c848e6 WatchSource:0}: Error finding container 52686c57f3e9564ce829e9f4534e49fd782625ef7d7b3e64a0cf26a003c848e6: Status 404 returned error can't find the container with id 52686c57f3e9564ce829e9f4534e49fd782625ef7d7b3e64a0cf26a003c848e6 Aug 02 09:39:17.153185 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.153159 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.153278 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.153210 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6ggr\" (UniqueName: \"kubernetes.io/projected/400ec88d-94f3-4ae2-b894-a6ad73d17de1-kube-api-access-t6ggr\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.153278 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.153245 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.153392 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.153358 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.153441 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.153403 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/400ec88d-94f3-4ae2-b894-a6ad73d17de1-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.153497 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.153470 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.153553 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.153520 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.254472 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.254392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.254472 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.254447 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/400ec88d-94f3-4ae2-b894-a6ad73d17de1-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.254691 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.254487 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.254691 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.254534 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.254691 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.254581 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.254691 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.254608 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6ggr\" (UniqueName: \"kubernetes.io/projected/400ec88d-94f3-4ae2-b894-a6ad73d17de1-kube-api-access-t6ggr\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.254691 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.254638 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.256056 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.255719 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.258730 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.258634 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.258730 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.258681 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.259311 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.259276 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.260521 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.260502 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/400ec88d-94f3-4ae2-b894-a6ad73d17de1-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.268874 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.268826 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6ggr\" (UniqueName: \"kubernetes.io/projected/400ec88d-94f3-4ae2-b894-a6ad73d17de1-kube-api-access-t6ggr\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.270484 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.270443 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hplsh\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.300345 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.300309 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7kz4n"] Aug 02 09:39:17.301938 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:39:17.301904 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5adcbcf_aaa5_4f96_b239_334e9e0f3553.slice/crio-9f79d8401002fd96c62773eb055853c225d8988727cb4441f94a2f4166b98af9 WatchSource:0}: Error finding container 9f79d8401002fd96c62773eb055853c225d8988727cb4441f94a2f4166b98af9: Status 404 returned error can't find the container with id 9f79d8401002fd96c62773eb055853c225d8988727cb4441f94a2f4166b98af9 Aug 02 09:39:17.320852 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.320823 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:17.490952 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.490915 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh"] Aug 02 09:39:17.492589 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:39:17.492555 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400ec88d_94f3_4ae2_b894_a6ad73d17de1.slice/crio-73e638f7987458861eab9d98898325ad4c6fd7aca38ba220e8c7163e9229afe2 WatchSource:0}: Error finding container 73e638f7987458861eab9d98898325ad4c6fd7aca38ba220e8c7163e9229afe2: Status 404 returned error can't find the container with id 73e638f7987458861eab9d98898325ad4c6fd7aca38ba220e8c7163e9229afe2 Aug 02 09:39:17.789965 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.789921 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7kz4n" event={"ID":"d5adcbcf-aaa5-4f96-b239-334e9e0f3553","Type":"ContainerStarted","Data":"9f79d8401002fd96c62773eb055853c225d8988727cb4441f94a2f4166b98af9"} Aug 02 09:39:17.791655 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.791583 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-g7xjz" event={"ID":"378db9e4-56a1-4ac3-be87-370d6b9fda89","Type":"ContainerStarted","Data":"52686c57f3e9564ce829e9f4534e49fd782625ef7d7b3e64a0cf26a003c848e6"} Aug 02 09:39:17.793137 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:17.793101 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" event={"ID":"400ec88d-94f3-4ae2-b894-a6ad73d17de1","Type":"ContainerStarted","Data":"73e638f7987458861eab9d98898325ad4c6fd7aca38ba220e8c7163e9229afe2"} Aug 02 09:39:20.816188 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:20.816153 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z" event={"ID":"c1c81e0e-dced-4292-a925-e41f4499c571","Type":"ContainerStarted","Data":"27807e6303f4cde0e01064834a64282c02d0be1ced77691fef1fb963ffad2734"} Aug 02 09:39:20.830621 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:20.830563 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7569d6b956-v7w2z" podStartSLOduration=1.337300267 podStartE2EDuration="5.830543334s" totalImagesPullingTime="4.493243067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:39:20.830290739 +0000 UTC m=+397.391446058" watchObservedRunningTime="2026-08-02 09:39:20.830543334 +0000 UTC m=+397.391698656" Aug 02 09:39:21.823089 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:21.823049 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-g7xjz" event={"ID":"378db9e4-56a1-4ac3-be87-370d6b9fda89","Type":"ContainerStarted","Data":"d4c17385f7ec655f537f0b4b8ec3bc0dfbc53da758ffc0d15cfc016d42925851"} Aug 02 09:39:21.823550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:21.823386 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-g7xjz" Aug 02 09:39:21.839573 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:21.839515 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-g7xjz" podStartSLOduration=2.242621611 podStartE2EDuration="5.839494149s" totalImagesPullingTime="3.596872538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:39:21.837974086 +0000 UTC m=+398.399129407" watchObservedRunningTime="2026-08-02 09:39:21.839494149 +0000 UTC m=+398.400649501" Aug 02 09:39:22.308265 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:22.308230 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 09:39:22.308358 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:22.308295 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 09:39:22.831130 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:22.831085 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" event={"ID":"400ec88d-94f3-4ae2-b894-a6ad73d17de1","Type":"ContainerStarted","Data":"124b9492a5248e77bc9ec73fa22cc2b9e95c1ad10d6729cd1498912983407bfe"} Aug 02 09:39:22.831609 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:22.831153 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:22.832642 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:22.832617 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7kz4n" event={"ID":"d5adcbcf-aaa5-4f96-b239-334e9e0f3553","Type":"ContainerStarted","Data":"16fac44933c39cbd82363b018ad3c5291c19aad6858aa4aff2c71e9d6341f818"} Aug 02 09:39:22.832786 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:22.832761 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-7kz4n" Aug 02 09:39:22.854007 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:22.853952 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" podStartSLOduration=2.040798322 podStartE2EDuration="6.853937509s" totalImagesPullingTime="4.813139187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:39:22.851867469 +0000 UTC m=+399.413022787" watchObservedRunningTime="2026-08-02 09:39:22.853937509 +0000 UTC m=+399.415092830" Aug 02 09:39:22.866972 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:22.866922 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-7kz4n" podStartSLOduration=1.9190063899999998 podStartE2EDuration="6.866907001s" totalImagesPullingTime="4.947900611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:39:22.865490537 +0000 UTC m=+399.426645856" watchObservedRunningTime="2026-08-02 09:39:22.866907001 +0000 UTC m=+399.428062321" Aug 02 09:39:23.509940 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.509904 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992"] Aug 02 09:39:23.513360 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.513338 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.516008 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.515987 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jrj87\"" Aug 02 09:39:23.543250 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.543222 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992"] Aug 02 09:39:23.618642 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.618606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m5wj\" (UniqueName: \"kubernetes.io/projected/823c9705-b560-4331-b55a-a7a3eadcc0bb-kube-api-access-4m5wj\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.618642 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.618656 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.618928 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.618678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823c9705-b560-4331-b55a-a7a3eadcc0bb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.618928 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.618712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.618928 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.618741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.618928 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.618762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.618928 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.618791 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.618928 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.618810 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.618928 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.618845 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.627173 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.627136 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk"] Aug 02 09:39:23.630790 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.630749 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.642396 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.642368 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk"] Aug 02 09:39:23.720320 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720288 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.720499 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720325 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.720499 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720349 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc3134d2-6889-4696-8de8-7d8122473f7e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.720499 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720374 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.720499 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720400 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.720499 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720444 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.720499 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.720499 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.720879 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720536 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.720879 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720611 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l8z4\" (UniqueName: \"kubernetes.io/projected/cc3134d2-6889-4696-8de8-7d8122473f7e-kube-api-access-9l8z4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.720879 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m5wj\" (UniqueName: \"kubernetes.io/projected/823c9705-b560-4331-b55a-a7a3eadcc0bb-kube-api-access-4m5wj\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.720879 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720734 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.720879 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720764 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.720879 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720823 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc3134d2-6889-4696-8de8-7d8122473f7e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.720879 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720858 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc3134d2-6889-4696-8de8-7d8122473f7e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.720879 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720865 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.721298 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720891 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.721298 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720924 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.721298 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.720936 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.721298 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.721014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823c9705-b560-4331-b55a-a7a3eadcc0bb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.721298 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.721034 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.721298 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.721179 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.721674 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.721650 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823c9705-b560-4331-b55a-a7a3eadcc0bb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.722881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.722856 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.723301 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.723280 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.728710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.728681 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.729099 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.729082 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m5wj\" (UniqueName: \"kubernetes.io/projected/823c9705-b560-4331-b55a-a7a3eadcc0bb-kube-api-access-4m5wj\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcb4992\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.821832 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.821757 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc3134d2-6889-4696-8de8-7d8122473f7e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.821832 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.821838 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.822092 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.821879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.822092 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.821931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l8z4\" (UniqueName: \"kubernetes.io/projected/cc3134d2-6889-4696-8de8-7d8122473f7e-kube-api-access-9l8z4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.822092 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.821958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.822092 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.821976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.822092 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.822002 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc3134d2-6889-4696-8de8-7d8122473f7e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.822092 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.822033 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc3134d2-6889-4696-8de8-7d8122473f7e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.822092 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.822072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.822424 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.822384 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.822467 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.822431 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.822577 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.822562 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.822634 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.822603 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc3134d2-6889-4696-8de8-7d8122473f7e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.822681 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.822630 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.823785 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.823753 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:23.824323 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.824303 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc3134d2-6889-4696-8de8-7d8122473f7e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.824651 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.824634 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc3134d2-6889-4696-8de8-7d8122473f7e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.830247 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.830218 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc3134d2-6889-4696-8de8-7d8122473f7e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.830361 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.830346 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l8z4\" (UniqueName: \"kubernetes.io/projected/cc3134d2-6889-4696-8de8-7d8122473f7e-kube-api-access-9l8z4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk\" (UID: \"cc3134d2-6889-4696-8de8-7d8122473f7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:23.839645 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.839625 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:23.941508 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:23.941404 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:24.009813 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:24.009770 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992"] Aug 02 09:39:24.099302 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:24.099277 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk"] Aug 02 09:39:24.100485 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:39:24.100461 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc3134d2_6889_4696_8de8_7d8122473f7e.slice/crio-c169079ed889be12fc8c18f14b05474c6d7ae9d21b9bbfb5a1563c4269861513 WatchSource:0}: Error finding container c169079ed889be12fc8c18f14b05474c6d7ae9d21b9bbfb5a1563c4269861513: Status 404 returned error can't find the container with id c169079ed889be12fc8c18f14b05474c6d7ae9d21b9bbfb5a1563c4269861513 Aug 02 09:39:24.848207 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:24.848121 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" event={"ID":"823c9705-b560-4331-b55a-a7a3eadcc0bb","Type":"ContainerStarted","Data":"73a6ac9e4d59257329b997eb99b5ec3932ae1e875e997bcc349faa1ec38d1232"} Aug 02 09:39:24.849829 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:24.849796 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" event={"ID":"cc3134d2-6889-4696-8de8-7d8122473f7e","Type":"ContainerStarted","Data":"c169079ed889be12fc8c18f14b05474c6d7ae9d21b9bbfb5a1563c4269861513"} Aug 02 09:39:25.482129 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.482089 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-57jwh"] Aug 02 09:39:25.486080 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.486048 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-57jwh" Aug 02 09:39:25.488999 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.488970 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rgzgc\"" Aug 02 09:39:25.489258 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.489217 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Aug 02 09:39:25.494665 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.494635 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh"] Aug 02 09:39:25.499703 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.499677 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh" Aug 02 09:39:25.504907 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.504884 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vb9xq\"" Aug 02 09:39:25.505130 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.505113 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Aug 02 09:39:25.505348 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.505323 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-57jwh"] Aug 02 09:39:25.514472 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.514446 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh"] Aug 02 09:39:25.638282 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.638237 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwq8d\" (UniqueName: \"kubernetes.io/projected/8f5dced0-4de3-46ea-a994-ec5ef53620e1-kube-api-access-rwq8d\") pod \"kserve-controller-manager-d6f4b65b8-57jwh\" (UID: \"8f5dced0-4de3-46ea-a994-ec5ef53620e1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-57jwh" Aug 02 09:39:25.638481 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.638291 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b814331a-0f2b-40f8-b711-119d61b3e9c2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z7hxh\" (UID: \"b814331a-0f2b-40f8-b711-119d61b3e9c2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh" Aug 02 09:39:25.638481 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.638397 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42tsq\" (UniqueName: \"kubernetes.io/projected/b814331a-0f2b-40f8-b711-119d61b3e9c2-kube-api-access-42tsq\") pod \"llmisvc-controller-manager-777c6bd7d5-z7hxh\" (UID: \"b814331a-0f2b-40f8-b711-119d61b3e9c2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh" Aug 02 09:39:25.638597 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.638535 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f5dced0-4de3-46ea-a994-ec5ef53620e1-cert\") pod \"kserve-controller-manager-d6f4b65b8-57jwh\" (UID: \"8f5dced0-4de3-46ea-a994-ec5ef53620e1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-57jwh" Aug 02 09:39:25.739514 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.739421 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f5dced0-4de3-46ea-a994-ec5ef53620e1-cert\") pod \"kserve-controller-manager-d6f4b65b8-57jwh\" (UID: \"8f5dced0-4de3-46ea-a994-ec5ef53620e1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-57jwh" Aug 02 09:39:25.739514 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.739492 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwq8d\" (UniqueName: \"kubernetes.io/projected/8f5dced0-4de3-46ea-a994-ec5ef53620e1-kube-api-access-rwq8d\") pod \"kserve-controller-manager-d6f4b65b8-57jwh\" (UID: \"8f5dced0-4de3-46ea-a994-ec5ef53620e1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-57jwh" Aug 02 09:39:25.739750 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.739522 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b814331a-0f2b-40f8-b711-119d61b3e9c2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z7hxh\" (UID: \"b814331a-0f2b-40f8-b711-119d61b3e9c2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh" Aug 02 09:39:25.739750 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.739566 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42tsq\" (UniqueName: \"kubernetes.io/projected/b814331a-0f2b-40f8-b711-119d61b3e9c2-kube-api-access-42tsq\") pod \"llmisvc-controller-manager-777c6bd7d5-z7hxh\" (UID: \"b814331a-0f2b-40f8-b711-119d61b3e9c2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh" Aug 02 09:39:25.739750 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:39:25.739587 2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Aug 02 09:39:25.739750 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:39:25.739669 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f5dced0-4de3-46ea-a994-ec5ef53620e1-cert podName:8f5dced0-4de3-46ea-a994-ec5ef53620e1 nodeName:}" failed. No retries permitted until 2026-08-02 09:39:26.239645249 +0000 UTC m=+402.800800561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f5dced0-4de3-46ea-a994-ec5ef53620e1-cert") pod "kserve-controller-manager-d6f4b65b8-57jwh" (UID: "8f5dced0-4de3-46ea-a994-ec5ef53620e1") : secret "kserve-webhook-server-cert" not found Aug 02 09:39:25.739992 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:39:25.739938 2575 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Aug 02 09:39:25.740056 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:39:25.740003 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b814331a-0f2b-40f8-b711-119d61b3e9c2-cert podName:b814331a-0f2b-40f8-b711-119d61b3e9c2 nodeName:}" failed. No retries permitted until 2026-08-02 09:39:26.239983822 +0000 UTC m=+402.801139138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b814331a-0f2b-40f8-b711-119d61b3e9c2-cert") pod "llmisvc-controller-manager-777c6bd7d5-z7hxh" (UID: "b814331a-0f2b-40f8-b711-119d61b3e9c2") : secret "llmisvc-webhook-server-cert" not found Aug 02 09:39:25.752010 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.751947 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwq8d\" (UniqueName: \"kubernetes.io/projected/8f5dced0-4de3-46ea-a994-ec5ef53620e1-kube-api-access-rwq8d\") pod \"kserve-controller-manager-d6f4b65b8-57jwh\" (UID: \"8f5dced0-4de3-46ea-a994-ec5ef53620e1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-57jwh" Aug 02 09:39:25.752174 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:25.752139 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42tsq\" (UniqueName: \"kubernetes.io/projected/b814331a-0f2b-40f8-b711-119d61b3e9c2-kube-api-access-42tsq\") pod \"llmisvc-controller-manager-777c6bd7d5-z7hxh\" (UID: \"b814331a-0f2b-40f8-b711-119d61b3e9c2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh" Aug 02 09:39:26.245130 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:26.244985 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f5dced0-4de3-46ea-a994-ec5ef53620e1-cert\") pod \"kserve-controller-manager-d6f4b65b8-57jwh\" (UID: \"8f5dced0-4de3-46ea-a994-ec5ef53620e1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-57jwh" Aug 02 09:39:26.245130 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:26.245068 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b814331a-0f2b-40f8-b711-119d61b3e9c2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z7hxh\" (UID: \"b814331a-0f2b-40f8-b711-119d61b3e9c2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh" Aug 02 09:39:26.248417 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:26.248389 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b814331a-0f2b-40f8-b711-119d61b3e9c2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z7hxh\" (UID: \"b814331a-0f2b-40f8-b711-119d61b3e9c2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh" Aug 02 09:39:26.248554 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:26.248485 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f5dced0-4de3-46ea-a994-ec5ef53620e1-cert\") pod \"kserve-controller-manager-d6f4b65b8-57jwh\" (UID: \"8f5dced0-4de3-46ea-a994-ec5ef53620e1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-57jwh" Aug 02 09:39:26.405383 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:26.405346 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-57jwh" Aug 02 09:39:26.419194 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:26.419165 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh" Aug 02 09:39:26.965296 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:26.965245 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 09:39:26.965436 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:26.965340 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 09:39:26.965436 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:26.965382 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 09:39:26.977177 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:26.977136 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 09:39:26.977287 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:26.977233 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 09:39:26.977287 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:26.977278 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 09:39:27.027915 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.027883 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-57jwh"] Aug 02 09:39:27.042117 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:39:27.042085 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f5dced0_4de3_46ea_a994_ec5ef53620e1.slice/crio-17b21f5ade8bd58813452d2a9aa203788245827a60c0ec96a75ce395ccb7fd0d WatchSource:0}: Error finding container 17b21f5ade8bd58813452d2a9aa203788245827a60c0ec96a75ce395ccb7fd0d: Status 404 returned error can't find the container with id 17b21f5ade8bd58813452d2a9aa203788245827a60c0ec96a75ce395ccb7fd0d Aug 02 09:39:27.050962 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.050751 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh"] Aug 02 09:39:27.054712 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:39:27.054685 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb814331a_0f2b_40f8_b711_119d61b3e9c2.slice/crio-efc19dd5e35ce4c214c98af335a2a77e592955d55dcc405bca4ed676c2bc8158 WatchSource:0}: Error finding container efc19dd5e35ce4c214c98af335a2a77e592955d55dcc405bca4ed676c2bc8158: Status 404 returned error can't find the container with id efc19dd5e35ce4c214c98af335a2a77e592955d55dcc405bca4ed676c2bc8158 Aug 02 09:39:27.427441 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.427403 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh"] Aug 02 09:39:27.428003 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.427623 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" podUID="400ec88d-94f3-4ae2-b894-a6ad73d17de1" containerName="discovery" containerID="cri-o://124b9492a5248e77bc9ec73fa22cc2b9e95c1ad10d6729cd1498912983407bfe" gracePeriod=30 Aug 02 09:39:27.665792 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.665757 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:27.759086 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.759008 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-token\") pod \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " Aug 02 09:39:27.759086 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.759076 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6ggr\" (UniqueName: \"kubernetes.io/projected/400ec88d-94f3-4ae2-b894-a6ad73d17de1-kube-api-access-t6ggr\") pod \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " Aug 02 09:39:27.759310 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.759110 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-csr-ca-configmap\") pod \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " Aug 02 09:39:27.759310 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.759137 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-csr-dns-cert\") pod \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " Aug 02 09:39:27.759310 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.759161 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/400ec88d-94f3-4ae2-b894-a6ad73d17de1-local-certs\") pod \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " Aug 02 09:39:27.759476 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.759318 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-kubeconfig\") pod \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " Aug 02 09:39:27.759476 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.759410 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-cacerts\") pod \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\" (UID: \"400ec88d-94f3-4ae2-b894-a6ad73d17de1\") " Aug 02 09:39:27.759586 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.759561 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "400ec88d-94f3-4ae2-b894-a6ad73d17de1" (UID: "400ec88d-94f3-4ae2-b894-a6ad73d17de1"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:39:27.759826 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.759798 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-csr-ca-configmap\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:27.761763 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.761732 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-cacerts" (OuterVolumeSpecName: "cacerts") pod "400ec88d-94f3-4ae2-b894-a6ad73d17de1" (UID: "400ec88d-94f3-4ae2-b894-a6ad73d17de1"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:39:27.761908 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.761854 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/400ec88d-94f3-4ae2-b894-a6ad73d17de1-local-certs" (OuterVolumeSpecName: "local-certs") pod "400ec88d-94f3-4ae2-b894-a6ad73d17de1" (UID: "400ec88d-94f3-4ae2-b894-a6ad73d17de1"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:39:27.761908 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.761849 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "400ec88d-94f3-4ae2-b894-a6ad73d17de1" (UID: "400ec88d-94f3-4ae2-b894-a6ad73d17de1"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:39:27.762027 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.761983 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "400ec88d-94f3-4ae2-b894-a6ad73d17de1" (UID: "400ec88d-94f3-4ae2-b894-a6ad73d17de1"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:39:27.762027 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.761995 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/400ec88d-94f3-4ae2-b894-a6ad73d17de1-kube-api-access-t6ggr" (OuterVolumeSpecName: "kube-api-access-t6ggr") pod "400ec88d-94f3-4ae2-b894-a6ad73d17de1" (UID: "400ec88d-94f3-4ae2-b894-a6ad73d17de1"). InnerVolumeSpecName "kube-api-access-t6ggr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:39:27.762285 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.762249 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-token" (OuterVolumeSpecName: "istio-token") pod "400ec88d-94f3-4ae2-b894-a6ad73d17de1" (UID: "400ec88d-94f3-4ae2-b894-a6ad73d17de1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:39:27.861336 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.861265 2575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-cacerts\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:27.861336 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.861301 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-token\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:27.861336 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.861321 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6ggr\" (UniqueName: \"kubernetes.io/projected/400ec88d-94f3-4ae2-b894-a6ad73d17de1-kube-api-access-t6ggr\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:27.861336 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.861336 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-csr-dns-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:27.861691 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.861351 2575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/400ec88d-94f3-4ae2-b894-a6ad73d17de1-local-certs\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:27.861691 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.861364 2575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/400ec88d-94f3-4ae2-b894-a6ad73d17de1-istio-kubeconfig\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:27.871164 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.871127 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" event={"ID":"cc3134d2-6889-4696-8de8-7d8122473f7e","Type":"ContainerStarted","Data":"9216d8ff9a5c632b7f72c15bfeee1bafc202d45540440860c1409b108ac52ffc"} Aug 02 09:39:27.872680 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.872649 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh" event={"ID":"b814331a-0f2b-40f8-b711-119d61b3e9c2","Type":"ContainerStarted","Data":"efc19dd5e35ce4c214c98af335a2a77e592955d55dcc405bca4ed676c2bc8158"} Aug 02 09:39:27.874192 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.874166 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-57jwh" event={"ID":"8f5dced0-4de3-46ea-a994-ec5ef53620e1","Type":"ContainerStarted","Data":"17b21f5ade8bd58813452d2a9aa203788245827a60c0ec96a75ce395ccb7fd0d"} Aug 02 09:39:27.875653 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.875628 2575 generic.go:356] "Generic (PLEG): container finished" podID="400ec88d-94f3-4ae2-b894-a6ad73d17de1" containerID="124b9492a5248e77bc9ec73fa22cc2b9e95c1ad10d6729cd1498912983407bfe" exitCode=0 Aug 02 09:39:27.875797 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.875681 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" Aug 02 09:39:27.875797 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.875684 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" event={"ID":"400ec88d-94f3-4ae2-b894-a6ad73d17de1","Type":"ContainerDied","Data":"124b9492a5248e77bc9ec73fa22cc2b9e95c1ad10d6729cd1498912983407bfe"} Aug 02 09:39:27.875797 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.875734 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh" event={"ID":"400ec88d-94f3-4ae2-b894-a6ad73d17de1","Type":"ContainerDied","Data":"73e638f7987458861eab9d98898325ad4c6fd7aca38ba220e8c7163e9229afe2"} Aug 02 09:39:27.875797 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.875752 2575 scope.go:117] "RemoveContainer" containerID="124b9492a5248e77bc9ec73fa22cc2b9e95c1ad10d6729cd1498912983407bfe" Aug 02 09:39:27.877643 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.877616 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" event={"ID":"823c9705-b560-4331-b55a-a7a3eadcc0bb","Type":"ContainerStarted","Data":"57396a17842f24469607c26db0d1993e01d46c827c980995d87f1bfa6dcc0966"} Aug 02 09:39:27.893973 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.893921 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" podStartSLOduration=2.019633168 podStartE2EDuration="4.89390448s" totalImagesPullingTime="2.874271312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:39:27.893841109 +0000 UTC m=+404.454996430" watchObservedRunningTime="2026-08-02 09:39:27.89390448 +0000 UTC m=+404.455059806" Aug 02 09:39:27.918149 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.918093 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" podStartSLOduration=1.969161884 podStartE2EDuration="4.918076613s" totalImagesPullingTime="2.948914729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:39:27.916754891 +0000 UTC m=+404.477910211" watchObservedRunningTime="2026-08-02 09:39:27.918076613 +0000 UTC m=+404.479231934" Aug 02 09:39:27.931354 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.931321 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh"] Aug 02 09:39:27.935339 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.935313 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hplsh"] Aug 02 09:39:27.942180 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.942150 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:27.958026 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:27.957992 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="400ec88d-94f3-4ae2-b894-a6ad73d17de1" path="/var/lib/kubelet/pods/400ec88d-94f3-4ae2-b894-a6ad73d17de1/volumes" Aug 02 09:39:28.009070 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:28.009003 2575 scope.go:117] "RemoveContainer" containerID="124b9492a5248e77bc9ec73fa22cc2b9e95c1ad10d6729cd1498912983407bfe" Aug 02 09:39:28.009606 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:39:28.009489 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"124b9492a5248e77bc9ec73fa22cc2b9e95c1ad10d6729cd1498912983407bfe\": container with ID starting with 124b9492a5248e77bc9ec73fa22cc2b9e95c1ad10d6729cd1498912983407bfe not found: ID does not exist" containerID="124b9492a5248e77bc9ec73fa22cc2b9e95c1ad10d6729cd1498912983407bfe" Aug 02 09:39:28.009606 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:28.009546 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"124b9492a5248e77bc9ec73fa22cc2b9e95c1ad10d6729cd1498912983407bfe"} err="failed to get container status \"124b9492a5248e77bc9ec73fa22cc2b9e95c1ad10d6729cd1498912983407bfe\": rpc error: code = NotFound desc = could not find container \"124b9492a5248e77bc9ec73fa22cc2b9e95c1ad10d6729cd1498912983407bfe\": container with ID starting with 124b9492a5248e77bc9ec73fa22cc2b9e95c1ad10d6729cd1498912983407bfe not found: ID does not exist" Aug 02 09:39:28.824268 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:28.824236 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:28.825872 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:28.825830 2575 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcb4992 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Aug 02 09:39:28.826014 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:28.825901 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" podUID="823c9705-b560-4331-b55a-a7a3eadcc0bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Aug 02 09:39:28.949442 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:28.949413 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:29.824498 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:29.824464 2575 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcb4992 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Aug 02 09:39:29.824906 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:29.824534 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" podUID="823c9705-b560-4331-b55a-a7a3eadcc0bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Aug 02 09:39:29.896016 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:29.895982 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:29.897057 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:29.897036 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk" Aug 02 09:39:29.942723 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:29.942700 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992"] Aug 02 09:39:30.824912 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:30.824879 2575 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcb4992 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Aug 02 09:39:30.825322 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:30.824943 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" podUID="823c9705-b560-4331-b55a-a7a3eadcc0bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Aug 02 09:39:30.902290 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:30.902252 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh" event={"ID":"b814331a-0f2b-40f8-b711-119d61b3e9c2","Type":"ContainerStarted","Data":"8516339f243455d516f4112e05ca0d64492cf34597805011501aa4acecc5bd52"} Aug 02 09:39:30.902467 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:30.902347 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh" Aug 02 09:39:30.903795 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:30.903745 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-57jwh" event={"ID":"8f5dced0-4de3-46ea-a994-ec5ef53620e1","Type":"ContainerStarted","Data":"2ed99837399cab207072f8dc8ed6d163de6bf1494c38d89742e2bc48063d3641"} Aug 02 09:39:30.903918 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:30.903824 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-57jwh" Aug 02 09:39:30.903918 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:30.903828 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" podUID="823c9705-b560-4331-b55a-a7a3eadcc0bb" containerName="istio-proxy" containerID="cri-o://57396a17842f24469607c26db0d1993e01d46c827c980995d87f1bfa6dcc0966" gracePeriod=30 Aug 02 09:39:30.918234 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:30.918190 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh" podStartSLOduration=3.036141227 podStartE2EDuration="5.91817285s" totalImagesPullingTime="2.882031623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:39:30.916062843 +0000 UTC m=+407.477218164" watchObservedRunningTime="2026-08-02 09:39:30.91817285 +0000 UTC m=+407.479328207" Aug 02 09:39:30.950858 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:30.950799 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-57jwh" podStartSLOduration=3.059727701 podStartE2EDuration="5.950753332s" totalImagesPullingTime="2.891025631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:39:30.950473863 +0000 UTC m=+407.511629184" watchObservedRunningTime="2026-08-02 09:39:30.950753332 +0000 UTC m=+407.511908654" Aug 02 09:39:32.728231 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:32.728188 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-647d6f769c-4bb67"] Aug 02 09:39:32.728786 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:32.728741 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="400ec88d-94f3-4ae2-b894-a6ad73d17de1" containerName="discovery" Aug 02 09:39:32.728786 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:32.728767 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="400ec88d-94f3-4ae2-b894-a6ad73d17de1" containerName="discovery" Aug 02 09:39:32.728980 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:32.728915 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="400ec88d-94f3-4ae2-b894-a6ad73d17de1" containerName="discovery" Aug 02 09:39:32.808223 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:32.808183 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-647d6f769c-4bb67"] Aug 02 09:39:32.808396 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:32.808297 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:32.835604 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:32.835569 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-g7xjz" Aug 02 09:39:32.911313 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:32.911282 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2743b604-841a-46da-a3da-a0ddc7317a58-console-serving-cert\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:32.911477 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:32.911320 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2743b604-841a-46da-a3da-a0ddc7317a58-oauth-serving-cert\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:32.911477 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:32.911405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2743b604-841a-46da-a3da-a0ddc7317a58-service-ca\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:32.911624 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:32.911479 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2743b604-841a-46da-a3da-a0ddc7317a58-console-config\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:32.911624 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:32.911521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2743b604-841a-46da-a3da-a0ddc7317a58-console-oauth-config\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:32.911624 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:32.911542 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2743b604-841a-46da-a3da-a0ddc7317a58-trusted-ca-bundle\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:32.911624 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:32.911565 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp54r\" (UniqueName: \"kubernetes.io/projected/2743b604-841a-46da-a3da-a0ddc7317a58-kube-api-access-wp54r\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.012327 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.012241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2743b604-841a-46da-a3da-a0ddc7317a58-console-oauth-config\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.012327 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.012280 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2743b604-841a-46da-a3da-a0ddc7317a58-trusted-ca-bundle\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.012327 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.012301 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp54r\" (UniqueName: \"kubernetes.io/projected/2743b604-841a-46da-a3da-a0ddc7317a58-kube-api-access-wp54r\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.012575 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.012337 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2743b604-841a-46da-a3da-a0ddc7317a58-console-serving-cert\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.012575 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.012469 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2743b604-841a-46da-a3da-a0ddc7317a58-oauth-serving-cert\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.012682 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.012572 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2743b604-841a-46da-a3da-a0ddc7317a58-service-ca\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.012956 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.012929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2743b604-841a-46da-a3da-a0ddc7317a58-console-config\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.013273 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.013246 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2743b604-841a-46da-a3da-a0ddc7317a58-oauth-serving-cert\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.013354 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.013246 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2743b604-841a-46da-a3da-a0ddc7317a58-trusted-ca-bundle\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.013354 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.013284 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2743b604-841a-46da-a3da-a0ddc7317a58-service-ca\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.013595 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.013576 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2743b604-841a-46da-a3da-a0ddc7317a58-console-config\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.014968 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.014948 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2743b604-841a-46da-a3da-a0ddc7317a58-console-serving-cert\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.015064 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.015046 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2743b604-841a-46da-a3da-a0ddc7317a58-console-oauth-config\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.022243 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.022216 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp54r\" (UniqueName: \"kubernetes.io/projected/2743b604-841a-46da-a3da-a0ddc7317a58-kube-api-access-wp54r\") pod \"console-647d6f769c-4bb67\" (UID: \"2743b604-841a-46da-a3da-a0ddc7317a58\") " pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.117227 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.117181 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:33.276111 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.276081 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-647d6f769c-4bb67"] Aug 02 09:39:33.277805 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:39:33.277762 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2743b604_841a_46da_a3da_a0ddc7317a58.slice/crio-384faa14c903827ec7444e362b7cf726cf5fc74e2ae964a23b81b03119eb52db WatchSource:0}: Error finding container 384faa14c903827ec7444e362b7cf726cf5fc74e2ae964a23b81b03119eb52db: Status 404 returned error can't find the container with id 384faa14c903827ec7444e362b7cf726cf5fc74e2ae964a23b81b03119eb52db Aug 02 09:39:33.842558 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.842529 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-7kz4n" Aug 02 09:39:33.921941 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.921904 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647d6f769c-4bb67" event={"ID":"2743b604-841a-46da-a3da-a0ddc7317a58","Type":"ContainerStarted","Data":"af1746593c2dd7391815b41871a04e05f0c0e92114139e649df1e2f035cfcdf6"} Aug 02 09:39:33.922108 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.921960 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647d6f769c-4bb67" event={"ID":"2743b604-841a-46da-a3da-a0ddc7317a58","Type":"ContainerStarted","Data":"384faa14c903827ec7444e362b7cf726cf5fc74e2ae964a23b81b03119eb52db"} Aug 02 09:39:33.939939 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:33.939890 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-647d6f769c-4bb67" podStartSLOduration=1.939873387 podStartE2EDuration="1.939873387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:39:33.936372499 +0000 UTC m=+410.497527823" watchObservedRunningTime="2026-08-02 09:39:33.939873387 +0000 UTC m=+410.501028719" Aug 02 09:39:36.164235 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.164206 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:36.242874 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.242750 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m5wj\" (UniqueName: \"kubernetes.io/projected/823c9705-b560-4331-b55a-a7a3eadcc0bb-kube-api-access-4m5wj\") pod \"823c9705-b560-4331-b55a-a7a3eadcc0bb\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " Aug 02 09:39:36.242874 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.242844 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-token\") pod \"823c9705-b560-4331-b55a-a7a3eadcc0bb\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " Aug 02 09:39:36.243120 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.242945 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-data\") pod \"823c9705-b560-4331-b55a-a7a3eadcc0bb\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " Aug 02 09:39:36.243120 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243005 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823c9705-b560-4331-b55a-a7a3eadcc0bb-istiod-ca-cert\") pod \"823c9705-b560-4331-b55a-a7a3eadcc0bb\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " Aug 02 09:39:36.243120 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243054 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-workload-socket\") pod \"823c9705-b560-4331-b55a-a7a3eadcc0bb\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " Aug 02 09:39:36.243120 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243082 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-credential-socket\") pod \"823c9705-b560-4331-b55a-a7a3eadcc0bb\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " Aug 02 09:39:36.243383 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243124 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-workload-certs\") pod \"823c9705-b560-4331-b55a-a7a3eadcc0bb\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " Aug 02 09:39:36.243383 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243167 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-envoy\") pod \"823c9705-b560-4331-b55a-a7a3eadcc0bb\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " Aug 02 09:39:36.243383 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243190 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "823c9705-b560-4331-b55a-a7a3eadcc0bb" (UID: "823c9705-b560-4331-b55a-a7a3eadcc0bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:39:36.243383 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243315 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "823c9705-b560-4331-b55a-a7a3eadcc0bb" (UID: "823c9705-b560-4331-b55a-a7a3eadcc0bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:39:36.243591 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243393 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "823c9705-b560-4331-b55a-a7a3eadcc0bb" (UID: "823c9705-b560-4331-b55a-a7a3eadcc0bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:39:36.243591 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243397 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/823c9705-b560-4331-b55a-a7a3eadcc0bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "823c9705-b560-4331-b55a-a7a3eadcc0bb" (UID: "823c9705-b560-4331-b55a-a7a3eadcc0bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:39:36.243591 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243412 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "823c9705-b560-4331-b55a-a7a3eadcc0bb" (UID: "823c9705-b560-4331-b55a-a7a3eadcc0bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:39:36.243591 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243500 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-podinfo\") pod \"823c9705-b560-4331-b55a-a7a3eadcc0bb\" (UID: \"823c9705-b560-4331-b55a-a7a3eadcc0bb\") " Aug 02 09:39:36.243830 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243811 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-data\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:36.243905 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243835 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823c9705-b560-4331-b55a-a7a3eadcc0bb-istiod-ca-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:36.243905 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243849 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-workload-socket\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:36.243905 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243864 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-credential-socket\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:36.243905 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.243880 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-workload-certs\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:36.245181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.245156 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "823c9705-b560-4331-b55a-a7a3eadcc0bb" (UID: "823c9705-b560-4331-b55a-a7a3eadcc0bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:39:36.245313 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.245182 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/823c9705-b560-4331-b55a-a7a3eadcc0bb-kube-api-access-4m5wj" (OuterVolumeSpecName: "kube-api-access-4m5wj") pod "823c9705-b560-4331-b55a-a7a3eadcc0bb" (UID: "823c9705-b560-4331-b55a-a7a3eadcc0bb"). InnerVolumeSpecName "kube-api-access-4m5wj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:39:36.245540 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.245519 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "823c9705-b560-4331-b55a-a7a3eadcc0bb" (UID: "823c9705-b560-4331-b55a-a7a3eadcc0bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 02 09:39:36.245602 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.245565 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "823c9705-b560-4331-b55a-a7a3eadcc0bb" (UID: "823c9705-b560-4331-b55a-a7a3eadcc0bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:39:36.345147 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.345118 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-podinfo\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:36.345147 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.345144 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m5wj\" (UniqueName: \"kubernetes.io/projected/823c9705-b560-4331-b55a-a7a3eadcc0bb-kube-api-access-4m5wj\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:36.345147 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.345156 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-token\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:36.345391 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.345167 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823c9705-b560-4331-b55a-a7a3eadcc0bb-istio-envoy\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:39:36.938406 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.938374 2575 generic.go:356] "Generic (PLEG): container finished" podID="823c9705-b560-4331-b55a-a7a3eadcc0bb" containerID="57396a17842f24469607c26db0d1993e01d46c827c980995d87f1bfa6dcc0966" exitCode=0 Aug 02 09:39:36.938573 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.938418 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" Aug 02 09:39:36.938573 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.938440 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" event={"ID":"823c9705-b560-4331-b55a-a7a3eadcc0bb","Type":"ContainerDied","Data":"57396a17842f24469607c26db0d1993e01d46c827c980995d87f1bfa6dcc0966"} Aug 02 09:39:36.938573 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.938480 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992" event={"ID":"823c9705-b560-4331-b55a-a7a3eadcc0bb","Type":"ContainerDied","Data":"73a6ac9e4d59257329b997eb99b5ec3932ae1e875e997bcc349faa1ec38d1232"} Aug 02 09:39:36.938573 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.938502 2575 scope.go:117] "RemoveContainer" containerID="57396a17842f24469607c26db0d1993e01d46c827c980995d87f1bfa6dcc0966" Aug 02 09:39:36.947504 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.947485 2575 scope.go:117] "RemoveContainer" containerID="57396a17842f24469607c26db0d1993e01d46c827c980995d87f1bfa6dcc0966" Aug 02 09:39:36.947748 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:39:36.947728 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57396a17842f24469607c26db0d1993e01d46c827c980995d87f1bfa6dcc0966\": container with ID starting with 57396a17842f24469607c26db0d1993e01d46c827c980995d87f1bfa6dcc0966 not found: ID does not exist" containerID="57396a17842f24469607c26db0d1993e01d46c827c980995d87f1bfa6dcc0966" Aug 02 09:39:36.947829 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.947759 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57396a17842f24469607c26db0d1993e01d46c827c980995d87f1bfa6dcc0966"} err="failed to get container status \"57396a17842f24469607c26db0d1993e01d46c827c980995d87f1bfa6dcc0966\": rpc error: code = NotFound desc = could not find container \"57396a17842f24469607c26db0d1993e01d46c827c980995d87f1bfa6dcc0966\": container with ID starting with 57396a17842f24469607c26db0d1993e01d46c827c980995d87f1bfa6dcc0966 not found: ID does not exist" Aug 02 09:39:36.963966 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.963944 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992"] Aug 02 09:39:36.967272 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:36.967250 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcb4992"] Aug 02 09:39:37.956227 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:37.956199 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="823c9705-b560-4331-b55a-a7a3eadcc0bb" path="/var/lib/kubelet/pods/823c9705-b560-4331-b55a-a7a3eadcc0bb/volumes" Aug 02 09:39:43.117669 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:43.117637 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:43.118192 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:43.117697 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:43.122498 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:43.122473 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:43.975092 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:43.975065 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-647d6f769c-4bb67" Aug 02 09:39:44.020255 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:39:44.020221 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677d9bc96b-7b4g2"] Aug 02 09:40:01.911601 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:01.911563 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z7hxh" Aug 02 09:40:01.914695 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:01.914675 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-57jwh" Aug 02 09:40:09.043446 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.043337 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-677d9bc96b-7b4g2" podUID="91988a50-00a0-4939-b50f-8480f1d0e7e5" containerName="console" containerID="cri-o://3b909b4ab3d86ff4c6c96317db1f7887d35ebb63c51f3ca8c314cb449afdf025" gracePeriod=15 Aug 02 09:40:09.308300 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.308275 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:40:09.440062 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.440024 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb7nq\" (UniqueName: \"kubernetes.io/projected/91988a50-00a0-4939-b50f-8480f1d0e7e5-kube-api-access-pb7nq\") pod \"91988a50-00a0-4939-b50f-8480f1d0e7e5\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " Aug 02 09:40:09.440062 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.440078 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-serving-cert\") pod \"91988a50-00a0-4939-b50f-8480f1d0e7e5\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " Aug 02 09:40:09.440316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.440112 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-oauth-config\") pod \"91988a50-00a0-4939-b50f-8480f1d0e7e5\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " Aug 02 09:40:09.440316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.440136 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-oauth-serving-cert\") pod \"91988a50-00a0-4939-b50f-8480f1d0e7e5\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " Aug 02 09:40:09.440316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.440245 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-config\") pod \"91988a50-00a0-4939-b50f-8480f1d0e7e5\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " Aug 02 09:40:09.440316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.440292 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-service-ca\") pod \"91988a50-00a0-4939-b50f-8480f1d0e7e5\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " Aug 02 09:40:09.440530 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.440381 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-trusted-ca-bundle\") pod \"91988a50-00a0-4939-b50f-8480f1d0e7e5\" (UID: \"91988a50-00a0-4939-b50f-8480f1d0e7e5\") " Aug 02 09:40:09.440632 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.440602 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-config" (OuterVolumeSpecName: "console-config") pod "91988a50-00a0-4939-b50f-8480f1d0e7e5" (UID: "91988a50-00a0-4939-b50f-8480f1d0e7e5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:40:09.440632 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.440536 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "91988a50-00a0-4939-b50f-8480f1d0e7e5" (UID: "91988a50-00a0-4939-b50f-8480f1d0e7e5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:40:09.440765 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.440737 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-service-ca" (OuterVolumeSpecName: "service-ca") pod "91988a50-00a0-4939-b50f-8480f1d0e7e5" (UID: "91988a50-00a0-4939-b50f-8480f1d0e7e5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:40:09.440975 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.440955 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "91988a50-00a0-4939-b50f-8480f1d0e7e5" (UID: "91988a50-00a0-4939-b50f-8480f1d0e7e5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 09:40:09.442431 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.442406 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91988a50-00a0-4939-b50f-8480f1d0e7e5-kube-api-access-pb7nq" (OuterVolumeSpecName: "kube-api-access-pb7nq") pod "91988a50-00a0-4939-b50f-8480f1d0e7e5" (UID: "91988a50-00a0-4939-b50f-8480f1d0e7e5"). InnerVolumeSpecName "kube-api-access-pb7nq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:40:09.442543 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.442462 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "91988a50-00a0-4939-b50f-8480f1d0e7e5" (UID: "91988a50-00a0-4939-b50f-8480f1d0e7e5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:40:09.442543 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.442539 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "91988a50-00a0-4939-b50f-8480f1d0e7e5" (UID: "91988a50-00a0-4939-b50f-8480f1d0e7e5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:40:09.542029 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.541987 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-trusted-ca-bundle\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:09.542029 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.542018 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb7nq\" (UniqueName: \"kubernetes.io/projected/91988a50-00a0-4939-b50f-8480f1d0e7e5-kube-api-access-pb7nq\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:09.542029 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.542027 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-serving-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:09.542267 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.542040 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-oauth-config\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:09.542267 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.542051 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-oauth-serving-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:09.542267 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.542060 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-console-config\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:09.542267 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:09.542068 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91988a50-00a0-4939-b50f-8480f1d0e7e5-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:10.098620 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:10.098585 2575 generic.go:356] "Generic (PLEG): container finished" podID="91988a50-00a0-4939-b50f-8480f1d0e7e5" containerID="3b909b4ab3d86ff4c6c96317db1f7887d35ebb63c51f3ca8c314cb449afdf025" exitCode=0 Aug 02 09:40:10.099027 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:10.098643 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677d9bc96b-7b4g2" Aug 02 09:40:10.099027 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:10.098647 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677d9bc96b-7b4g2" event={"ID":"91988a50-00a0-4939-b50f-8480f1d0e7e5","Type":"ContainerDied","Data":"3b909b4ab3d86ff4c6c96317db1f7887d35ebb63c51f3ca8c314cb449afdf025"} Aug 02 09:40:10.099027 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:10.098754 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677d9bc96b-7b4g2" event={"ID":"91988a50-00a0-4939-b50f-8480f1d0e7e5","Type":"ContainerDied","Data":"5e9c5bd4414f9eb2ec480df7d9a6d19caef2eda969085bea027cf40666c28b3c"} Aug 02 09:40:10.099027 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:10.098795 2575 scope.go:117] "RemoveContainer" containerID="3b909b4ab3d86ff4c6c96317db1f7887d35ebb63c51f3ca8c314cb449afdf025" Aug 02 09:40:10.107581 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:10.107564 2575 scope.go:117] "RemoveContainer" containerID="3b909b4ab3d86ff4c6c96317db1f7887d35ebb63c51f3ca8c314cb449afdf025" Aug 02 09:40:10.107852 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:40:10.107827 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b909b4ab3d86ff4c6c96317db1f7887d35ebb63c51f3ca8c314cb449afdf025\": container with ID starting with 3b909b4ab3d86ff4c6c96317db1f7887d35ebb63c51f3ca8c314cb449afdf025 not found: ID does not exist" containerID="3b909b4ab3d86ff4c6c96317db1f7887d35ebb63c51f3ca8c314cb449afdf025" Aug 02 09:40:10.107929 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:10.107862 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b909b4ab3d86ff4c6c96317db1f7887d35ebb63c51f3ca8c314cb449afdf025"} err="failed to get container status \"3b909b4ab3d86ff4c6c96317db1f7887d35ebb63c51f3ca8c314cb449afdf025\": rpc error: code = NotFound desc = could not find container \"3b909b4ab3d86ff4c6c96317db1f7887d35ebb63c51f3ca8c314cb449afdf025\": container with ID starting with 3b909b4ab3d86ff4c6c96317db1f7887d35ebb63c51f3ca8c314cb449afdf025 not found: ID does not exist" Aug 02 09:40:10.115130 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:10.115106 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677d9bc96b-7b4g2"] Aug 02 09:40:10.118402 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:10.118380 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-677d9bc96b-7b4g2"] Aug 02 09:40:11.955902 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:11.955868 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91988a50-00a0-4939-b50f-8480f1d0e7e5" path="/var/lib/kubelet/pods/91988a50-00a0-4939-b50f-8480f1d0e7e5/volumes" Aug 02 09:40:19.710334 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.710301 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf"] Aug 02 09:40:19.710705 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.710641 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="823c9705-b560-4331-b55a-a7a3eadcc0bb" containerName="istio-proxy" Aug 02 09:40:19.710705 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.710652 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="823c9705-b560-4331-b55a-a7a3eadcc0bb" containerName="istio-proxy" Aug 02 09:40:19.710705 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.710662 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91988a50-00a0-4939-b50f-8480f1d0e7e5" containerName="console" Aug 02 09:40:19.710705 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.710667 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="91988a50-00a0-4939-b50f-8480f1d0e7e5" containerName="console" Aug 02 09:40:19.710891 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.710721 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="823c9705-b560-4331-b55a-a7a3eadcc0bb" containerName="istio-proxy" Aug 02 09:40:19.710891 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.710729 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="91988a50-00a0-4939-b50f-8480f1d0e7e5" containerName="console" Aug 02 09:40:19.715127 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.715111 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" Aug 02 09:40:19.717357 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.717332 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 02 09:40:19.717357 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.717347 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 02 09:40:19.718474 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.718456 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cv7v4\"" Aug 02 09:40:19.721044 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.721020 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf"] Aug 02 09:40:19.727303 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.727284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf\" (UID: \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" Aug 02 09:40:19.727394 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.727342 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf\" (UID: \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" Aug 02 09:40:19.727434 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.727397 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gb8l\" (UniqueName: \"kubernetes.io/projected/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-kube-api-access-9gb8l\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf\" (UID: \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" Aug 02 09:40:19.806674 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.806643 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl"] Aug 02 09:40:19.810046 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.810028 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" Aug 02 09:40:19.817274 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.817252 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl"] Aug 02 09:40:19.828196 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.828170 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nst8z\" (UniqueName: \"kubernetes.io/projected/898125a0-5ccf-4f0d-96df-5d848f6518ac-kube-api-access-nst8z\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl\" (UID: \"898125a0-5ccf-4f0d-96df-5d848f6518ac\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" Aug 02 09:40:19.828309 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.828203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/898125a0-5ccf-4f0d-96df-5d848f6518ac-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl\" (UID: \"898125a0-5ccf-4f0d-96df-5d848f6518ac\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" Aug 02 09:40:19.828309 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.828224 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/898125a0-5ccf-4f0d-96df-5d848f6518ac-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl\" (UID: \"898125a0-5ccf-4f0d-96df-5d848f6518ac\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" Aug 02 09:40:19.828309 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.828272 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf\" (UID: \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" Aug 02 09:40:19.828416 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.828332 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gb8l\" (UniqueName: \"kubernetes.io/projected/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-kube-api-access-9gb8l\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf\" (UID: \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" Aug 02 09:40:19.828416 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.828375 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf\" (UID: \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" Aug 02 09:40:19.828563 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.828544 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf\" (UID: \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" Aug 02 09:40:19.828724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.828709 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf\" (UID: \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" Aug 02 09:40:19.836212 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.836191 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gb8l\" (UniqueName: \"kubernetes.io/projected/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-kube-api-access-9gb8l\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf\" (UID: \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" Aug 02 09:40:19.905660 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.905624 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m"] Aug 02 09:40:19.909283 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.909266 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" Aug 02 09:40:19.916880 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.916850 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m"] Aug 02 09:40:19.929490 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.929463 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/898125a0-5ccf-4f0d-96df-5d848f6518ac-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl\" (UID: \"898125a0-5ccf-4f0d-96df-5d848f6518ac\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" Aug 02 09:40:19.929624 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.929503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/710f89bc-717d-407e-9d6a-21a6f337c9a0-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m\" (UID: \"710f89bc-717d-407e-9d6a-21a6f337c9a0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" Aug 02 09:40:19.929624 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.929557 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25skx\" (UniqueName: \"kubernetes.io/projected/710f89bc-717d-407e-9d6a-21a6f337c9a0-kube-api-access-25skx\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m\" (UID: \"710f89bc-717d-407e-9d6a-21a6f337c9a0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" Aug 02 09:40:19.929624 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.929592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/710f89bc-717d-407e-9d6a-21a6f337c9a0-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m\" (UID: \"710f89bc-717d-407e-9d6a-21a6f337c9a0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" Aug 02 09:40:19.929821 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.929655 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nst8z\" (UniqueName: \"kubernetes.io/projected/898125a0-5ccf-4f0d-96df-5d848f6518ac-kube-api-access-nst8z\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl\" (UID: \"898125a0-5ccf-4f0d-96df-5d848f6518ac\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" Aug 02 09:40:19.929821 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.929704 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/898125a0-5ccf-4f0d-96df-5d848f6518ac-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl\" (UID: \"898125a0-5ccf-4f0d-96df-5d848f6518ac\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" Aug 02 09:40:19.929945 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.929837 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/898125a0-5ccf-4f0d-96df-5d848f6518ac-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl\" (UID: \"898125a0-5ccf-4f0d-96df-5d848f6518ac\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" Aug 02 09:40:19.930243 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.929947 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/898125a0-5ccf-4f0d-96df-5d848f6518ac-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl\" (UID: \"898125a0-5ccf-4f0d-96df-5d848f6518ac\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" Aug 02 09:40:19.937384 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:19.937363 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nst8z\" (UniqueName: \"kubernetes.io/projected/898125a0-5ccf-4f0d-96df-5d848f6518ac-kube-api-access-nst8z\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl\" (UID: \"898125a0-5ccf-4f0d-96df-5d848f6518ac\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" Aug 02 09:40:20.011798 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.011698 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw"] Aug 02 09:40:20.015361 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.015342 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" Aug 02 09:40:20.025242 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.025218 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw"] Aug 02 09:40:20.025352 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.025273 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" Aug 02 09:40:20.030416 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.030393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25skx\" (UniqueName: \"kubernetes.io/projected/710f89bc-717d-407e-9d6a-21a6f337c9a0-kube-api-access-25skx\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m\" (UID: \"710f89bc-717d-407e-9d6a-21a6f337c9a0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" Aug 02 09:40:20.030529 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.030429 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3459441d-b0b5-4c05-a3d0-8972f484ea80-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw\" (UID: \"3459441d-b0b5-4c05-a3d0-8972f484ea80\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" Aug 02 09:40:20.030529 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.030467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/710f89bc-717d-407e-9d6a-21a6f337c9a0-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m\" (UID: \"710f89bc-717d-407e-9d6a-21a6f337c9a0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" Aug 02 09:40:20.030529 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.030500 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3459441d-b0b5-4c05-a3d0-8972f484ea80-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw\" (UID: \"3459441d-b0b5-4c05-a3d0-8972f484ea80\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" Aug 02 09:40:20.030529 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.030523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-759hk\" (UniqueName: \"kubernetes.io/projected/3459441d-b0b5-4c05-a3d0-8972f484ea80-kube-api-access-759hk\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw\" (UID: \"3459441d-b0b5-4c05-a3d0-8972f484ea80\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" Aug 02 09:40:20.030808 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.030590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/710f89bc-717d-407e-9d6a-21a6f337c9a0-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m\" (UID: \"710f89bc-717d-407e-9d6a-21a6f337c9a0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" Aug 02 09:40:20.030929 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.030903 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/710f89bc-717d-407e-9d6a-21a6f337c9a0-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m\" (UID: \"710f89bc-717d-407e-9d6a-21a6f337c9a0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" Aug 02 09:40:20.030996 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.030928 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/710f89bc-717d-407e-9d6a-21a6f337c9a0-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m\" (UID: \"710f89bc-717d-407e-9d6a-21a6f337c9a0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" Aug 02 09:40:20.039120 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.039099 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25skx\" (UniqueName: \"kubernetes.io/projected/710f89bc-717d-407e-9d6a-21a6f337c9a0-kube-api-access-25skx\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m\" (UID: \"710f89bc-717d-407e-9d6a-21a6f337c9a0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" Aug 02 09:40:20.120396 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.120113 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" Aug 02 09:40:20.131114 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.131043 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3459441d-b0b5-4c05-a3d0-8972f484ea80-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw\" (UID: \"3459441d-b0b5-4c05-a3d0-8972f484ea80\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" Aug 02 09:40:20.131114 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.131113 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3459441d-b0b5-4c05-a3d0-8972f484ea80-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw\" (UID: \"3459441d-b0b5-4c05-a3d0-8972f484ea80\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" Aug 02 09:40:20.131311 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.131140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-759hk\" (UniqueName: \"kubernetes.io/projected/3459441d-b0b5-4c05-a3d0-8972f484ea80-kube-api-access-759hk\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw\" (UID: \"3459441d-b0b5-4c05-a3d0-8972f484ea80\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" Aug 02 09:40:20.131496 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.131468 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3459441d-b0b5-4c05-a3d0-8972f484ea80-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw\" (UID: \"3459441d-b0b5-4c05-a3d0-8972f484ea80\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" Aug 02 09:40:20.131794 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.131748 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3459441d-b0b5-4c05-a3d0-8972f484ea80-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw\" (UID: \"3459441d-b0b5-4c05-a3d0-8972f484ea80\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" Aug 02 09:40:20.144303 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.144225 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-759hk\" (UniqueName: \"kubernetes.io/projected/3459441d-b0b5-4c05-a3d0-8972f484ea80-kube-api-access-759hk\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw\" (UID: \"3459441d-b0b5-4c05-a3d0-8972f484ea80\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" Aug 02 09:40:20.171206 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.171125 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf"] Aug 02 09:40:20.173307 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:40:20.173278 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81ee1bae_811c_418f_bee0_76bdb2ca8ebf.slice/crio-096b7b1cb4183af826ee3e68f8573ca645e8e08665f3d0231268960e75427394 WatchSource:0}: Error finding container 096b7b1cb4183af826ee3e68f8573ca645e8e08665f3d0231268960e75427394: Status 404 returned error can't find the container with id 096b7b1cb4183af826ee3e68f8573ca645e8e08665f3d0231268960e75427394 Aug 02 09:40:20.219579 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.219558 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" Aug 02 09:40:20.277016 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.276988 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl"] Aug 02 09:40:20.277604 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:40:20.277562 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod898125a0_5ccf_4f0d_96df_5d848f6518ac.slice/crio-0dac54cc1d01e809fdbfa2b83f50380756ded39f6f42263079974db24d8fd92e WatchSource:0}: Error finding container 0dac54cc1d01e809fdbfa2b83f50380756ded39f6f42263079974db24d8fd92e: Status 404 returned error can't find the container with id 0dac54cc1d01e809fdbfa2b83f50380756ded39f6f42263079974db24d8fd92e Aug 02 09:40:20.325097 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.325073 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" Aug 02 09:40:20.371308 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.371284 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m"] Aug 02 09:40:20.475829 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:20.475792 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw"] Aug 02 09:40:20.476044 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:40:20.475928 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3459441d_b0b5_4c05_a3d0_8972f484ea80.slice/crio-f094f5fa2a66b1c8c21b46e65c4c93d81fa693798d1865906f3a467832fc8392 WatchSource:0}: Error finding container f094f5fa2a66b1c8c21b46e65c4c93d81fa693798d1865906f3a467832fc8392: Status 404 returned error can't find the container with id f094f5fa2a66b1c8c21b46e65c4c93d81fa693798d1865906f3a467832fc8392 Aug 02 09:40:21.154373 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:21.154341 2575 generic.go:356] "Generic (PLEG): container finished" podID="898125a0-5ccf-4f0d-96df-5d848f6518ac" containerID="9d77934aa26e97efb1a6d440fa011fa255286595e7926ec69b8d7814e5b8df4b" exitCode=0 Aug 02 09:40:21.154844 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:21.154426 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" event={"ID":"898125a0-5ccf-4f0d-96df-5d848f6518ac","Type":"ContainerDied","Data":"9d77934aa26e97efb1a6d440fa011fa255286595e7926ec69b8d7814e5b8df4b"} Aug 02 09:40:21.154844 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:21.154492 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" event={"ID":"898125a0-5ccf-4f0d-96df-5d848f6518ac","Type":"ContainerStarted","Data":"0dac54cc1d01e809fdbfa2b83f50380756ded39f6f42263079974db24d8fd92e"} Aug 02 09:40:21.156016 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:21.155994 2575 generic.go:356] "Generic (PLEG): container finished" podID="3459441d-b0b5-4c05-a3d0-8972f484ea80" containerID="a5ea86cc4f65063db09d2cf9c54f2def1c326a3c832cd0eba6ab89e1d9db8668" exitCode=0 Aug 02 09:40:21.156090 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:21.156074 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" event={"ID":"3459441d-b0b5-4c05-a3d0-8972f484ea80","Type":"ContainerDied","Data":"a5ea86cc4f65063db09d2cf9c54f2def1c326a3c832cd0eba6ab89e1d9db8668"} Aug 02 09:40:21.156152 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:21.156117 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" event={"ID":"3459441d-b0b5-4c05-a3d0-8972f484ea80","Type":"ContainerStarted","Data":"f094f5fa2a66b1c8c21b46e65c4c93d81fa693798d1865906f3a467832fc8392"} Aug 02 09:40:21.160866 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:21.160843 2575 generic.go:356] "Generic (PLEG): container finished" podID="81ee1bae-811c-418f-bee0-76bdb2ca8ebf" containerID="e453046e517f3a96af8d6ade63269fff0f29416f2400d51845a3854f69ef0456" exitCode=0 Aug 02 09:40:21.160977 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:21.160936 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" event={"ID":"81ee1bae-811c-418f-bee0-76bdb2ca8ebf","Type":"ContainerDied","Data":"e453046e517f3a96af8d6ade63269fff0f29416f2400d51845a3854f69ef0456"} Aug 02 09:40:21.160977 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:21.160974 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" event={"ID":"81ee1bae-811c-418f-bee0-76bdb2ca8ebf","Type":"ContainerStarted","Data":"096b7b1cb4183af826ee3e68f8573ca645e8e08665f3d0231268960e75427394"} Aug 02 09:40:21.162840 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:21.162819 2575 generic.go:356] "Generic (PLEG): container finished" podID="710f89bc-717d-407e-9d6a-21a6f337c9a0" containerID="5430d71856e205b73459589cdd7b7e12e3edde8b5aec64eb5f6517346d04dcc0" exitCode=0 Aug 02 09:40:21.162927 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:21.162888 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" event={"ID":"710f89bc-717d-407e-9d6a-21a6f337c9a0","Type":"ContainerDied","Data":"5430d71856e205b73459589cdd7b7e12e3edde8b5aec64eb5f6517346d04dcc0"} Aug 02 09:40:21.162986 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:21.162927 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" event={"ID":"710f89bc-717d-407e-9d6a-21a6f337c9a0","Type":"ContainerStarted","Data":"4f6a706c1aa82222d256b6a02cf3acbf8fdf3a865949a8114664f1ece411714f"} Aug 02 09:40:22.169584 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:22.169556 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" event={"ID":"3459441d-b0b5-4c05-a3d0-8972f484ea80","Type":"ContainerStarted","Data":"3f3cf6b75695a3a5ebba0cc0c1aa2a3191a9b1f6cbe37ee2609e227975fcb022"} Aug 02 09:40:22.171258 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:22.171234 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" event={"ID":"710f89bc-717d-407e-9d6a-21a6f337c9a0","Type":"ContainerStarted","Data":"b38831d06e72cdf1d7f63fcb115f2da42f2b8c94cb4ca3422c3eae2e55b0b71e"} Aug 02 09:40:23.178165 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:23.178127 2575 generic.go:356] "Generic (PLEG): container finished" podID="3459441d-b0b5-4c05-a3d0-8972f484ea80" containerID="3f3cf6b75695a3a5ebba0cc0c1aa2a3191a9b1f6cbe37ee2609e227975fcb022" exitCode=0 Aug 02 09:40:23.178584 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:23.178202 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" event={"ID":"3459441d-b0b5-4c05-a3d0-8972f484ea80","Type":"ContainerDied","Data":"3f3cf6b75695a3a5ebba0cc0c1aa2a3191a9b1f6cbe37ee2609e227975fcb022"} Aug 02 09:40:23.180203 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:23.180148 2575 generic.go:356] "Generic (PLEG): container finished" podID="81ee1bae-811c-418f-bee0-76bdb2ca8ebf" containerID="713c5eb89f3e2038852a8bcb317ea81cf4a4a70bba4548620fac2c4ff5e224cf" exitCode=0 Aug 02 09:40:23.180292 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:23.180269 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" event={"ID":"81ee1bae-811c-418f-bee0-76bdb2ca8ebf","Type":"ContainerDied","Data":"713c5eb89f3e2038852a8bcb317ea81cf4a4a70bba4548620fac2c4ff5e224cf"} Aug 02 09:40:23.182475 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:23.182453 2575 generic.go:356] "Generic (PLEG): container finished" podID="710f89bc-717d-407e-9d6a-21a6f337c9a0" containerID="b38831d06e72cdf1d7f63fcb115f2da42f2b8c94cb4ca3422c3eae2e55b0b71e" exitCode=0 Aug 02 09:40:23.182553 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:23.182500 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" event={"ID":"710f89bc-717d-407e-9d6a-21a6f337c9a0","Type":"ContainerDied","Data":"b38831d06e72cdf1d7f63fcb115f2da42f2b8c94cb4ca3422c3eae2e55b0b71e"} Aug 02 09:40:23.184629 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:23.184605 2575 generic.go:356] "Generic (PLEG): container finished" podID="898125a0-5ccf-4f0d-96df-5d848f6518ac" containerID="f9bbb0d536f18763d274f7c9e63a6f23466b5fc9707a4400fe70b03c0edfb426" exitCode=0 Aug 02 09:40:23.184724 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:23.184666 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" event={"ID":"898125a0-5ccf-4f0d-96df-5d848f6518ac","Type":"ContainerDied","Data":"f9bbb0d536f18763d274f7c9e63a6f23466b5fc9707a4400fe70b03c0edfb426"} Aug 02 09:40:24.193042 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:24.193006 2575 generic.go:356] "Generic (PLEG): container finished" podID="898125a0-5ccf-4f0d-96df-5d848f6518ac" containerID="ee911cbd73b39b8be8b7257c1565c7f5b1bb90e843780d238bbc529e7e96bcf2" exitCode=0 Aug 02 09:40:24.193446 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:24.193084 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" event={"ID":"898125a0-5ccf-4f0d-96df-5d848f6518ac","Type":"ContainerDied","Data":"ee911cbd73b39b8be8b7257c1565c7f5b1bb90e843780d238bbc529e7e96bcf2"} Aug 02 09:40:24.195288 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:24.195265 2575 generic.go:356] "Generic (PLEG): container finished" podID="3459441d-b0b5-4c05-a3d0-8972f484ea80" containerID="c797acb09b3ed73afbfa2e8ad8486c5b9457a0d5e7aaf6195068905e7e3c60d2" exitCode=0 Aug 02 09:40:24.195434 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:24.195331 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" event={"ID":"3459441d-b0b5-4c05-a3d0-8972f484ea80","Type":"ContainerDied","Data":"c797acb09b3ed73afbfa2e8ad8486c5b9457a0d5e7aaf6195068905e7e3c60d2"} Aug 02 09:40:24.197478 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:24.197456 2575 generic.go:356] "Generic (PLEG): container finished" podID="81ee1bae-811c-418f-bee0-76bdb2ca8ebf" containerID="3693c3f7132f9a908686dd23fd5eb9ac11b1a017fd2e2a05a5f3f4552b25969e" exitCode=0 Aug 02 09:40:24.197592 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:24.197541 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" event={"ID":"81ee1bae-811c-418f-bee0-76bdb2ca8ebf","Type":"ContainerDied","Data":"3693c3f7132f9a908686dd23fd5eb9ac11b1a017fd2e2a05a5f3f4552b25969e"} Aug 02 09:40:24.199638 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:24.199616 2575 generic.go:356] "Generic (PLEG): container finished" podID="710f89bc-717d-407e-9d6a-21a6f337c9a0" containerID="5e6605d4334f084c0b3b86873008ee69ff873d30e203939a7f4941d74b7e8391" exitCode=0 Aug 02 09:40:24.199722 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:24.199642 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" event={"ID":"710f89bc-717d-407e-9d6a-21a6f337c9a0","Type":"ContainerDied","Data":"5e6605d4334f084c0b3b86873008ee69ff873d30e203939a7f4941d74b7e8391"} Aug 02 09:40:25.367859 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.367833 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" Aug 02 09:40:25.389447 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.389416 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" Aug 02 09:40:25.426330 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.426299 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" Aug 02 09:40:25.430897 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.430878 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" Aug 02 09:40:25.477405 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.477329 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3459441d-b0b5-4c05-a3d0-8972f484ea80-bundle\") pod \"3459441d-b0b5-4c05-a3d0-8972f484ea80\" (UID: \"3459441d-b0b5-4c05-a3d0-8972f484ea80\") " Aug 02 09:40:25.477405 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.477365 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-759hk\" (UniqueName: \"kubernetes.io/projected/3459441d-b0b5-4c05-a3d0-8972f484ea80-kube-api-access-759hk\") pod \"3459441d-b0b5-4c05-a3d0-8972f484ea80\" (UID: \"3459441d-b0b5-4c05-a3d0-8972f484ea80\") " Aug 02 09:40:25.477405 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.477397 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nst8z\" (UniqueName: \"kubernetes.io/projected/898125a0-5ccf-4f0d-96df-5d848f6518ac-kube-api-access-nst8z\") pod \"898125a0-5ccf-4f0d-96df-5d848f6518ac\" (UID: \"898125a0-5ccf-4f0d-96df-5d848f6518ac\") " Aug 02 09:40:25.477682 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.477420 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/898125a0-5ccf-4f0d-96df-5d848f6518ac-util\") pod \"898125a0-5ccf-4f0d-96df-5d848f6518ac\" (UID: \"898125a0-5ccf-4f0d-96df-5d848f6518ac\") " Aug 02 09:40:25.477682 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.477449 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/710f89bc-717d-407e-9d6a-21a6f337c9a0-bundle\") pod \"710f89bc-717d-407e-9d6a-21a6f337c9a0\" (UID: \"710f89bc-717d-407e-9d6a-21a6f337c9a0\") " Aug 02 09:40:25.477682 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.477478 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25skx\" (UniqueName: \"kubernetes.io/projected/710f89bc-717d-407e-9d6a-21a6f337c9a0-kube-api-access-25skx\") pod \"710f89bc-717d-407e-9d6a-21a6f337c9a0\" (UID: \"710f89bc-717d-407e-9d6a-21a6f337c9a0\") " Aug 02 09:40:25.477682 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.477504 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3459441d-b0b5-4c05-a3d0-8972f484ea80-util\") pod \"3459441d-b0b5-4c05-a3d0-8972f484ea80\" (UID: \"3459441d-b0b5-4c05-a3d0-8972f484ea80\") " Aug 02 09:40:25.478240 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.477854 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gb8l\" (UniqueName: \"kubernetes.io/projected/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-kube-api-access-9gb8l\") pod \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\" (UID: \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\") " Aug 02 09:40:25.478240 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.477922 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3459441d-b0b5-4c05-a3d0-8972f484ea80-bundle" (OuterVolumeSpecName: "bundle") pod "3459441d-b0b5-4c05-a3d0-8972f484ea80" (UID: "3459441d-b0b5-4c05-a3d0-8972f484ea80"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:40:25.478240 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.477968 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-bundle\") pod \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\" (UID: \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\") " Aug 02 09:40:25.478240 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.478015 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/710f89bc-717d-407e-9d6a-21a6f337c9a0-util\") pod \"710f89bc-717d-407e-9d6a-21a6f337c9a0\" (UID: \"710f89bc-717d-407e-9d6a-21a6f337c9a0\") " Aug 02 09:40:25.478240 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.478053 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-util\") pod \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\" (UID: \"81ee1bae-811c-418f-bee0-76bdb2ca8ebf\") " Aug 02 09:40:25.478240 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.478087 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/898125a0-5ccf-4f0d-96df-5d848f6518ac-bundle\") pod \"898125a0-5ccf-4f0d-96df-5d848f6518ac\" (UID: \"898125a0-5ccf-4f0d-96df-5d848f6518ac\") " Aug 02 09:40:25.478240 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.478097 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/710f89bc-717d-407e-9d6a-21a6f337c9a0-bundle" (OuterVolumeSpecName: "bundle") pod "710f89bc-717d-407e-9d6a-21a6f337c9a0" (UID: "710f89bc-717d-407e-9d6a-21a6f337c9a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:40:25.478626 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.478554 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3459441d-b0b5-4c05-a3d0-8972f484ea80-bundle\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:25.478626 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.478571 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/710f89bc-717d-407e-9d6a-21a6f337c9a0-bundle\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:25.486423 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.478951 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-bundle" (OuterVolumeSpecName: "bundle") pod "81ee1bae-811c-418f-bee0-76bdb2ca8ebf" (UID: "81ee1bae-811c-418f-bee0-76bdb2ca8ebf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:40:25.486423 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.479252 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898125a0-5ccf-4f0d-96df-5d848f6518ac-bundle" (OuterVolumeSpecName: "bundle") pod "898125a0-5ccf-4f0d-96df-5d848f6518ac" (UID: "898125a0-5ccf-4f0d-96df-5d848f6518ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:40:25.486423 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.484083 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3459441d-b0b5-4c05-a3d0-8972f484ea80-util" (OuterVolumeSpecName: "util") pod "3459441d-b0b5-4c05-a3d0-8972f484ea80" (UID: "3459441d-b0b5-4c05-a3d0-8972f484ea80"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:40:25.486423 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.485343 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/710f89bc-717d-407e-9d6a-21a6f337c9a0-kube-api-access-25skx" (OuterVolumeSpecName: "kube-api-access-25skx") pod "710f89bc-717d-407e-9d6a-21a6f337c9a0" (UID: "710f89bc-717d-407e-9d6a-21a6f337c9a0"). InnerVolumeSpecName "kube-api-access-25skx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:40:25.486423 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.485370 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-kube-api-access-9gb8l" (OuterVolumeSpecName: "kube-api-access-9gb8l") pod "81ee1bae-811c-418f-bee0-76bdb2ca8ebf" (UID: "81ee1bae-811c-418f-bee0-76bdb2ca8ebf"). InnerVolumeSpecName "kube-api-access-9gb8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:40:25.486423 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.485373 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3459441d-b0b5-4c05-a3d0-8972f484ea80-kube-api-access-759hk" (OuterVolumeSpecName: "kube-api-access-759hk") pod "3459441d-b0b5-4c05-a3d0-8972f484ea80" (UID: "3459441d-b0b5-4c05-a3d0-8972f484ea80"). InnerVolumeSpecName "kube-api-access-759hk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:40:25.486423 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.485728 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/898125a0-5ccf-4f0d-96df-5d848f6518ac-kube-api-access-nst8z" (OuterVolumeSpecName: "kube-api-access-nst8z") pod "898125a0-5ccf-4f0d-96df-5d848f6518ac" (UID: "898125a0-5ccf-4f0d-96df-5d848f6518ac"). InnerVolumeSpecName "kube-api-access-nst8z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:40:25.486423 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.486359 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898125a0-5ccf-4f0d-96df-5d848f6518ac-util" (OuterVolumeSpecName: "util") pod "898125a0-5ccf-4f0d-96df-5d848f6518ac" (UID: "898125a0-5ccf-4f0d-96df-5d848f6518ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:40:25.488268 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.488241 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-util" (OuterVolumeSpecName: "util") pod "81ee1bae-811c-418f-bee0-76bdb2ca8ebf" (UID: "81ee1bae-811c-418f-bee0-76bdb2ca8ebf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:40:25.489654 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.489637 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/710f89bc-717d-407e-9d6a-21a6f337c9a0-util" (OuterVolumeSpecName: "util") pod "710f89bc-717d-407e-9d6a-21a6f337c9a0" (UID: "710f89bc-717d-407e-9d6a-21a6f337c9a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:40:25.579391 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.579356 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gb8l\" (UniqueName: \"kubernetes.io/projected/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-kube-api-access-9gb8l\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:25.579391 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.579384 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-bundle\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:25.579391 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.579394 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/710f89bc-717d-407e-9d6a-21a6f337c9a0-util\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:25.579391 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.579403 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81ee1bae-811c-418f-bee0-76bdb2ca8ebf-util\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:25.579646 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.579411 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/898125a0-5ccf-4f0d-96df-5d848f6518ac-bundle\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:25.579646 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.579420 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-759hk\" (UniqueName: \"kubernetes.io/projected/3459441d-b0b5-4c05-a3d0-8972f484ea80-kube-api-access-759hk\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:25.579646 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.579428 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nst8z\" (UniqueName: \"kubernetes.io/projected/898125a0-5ccf-4f0d-96df-5d848f6518ac-kube-api-access-nst8z\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:25.579646 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.579436 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/898125a0-5ccf-4f0d-96df-5d848f6518ac-util\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:25.579646 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.579444 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25skx\" (UniqueName: \"kubernetes.io/projected/710f89bc-717d-407e-9d6a-21a6f337c9a0-kube-api-access-25skx\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:25.579646 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:25.579452 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3459441d-b0b5-4c05-a3d0-8972f484ea80-util\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:26.214791 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:26.214739 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" Aug 02 09:40:26.214791 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:26.214760 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532m2vl" event={"ID":"898125a0-5ccf-4f0d-96df-5d848f6518ac","Type":"ContainerDied","Data":"0dac54cc1d01e809fdbfa2b83f50380756ded39f6f42263079974db24d8fd92e"} Aug 02 09:40:26.214987 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:26.214848 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0dac54cc1d01e809fdbfa2b83f50380756ded39f6f42263079974db24d8fd92e" Aug 02 09:40:26.216644 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:26.216597 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" event={"ID":"3459441d-b0b5-4c05-a3d0-8972f484ea80","Type":"ContainerDied","Data":"f094f5fa2a66b1c8c21b46e65c4c93d81fa693798d1865906f3a467832fc8392"} Aug 02 09:40:26.216644 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:26.216642 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f094f5fa2a66b1c8c21b46e65c4c93d81fa693798d1865906f3a467832fc8392" Aug 02 09:40:26.216863 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:26.216610 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08hnnw" Aug 02 09:40:26.218964 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:26.218938 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" event={"ID":"81ee1bae-811c-418f-bee0-76bdb2ca8ebf","Type":"ContainerDied","Data":"096b7b1cb4183af826ee3e68f8573ca645e8e08665f3d0231268960e75427394"} Aug 02 09:40:26.219078 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:26.218976 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="096b7b1cb4183af826ee3e68f8573ca645e8e08665f3d0231268960e75427394" Aug 02 09:40:26.219078 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:26.219071 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwn2wf" Aug 02 09:40:26.220988 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:26.220898 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" event={"ID":"710f89bc-717d-407e-9d6a-21a6f337c9a0","Type":"ContainerDied","Data":"4f6a706c1aa82222d256b6a02cf3acbf8fdf3a865949a8114664f1ece411714f"} Aug 02 09:40:26.220988 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:26.220936 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f6a706c1aa82222d256b6a02cf3acbf8fdf3a865949a8114664f1ece411714f" Aug 02 09:40:26.220988 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:26.220962 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbf8r6m" Aug 02 09:40:30.693190 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693158 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29"] Aug 02 09:40:30.693550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693489 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3459441d-b0b5-4c05-a3d0-8972f484ea80" containerName="pull" Aug 02 09:40:30.693550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693499 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3459441d-b0b5-4c05-a3d0-8972f484ea80" containerName="pull" Aug 02 09:40:30.693550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693511 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3459441d-b0b5-4c05-a3d0-8972f484ea80" containerName="util" Aug 02 09:40:30.693550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693517 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3459441d-b0b5-4c05-a3d0-8972f484ea80" containerName="util" Aug 02 09:40:30.693550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693524 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="898125a0-5ccf-4f0d-96df-5d848f6518ac" containerName="util" Aug 02 09:40:30.693550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693529 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="898125a0-5ccf-4f0d-96df-5d848f6518ac" containerName="util" Aug 02 09:40:30.693550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693536 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="898125a0-5ccf-4f0d-96df-5d848f6518ac" containerName="pull" Aug 02 09:40:30.693550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693542 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="898125a0-5ccf-4f0d-96df-5d848f6518ac" containerName="pull" Aug 02 09:40:30.693550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693548 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="898125a0-5ccf-4f0d-96df-5d848f6518ac" containerName="extract" Aug 02 09:40:30.693550 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693553 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="898125a0-5ccf-4f0d-96df-5d848f6518ac" containerName="extract" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693562 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3459441d-b0b5-4c05-a3d0-8972f484ea80" containerName="extract" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693567 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3459441d-b0b5-4c05-a3d0-8972f484ea80" containerName="extract" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693574 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81ee1bae-811c-418f-bee0-76bdb2ca8ebf" containerName="util" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693579 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="81ee1bae-811c-418f-bee0-76bdb2ca8ebf" containerName="util" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693589 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="710f89bc-717d-407e-9d6a-21a6f337c9a0" containerName="pull" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693594 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="710f89bc-717d-407e-9d6a-21a6f337c9a0" containerName="pull" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693600 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81ee1bae-811c-418f-bee0-76bdb2ca8ebf" containerName="pull" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693605 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="81ee1bae-811c-418f-bee0-76bdb2ca8ebf" containerName="pull" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693610 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="710f89bc-717d-407e-9d6a-21a6f337c9a0" containerName="extract" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693615 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="710f89bc-717d-407e-9d6a-21a6f337c9a0" containerName="extract" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693623 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81ee1bae-811c-418f-bee0-76bdb2ca8ebf" containerName="extract" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693628 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="81ee1bae-811c-418f-bee0-76bdb2ca8ebf" containerName="extract" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693638 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="710f89bc-717d-407e-9d6a-21a6f337c9a0" containerName="util" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693643 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="710f89bc-717d-407e-9d6a-21a6f337c9a0" containerName="util" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693695 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="710f89bc-717d-407e-9d6a-21a6f337c9a0" containerName="extract" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693702 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="81ee1bae-811c-418f-bee0-76bdb2ca8ebf" containerName="extract" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693710 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3459441d-b0b5-4c05-a3d0-8972f484ea80" containerName="extract" Aug 02 09:40:30.693881 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.693716 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="898125a0-5ccf-4f0d-96df-5d848f6518ac" containerName="extract" Aug 02 09:40:30.697949 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.697921 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" Aug 02 09:40:30.700338 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.700318 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qvmb5\"" Aug 02 09:40:30.700451 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.700337 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Aug 02 09:40:30.701131 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.701115 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Aug 02 09:40:30.708868 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.708836 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29"] Aug 02 09:40:30.723957 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.723934 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bz5g\" (UniqueName: \"kubernetes.io/projected/62f8f529-46c5-45fe-aa99-864fa7ebf04b-kube-api-access-4bz5g\") pod \"limitador-operator-controller-manager-6c549b6d85-8qx29\" (UID: \"62f8f529-46c5-45fe-aa99-864fa7ebf04b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" Aug 02 09:40:30.824655 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.824620 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bz5g\" (UniqueName: \"kubernetes.io/projected/62f8f529-46c5-45fe-aa99-864fa7ebf04b-kube-api-access-4bz5g\") pod \"limitador-operator-controller-manager-6c549b6d85-8qx29\" (UID: \"62f8f529-46c5-45fe-aa99-864fa7ebf04b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" Aug 02 09:40:30.838434 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:30.838411 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bz5g\" (UniqueName: \"kubernetes.io/projected/62f8f529-46c5-45fe-aa99-864fa7ebf04b-kube-api-access-4bz5g\") pod \"limitador-operator-controller-manager-6c549b6d85-8qx29\" (UID: \"62f8f529-46c5-45fe-aa99-864fa7ebf04b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" Aug 02 09:40:31.009628 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:31.009553 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" Aug 02 09:40:31.149025 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:31.148994 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29"] Aug 02 09:40:31.152117 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:40:31.152082 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f8f529_46c5_45fe_aa99_864fa7ebf04b.slice/crio-9c638ebdba00f2c3754792ea2136bf8a4958121e1276b9a63c94360e90de6762 WatchSource:0}: Error finding container 9c638ebdba00f2c3754792ea2136bf8a4958121e1276b9a63c94360e90de6762: Status 404 returned error can't find the container with id 9c638ebdba00f2c3754792ea2136bf8a4958121e1276b9a63c94360e90de6762 Aug 02 09:40:31.246180 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:31.246144 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" event={"ID":"62f8f529-46c5-45fe-aa99-864fa7ebf04b","Type":"ContainerStarted","Data":"9c638ebdba00f2c3754792ea2136bf8a4958121e1276b9a63c94360e90de6762"} Aug 02 09:40:33.238592 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:33.238561 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-8dfz2"] Aug 02 09:40:33.243089 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:33.243071 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-8dfz2" Aug 02 09:40:33.245519 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:33.245501 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6lfkz\"" Aug 02 09:40:33.266652 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:33.266627 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-8dfz2"] Aug 02 09:40:33.343745 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:33.343712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m476f\" (UniqueName: \"kubernetes.io/projected/e1de6967-02d4-4ff1-98c5-c65f58987570-kube-api-access-m476f\") pod \"authorino-operator-68d88948d8-8dfz2\" (UID: \"e1de6967-02d4-4ff1-98c5-c65f58987570\") " pod="kuadrant-system/authorino-operator-68d88948d8-8dfz2" Aug 02 09:40:33.444837 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:33.444804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m476f\" (UniqueName: \"kubernetes.io/projected/e1de6967-02d4-4ff1-98c5-c65f58987570-kube-api-access-m476f\") pod \"authorino-operator-68d88948d8-8dfz2\" (UID: \"e1de6967-02d4-4ff1-98c5-c65f58987570\") " pod="kuadrant-system/authorino-operator-68d88948d8-8dfz2" Aug 02 09:40:33.459326 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:33.459289 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m476f\" (UniqueName: \"kubernetes.io/projected/e1de6967-02d4-4ff1-98c5-c65f58987570-kube-api-access-m476f\") pod \"authorino-operator-68d88948d8-8dfz2\" (UID: \"e1de6967-02d4-4ff1-98c5-c65f58987570\") " pod="kuadrant-system/authorino-operator-68d88948d8-8dfz2" Aug 02 09:40:33.553665 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:33.553632 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-8dfz2" Aug 02 09:40:33.684553 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:33.684529 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-8dfz2"] Aug 02 09:40:33.686122 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:40:33.686091 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1de6967_02d4_4ff1_98c5_c65f58987570.slice/crio-0da684d642819f5189156468e61b484773c024a8ef93c56b06b96d317e7225ee WatchSource:0}: Error finding container 0da684d642819f5189156468e61b484773c024a8ef93c56b06b96d317e7225ee: Status 404 returned error can't find the container with id 0da684d642819f5189156468e61b484773c024a8ef93c56b06b96d317e7225ee Aug 02 09:40:34.262402 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:34.262367 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-8dfz2" event={"ID":"e1de6967-02d4-4ff1-98c5-c65f58987570","Type":"ContainerStarted","Data":"0da684d642819f5189156468e61b484773c024a8ef93c56b06b96d317e7225ee"} Aug 02 09:40:37.282204 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:37.282166 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-8dfz2" event={"ID":"e1de6967-02d4-4ff1-98c5-c65f58987570","Type":"ContainerStarted","Data":"ee6a466493b59d6765dcdf4046bc26440ae32b9ee24383568222f90ab28247e5"} Aug 02 09:40:37.282620 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:37.282366 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-8dfz2" Aug 02 09:40:37.306643 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:37.306592 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-8dfz2" podStartSLOduration=1.575040065 podStartE2EDuration="4.306578574s" totalImagesPullingTime="2.731538509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:40:37.305532348 +0000 UTC m=+473.866687668" watchObservedRunningTime="2026-08-02 09:40:37.306578574 +0000 UTC m=+473.867733932" Aug 02 09:40:37.540000 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:37.539971 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj"] Aug 02 09:40:37.543593 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:37.543577 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:37.545854 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:37.545823 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sd755\"" Aug 02 09:40:37.569714 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:37.569688 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj"] Aug 02 09:40:37.579538 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:37.579510 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d23838aa-fad0-4d11-8026-c857888de8ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-xs4cj\" (UID: \"d23838aa-fad0-4d11-8026-c857888de8ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:37.579677 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:37.579580 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rsdr\" (UniqueName: \"kubernetes.io/projected/d23838aa-fad0-4d11-8026-c857888de8ae-kube-api-access-8rsdr\") pod \"kuadrant-operator-controller-manager-58fc56757c-xs4cj\" (UID: \"d23838aa-fad0-4d11-8026-c857888de8ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:37.680889 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:37.680853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rsdr\" (UniqueName: \"kubernetes.io/projected/d23838aa-fad0-4d11-8026-c857888de8ae-kube-api-access-8rsdr\") pod \"kuadrant-operator-controller-manager-58fc56757c-xs4cj\" (UID: \"d23838aa-fad0-4d11-8026-c857888de8ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:37.681028 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:37.680913 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d23838aa-fad0-4d11-8026-c857888de8ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-xs4cj\" (UID: \"d23838aa-fad0-4d11-8026-c857888de8ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:37.681247 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:37.681232 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d23838aa-fad0-4d11-8026-c857888de8ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-xs4cj\" (UID: \"d23838aa-fad0-4d11-8026-c857888de8ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:37.691000 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:37.690971 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rsdr\" (UniqueName: \"kubernetes.io/projected/d23838aa-fad0-4d11-8026-c857888de8ae-kube-api-access-8rsdr\") pod \"kuadrant-operator-controller-manager-58fc56757c-xs4cj\" (UID: \"d23838aa-fad0-4d11-8026-c857888de8ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:37.853936 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:37.853858 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:38.008313 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:38.008288 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj"] Aug 02 09:40:38.010262 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:40:38.010237 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd23838aa_fad0_4d11_8026_c857888de8ae.slice/crio-fd8b269c91ced12e8d0fce900aa5d374f7226ce448e405c3cb2a1a803facc2de WatchSource:0}: Error finding container fd8b269c91ced12e8d0fce900aa5d374f7226ce448e405c3cb2a1a803facc2de: Status 404 returned error can't find the container with id fd8b269c91ced12e8d0fce900aa5d374f7226ce448e405c3cb2a1a803facc2de Aug 02 09:40:38.289194 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:38.289168 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" event={"ID":"d23838aa-fad0-4d11-8026-c857888de8ae","Type":"ContainerStarted","Data":"fd8b269c91ced12e8d0fce900aa5d374f7226ce448e405c3cb2a1a803facc2de"} Aug 02 09:40:42.314621 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:42.314578 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" event={"ID":"d23838aa-fad0-4d11-8026-c857888de8ae","Type":"ContainerStarted","Data":"eb721ec61f0436dfa1499111fcb73976a140dea66e45f20743b186fb495e4302"} Aug 02 09:40:42.315105 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:42.314682 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:42.316268 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:42.316242 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" event={"ID":"62f8f529-46c5-45fe-aa99-864fa7ebf04b","Type":"ContainerStarted","Data":"11084f1427b88f2248f4b5dca5b8ad28a71fa8c6af63f4679e5373adec789f23"} Aug 02 09:40:42.316331 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:42.316318 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" Aug 02 09:40:42.334497 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:42.334437 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" podStartSLOduration=1.41628998 podStartE2EDuration="5.334418518s" totalImagesPullingTime="3.918128538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:40:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:40:42.332768336 +0000 UTC m=+478.893923657" watchObservedRunningTime="2026-08-02 09:40:42.334418518 +0000 UTC m=+478.895573839" Aug 02 09:40:42.347638 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:42.347583 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" podStartSLOduration=1.63973003 podStartE2EDuration="12.347569689s" totalImagesPullingTime="10.707839659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:40:42.347088487 +0000 UTC m=+478.908243821" watchObservedRunningTime="2026-08-02 09:40:42.347569689 +0000 UTC m=+478.908725008" Aug 02 09:40:48.291864 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:48.291831 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-8dfz2" Aug 02 09:40:53.326685 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:53.326654 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:53.327077 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:53.326731 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" Aug 02 09:40:55.163549 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.163513 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj"] Aug 02 09:40:55.163955 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.163707 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" podUID="d23838aa-fad0-4d11-8026-c857888de8ae" containerName="manager" containerID="cri-o://eb721ec61f0436dfa1499111fcb73976a140dea66e45f20743b186fb495e4302" gracePeriod=2 Aug 02 09:40:55.173169 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.173140 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj"] Aug 02 09:40:55.175316 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:40:55.175282 2575 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d23838aa-fad0-4d11-8026-c857888de8ae\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-xs4cj\": pods \"kuadrant-operator-controller-manager-58fc56757c-xs4cj\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:55.183316 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.183297 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29"] Aug 02 09:40:55.183502 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.183478 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" podUID="62f8f529-46c5-45fe-aa99-864fa7ebf04b" containerName="manager" containerID="cri-o://11084f1427b88f2248f4b5dca5b8ad28a71fa8c6af63f4679e5373adec789f23" gracePeriod=2 Aug 02 09:40:55.187097 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.187075 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx"] Aug 02 09:40:55.187437 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.187425 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d23838aa-fad0-4d11-8026-c857888de8ae" containerName="manager" Aug 02 09:40:55.187503 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.187439 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d23838aa-fad0-4d11-8026-c857888de8ae" containerName="manager" Aug 02 09:40:55.187503 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.187491 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d23838aa-fad0-4d11-8026-c857888de8ae" containerName="manager" Aug 02 09:40:55.191051 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.191003 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" Aug 02 09:40:55.191552 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.191495 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29"] Aug 02 09:40:55.192235 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:40:55.191823 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xs4cj\" is forbidden: User \"system:node:ip-10-0-142-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-118.ec2.internal' and this object" podUID="d23838aa-fad0-4d11-8026-c857888de8ae" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:55.193495 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:40:55.193466 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-8qx29\" is forbidden: User \"system:node:ip-10-0-142-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-118.ec2.internal' and this object" podUID="62f8f529-46c5-45fe-aa99-864fa7ebf04b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" Aug 02 09:40:55.195114 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:40:55.195062 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xs4cj\" is forbidden: User \"system:node:ip-10-0-142-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-118.ec2.internal' and this object" podUID="d23838aa-fad0-4d11-8026-c857888de8ae" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:55.208022 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.207997 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx"] Aug 02 09:40:55.211024 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.211002 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-hz52p"] Aug 02 09:40:55.211356 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.211344 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f8f529-46c5-45fe-aa99-864fa7ebf04b" containerName="manager" Aug 02 09:40:55.211441 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.211357 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f8f529-46c5-45fe-aa99-864fa7ebf04b" containerName="manager" Aug 02 09:40:55.211441 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.211415 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="62f8f529-46c5-45fe-aa99-864fa7ebf04b" containerName="manager" Aug 02 09:40:55.214383 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.214369 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-hz52p" Aug 02 09:40:55.221385 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.221360 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-hz52p"] Aug 02 09:40:55.245262 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:40:55.245231 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-8qx29\" is forbidden: User \"system:node:ip-10-0-142-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-118.ec2.internal' and this object" podUID="62f8f529-46c5-45fe-aa99-864fa7ebf04b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" Aug 02 09:40:55.246752 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:40:55.246728 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xs4cj\" is forbidden: User \"system:node:ip-10-0-142-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-118.ec2.internal' and this object" podUID="d23838aa-fad0-4d11-8026-c857888de8ae" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:55.334838 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.334802 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9545aeef-791e-4bc2-93de-ca2571db5ce7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-8tftx\" (UID: \"9545aeef-791e-4bc2-93de-ca2571db5ce7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" Aug 02 09:40:55.335127 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.335102 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkn44\" (UniqueName: \"kubernetes.io/projected/65b2f0b7-962b-45ec-b28b-a1463754234f-kube-api-access-kkn44\") pod \"limitador-operator-controller-manager-6c549b6d85-hz52p\" (UID: \"65b2f0b7-962b-45ec-b28b-a1463754234f\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-hz52p" Aug 02 09:40:55.335256 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.335240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppnbq\" (UniqueName: \"kubernetes.io/projected/9545aeef-791e-4bc2-93de-ca2571db5ce7-kube-api-access-ppnbq\") pod \"kuadrant-operator-controller-manager-58fc56757c-8tftx\" (UID: \"9545aeef-791e-4bc2-93de-ca2571db5ce7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" Aug 02 09:40:55.377024 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.376997 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9"] Aug 02 09:40:55.381944 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.381921 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" Aug 02 09:40:55.394708 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.394669 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9"] Aug 02 09:40:55.399856 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.399826 2575 generic.go:356] "Generic (PLEG): container finished" podID="d23838aa-fad0-4d11-8026-c857888de8ae" containerID="eb721ec61f0436dfa1499111fcb73976a140dea66e45f20743b186fb495e4302" exitCode=0 Aug 02 09:40:55.401656 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.401636 2575 generic.go:356] "Generic (PLEG): container finished" podID="62f8f529-46c5-45fe-aa99-864fa7ebf04b" containerID="11084f1427b88f2248f4b5dca5b8ad28a71fa8c6af63f4679e5373adec789f23" exitCode=0 Aug 02 09:40:55.408018 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:40:55.407980 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-8qx29\" is forbidden: User \"system:node:ip-10-0-142-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-118.ec2.internal' and this object" podUID="62f8f529-46c5-45fe-aa99-864fa7ebf04b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" Aug 02 09:40:55.409606 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:40:55.409570 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xs4cj\" is forbidden: User \"system:node:ip-10-0-142-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-118.ec2.internal' and this object" podUID="d23838aa-fad0-4d11-8026-c857888de8ae" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:55.440384 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.440350 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkn44\" (UniqueName: \"kubernetes.io/projected/65b2f0b7-962b-45ec-b28b-a1463754234f-kube-api-access-kkn44\") pod \"limitador-operator-controller-manager-6c549b6d85-hz52p\" (UID: \"65b2f0b7-962b-45ec-b28b-a1463754234f\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-hz52p" Aug 02 09:40:55.440534 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.440409 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppnbq\" (UniqueName: \"kubernetes.io/projected/9545aeef-791e-4bc2-93de-ca2571db5ce7-kube-api-access-ppnbq\") pod \"kuadrant-operator-controller-manager-58fc56757c-8tftx\" (UID: \"9545aeef-791e-4bc2-93de-ca2571db5ce7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" Aug 02 09:40:55.440534 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.440488 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9545aeef-791e-4bc2-93de-ca2571db5ce7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-8tftx\" (UID: \"9545aeef-791e-4bc2-93de-ca2571db5ce7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" Aug 02 09:40:55.440910 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.440888 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9545aeef-791e-4bc2-93de-ca2571db5ce7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-8tftx\" (UID: \"9545aeef-791e-4bc2-93de-ca2571db5ce7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" Aug 02 09:40:55.452229 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.452201 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppnbq\" (UniqueName: \"kubernetes.io/projected/9545aeef-791e-4bc2-93de-ca2571db5ce7-kube-api-access-ppnbq\") pod \"kuadrant-operator-controller-manager-58fc56757c-8tftx\" (UID: \"9545aeef-791e-4bc2-93de-ca2571db5ce7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" Aug 02 09:40:55.452341 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.452234 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:55.452528 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.452508 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkn44\" (UniqueName: \"kubernetes.io/projected/65b2f0b7-962b-45ec-b28b-a1463754234f-kube-api-access-kkn44\") pod \"limitador-operator-controller-manager-6c549b6d85-hz52p\" (UID: \"65b2f0b7-962b-45ec-b28b-a1463754234f\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-hz52p" Aug 02 09:40:55.454020 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:40:55.453994 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-8qx29\" is forbidden: User \"system:node:ip-10-0-142-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-118.ec2.internal' and this object" podUID="62f8f529-46c5-45fe-aa99-864fa7ebf04b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" Aug 02 09:40:55.455262 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.455244 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" Aug 02 09:40:55.455499 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:40:55.455477 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xs4cj\" is forbidden: User \"system:node:ip-10-0-142-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-118.ec2.internal' and this object" podUID="d23838aa-fad0-4d11-8026-c857888de8ae" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:55.456993 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:40:55.456973 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-8qx29\" is forbidden: User \"system:node:ip-10-0-142-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-118.ec2.internal' and this object" podUID="62f8f529-46c5-45fe-aa99-864fa7ebf04b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" Aug 02 09:40:55.458415 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:40:55.458394 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xs4cj\" is forbidden: User \"system:node:ip-10-0-142-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-118.ec2.internal' and this object" podUID="d23838aa-fad0-4d11-8026-c857888de8ae" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:55.540892 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.540854 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d23838aa-fad0-4d11-8026-c857888de8ae-extensions-socket-volume\") pod \"d23838aa-fad0-4d11-8026-c857888de8ae\" (UID: \"d23838aa-fad0-4d11-8026-c857888de8ae\") " Aug 02 09:40:55.541049 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.540928 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rsdr\" (UniqueName: \"kubernetes.io/projected/d23838aa-fad0-4d11-8026-c857888de8ae-kube-api-access-8rsdr\") pod \"d23838aa-fad0-4d11-8026-c857888de8ae\" (UID: \"d23838aa-fad0-4d11-8026-c857888de8ae\") " Aug 02 09:40:55.541049 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.540980 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bz5g\" (UniqueName: \"kubernetes.io/projected/62f8f529-46c5-45fe-aa99-864fa7ebf04b-kube-api-access-4bz5g\") pod \"62f8f529-46c5-45fe-aa99-864fa7ebf04b\" (UID: \"62f8f529-46c5-45fe-aa99-864fa7ebf04b\") " Aug 02 09:40:55.541146 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.541124 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cc76436-aaa7-4357-8146-fe8a50520bec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-qv2g9\" (UID: \"5cc76436-aaa7-4357-8146-fe8a50520bec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" Aug 02 09:40:55.541195 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.541175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf8bx\" (UniqueName: \"kubernetes.io/projected/5cc76436-aaa7-4357-8146-fe8a50520bec-kube-api-access-gf8bx\") pod \"kuadrant-operator-controller-manager-68cf589589-qv2g9\" (UID: \"5cc76436-aaa7-4357-8146-fe8a50520bec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" Aug 02 09:40:55.541270 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.541248 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d23838aa-fad0-4d11-8026-c857888de8ae-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d23838aa-fad0-4d11-8026-c857888de8ae" (UID: "d23838aa-fad0-4d11-8026-c857888de8ae"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:40:55.541376 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.541363 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d23838aa-fad0-4d11-8026-c857888de8ae-extensions-socket-volume\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:55.543189 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.543162 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d23838aa-fad0-4d11-8026-c857888de8ae-kube-api-access-8rsdr" (OuterVolumeSpecName: "kube-api-access-8rsdr") pod "d23838aa-fad0-4d11-8026-c857888de8ae" (UID: "d23838aa-fad0-4d11-8026-c857888de8ae"). InnerVolumeSpecName "kube-api-access-8rsdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:40:55.543275 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.543187 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62f8f529-46c5-45fe-aa99-864fa7ebf04b-kube-api-access-4bz5g" (OuterVolumeSpecName: "kube-api-access-4bz5g") pod "62f8f529-46c5-45fe-aa99-864fa7ebf04b" (UID: "62f8f529-46c5-45fe-aa99-864fa7ebf04b"). InnerVolumeSpecName "kube-api-access-4bz5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:40:55.614427 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.614396 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" Aug 02 09:40:55.621482 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.621457 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-hz52p" Aug 02 09:40:55.642807 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.642751 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cc76436-aaa7-4357-8146-fe8a50520bec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-qv2g9\" (UID: \"5cc76436-aaa7-4357-8146-fe8a50520bec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" Aug 02 09:40:55.642929 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.642831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf8bx\" (UniqueName: \"kubernetes.io/projected/5cc76436-aaa7-4357-8146-fe8a50520bec-kube-api-access-gf8bx\") pod \"kuadrant-operator-controller-manager-68cf589589-qv2g9\" (UID: \"5cc76436-aaa7-4357-8146-fe8a50520bec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" Aug 02 09:40:55.642996 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.642959 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rsdr\" (UniqueName: \"kubernetes.io/projected/d23838aa-fad0-4d11-8026-c857888de8ae-kube-api-access-8rsdr\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:55.642996 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.642978 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bz5g\" (UniqueName: \"kubernetes.io/projected/62f8f529-46c5-45fe-aa99-864fa7ebf04b-kube-api-access-4bz5g\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:40:55.643155 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.643136 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cc76436-aaa7-4357-8146-fe8a50520bec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-qv2g9\" (UID: \"5cc76436-aaa7-4357-8146-fe8a50520bec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" Aug 02 09:40:55.656412 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.655638 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf8bx\" (UniqueName: \"kubernetes.io/projected/5cc76436-aaa7-4357-8146-fe8a50520bec-kube-api-access-gf8bx\") pod \"kuadrant-operator-controller-manager-68cf589589-qv2g9\" (UID: \"5cc76436-aaa7-4357-8146-fe8a50520bec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" Aug 02 09:40:55.694006 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.693934 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" Aug 02 09:40:55.773714 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.773682 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx"] Aug 02 09:40:55.777849 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:40:55.777806 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9545aeef_791e_4bc2_93de_ca2571db5ce7.slice/crio-6ed3abfa14ee65fac2362e4f0212086fd5acaefd1635c474a319d9d3ec6ac6c1 WatchSource:0}: Error finding container 6ed3abfa14ee65fac2362e4f0212086fd5acaefd1635c474a319d9d3ec6ac6c1: Status 404 returned error can't find the container with id 6ed3abfa14ee65fac2362e4f0212086fd5acaefd1635c474a319d9d3ec6ac6c1 Aug 02 09:40:55.802062 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.802038 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-hz52p"] Aug 02 09:40:55.823214 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:40:55.823183 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b2f0b7_962b_45ec_b28b_a1463754234f.slice/crio-6cfe793c5a60b3ae061fa3fdf8b7a9af0c98b6bba14a3c79d07c201e4c163998 WatchSource:0}: Error finding container 6cfe793c5a60b3ae061fa3fdf8b7a9af0c98b6bba14a3c79d07c201e4c163998: Status 404 returned error can't find the container with id 6cfe793c5a60b3ae061fa3fdf8b7a9af0c98b6bba14a3c79d07c201e4c163998 Aug 02 09:40:55.856681 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.856566 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9"] Aug 02 09:40:55.859471 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:40:55.859443 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cc76436_aaa7_4357_8146_fe8a50520bec.slice/crio-9bebab456186d468dc619d5c62fbba3a47d60898223a154a5b1ad934dcac3f72 WatchSource:0}: Error finding container 9bebab456186d468dc619d5c62fbba3a47d60898223a154a5b1ad934dcac3f72: Status 404 returned error can't find the container with id 9bebab456186d468dc619d5c62fbba3a47d60898223a154a5b1ad934dcac3f72 Aug 02 09:40:55.955925 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.955847 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62f8f529-46c5-45fe-aa99-864fa7ebf04b" path="/var/lib/kubelet/pods/62f8f529-46c5-45fe-aa99-864fa7ebf04b/volumes" Aug 02 09:40:55.956210 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:55.956197 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d23838aa-fad0-4d11-8026-c857888de8ae" path="/var/lib/kubelet/pods/d23838aa-fad0-4d11-8026-c857888de8ae/volumes" Aug 02 09:40:56.409021 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.408988 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xs4cj" Aug 02 09:40:56.409492 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.408993 2575 scope.go:117] "RemoveContainer" containerID="eb721ec61f0436dfa1499111fcb73976a140dea66e45f20743b186fb495e4302" Aug 02 09:40:56.411274 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.411240 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" event={"ID":"9545aeef-791e-4bc2-93de-ca2571db5ce7","Type":"ContainerStarted","Data":"683a6696336b6f6a00362e560d8ceb9991e441749937fab11195f450a79954da"} Aug 02 09:40:56.411448 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.411432 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" Aug 02 09:40:56.411595 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.411570 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" event={"ID":"9545aeef-791e-4bc2-93de-ca2571db5ce7","Type":"ContainerStarted","Data":"6ed3abfa14ee65fac2362e4f0212086fd5acaefd1635c474a319d9d3ec6ac6c1"} Aug 02 09:40:56.412808 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.412792 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8qx29" Aug 02 09:40:56.414575 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.414547 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-hz52p" event={"ID":"65b2f0b7-962b-45ec-b28b-a1463754234f","Type":"ContainerStarted","Data":"5ab9f39951c3fde99b7fd40b8518639b765fee9eaefb21025b811104882f64b8"} Aug 02 09:40:56.414692 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.414605 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-hz52p" Aug 02 09:40:56.414692 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.414630 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-hz52p" event={"ID":"65b2f0b7-962b-45ec-b28b-a1463754234f","Type":"ContainerStarted","Data":"6cfe793c5a60b3ae061fa3fdf8b7a9af0c98b6bba14a3c79d07c201e4c163998"} Aug 02 09:40:56.416365 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.416346 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" event={"ID":"5cc76436-aaa7-4357-8146-fe8a50520bec","Type":"ContainerStarted","Data":"1bb4aa076163124857ae3993ac22cc14ae30a12fe724448bd3830220d9da1db1"} Aug 02 09:40:56.416459 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.416379 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" event={"ID":"5cc76436-aaa7-4357-8146-fe8a50520bec","Type":"ContainerStarted","Data":"9bebab456186d468dc619d5c62fbba3a47d60898223a154a5b1ad934dcac3f72"} Aug 02 09:40:56.416510 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.416468 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" Aug 02 09:40:56.419624 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.419607 2575 scope.go:117] "RemoveContainer" containerID="11084f1427b88f2248f4b5dca5b8ad28a71fa8c6af63f4679e5373adec789f23" Aug 02 09:40:56.461792 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.461733 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" podStartSLOduration=1.461709648 podStartE2EDuration="1.461709648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:40:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:40:56.460637566 +0000 UTC m=+493.021792886" watchObservedRunningTime="2026-08-02 09:40:56.461709648 +0000 UTC m=+493.022864969" Aug 02 09:40:56.493919 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.493867 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-hz52p" podStartSLOduration=1.493852161 podStartE2EDuration="1.493852161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:40:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:40:56.491762112 +0000 UTC m=+493.052917435" watchObservedRunningTime="2026-08-02 09:40:56.493852161 +0000 UTC m=+493.055007477" Aug 02 09:40:56.532168 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:40:56.532109 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" podStartSLOduration=1.532089004 podStartE2EDuration="1.532089004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:40:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:40:56.530523191 +0000 UTC m=+493.091678524" watchObservedRunningTime="2026-08-02 09:40:56.532089004 +0000 UTC m=+493.093244326" Aug 02 09:41:07.426986 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:07.426955 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-hz52p" Aug 02 09:41:07.427454 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:07.427023 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" Aug 02 09:41:07.427454 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:07.427143 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" Aug 02 09:41:07.512626 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:07.512591 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx"] Aug 02 09:41:07.512851 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:07.512826 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" podUID="9545aeef-791e-4bc2-93de-ca2571db5ce7" containerName="manager" containerID="cri-o://683a6696336b6f6a00362e560d8ceb9991e441749937fab11195f450a79954da" gracePeriod=10 Aug 02 09:41:07.760655 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:07.760627 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" Aug 02 09:41:07.849046 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:07.849019 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9545aeef-791e-4bc2-93de-ca2571db5ce7-extensions-socket-volume\") pod \"9545aeef-791e-4bc2-93de-ca2571db5ce7\" (UID: \"9545aeef-791e-4bc2-93de-ca2571db5ce7\") " Aug 02 09:41:07.849191 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:07.849080 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppnbq\" (UniqueName: \"kubernetes.io/projected/9545aeef-791e-4bc2-93de-ca2571db5ce7-kube-api-access-ppnbq\") pod \"9545aeef-791e-4bc2-93de-ca2571db5ce7\" (UID: \"9545aeef-791e-4bc2-93de-ca2571db5ce7\") " Aug 02 09:41:07.849415 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:07.849391 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9545aeef-791e-4bc2-93de-ca2571db5ce7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9545aeef-791e-4bc2-93de-ca2571db5ce7" (UID: "9545aeef-791e-4bc2-93de-ca2571db5ce7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:41:07.851179 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:07.851151 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9545aeef-791e-4bc2-93de-ca2571db5ce7-kube-api-access-ppnbq" (OuterVolumeSpecName: "kube-api-access-ppnbq") pod "9545aeef-791e-4bc2-93de-ca2571db5ce7" (UID: "9545aeef-791e-4bc2-93de-ca2571db5ce7"). InnerVolumeSpecName "kube-api-access-ppnbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:41:07.950630 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:07.950548 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9545aeef-791e-4bc2-93de-ca2571db5ce7-extensions-socket-volume\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:41:07.950630 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:07.950576 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppnbq\" (UniqueName: \"kubernetes.io/projected/9545aeef-791e-4bc2-93de-ca2571db5ce7-kube-api-access-ppnbq\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:41:08.490995 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:08.490963 2575 generic.go:356] "Generic (PLEG): container finished" podID="9545aeef-791e-4bc2-93de-ca2571db5ce7" containerID="683a6696336b6f6a00362e560d8ceb9991e441749937fab11195f450a79954da" exitCode=0 Aug 02 09:41:08.491437 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:08.491012 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" Aug 02 09:41:08.491437 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:08.491050 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" event={"ID":"9545aeef-791e-4bc2-93de-ca2571db5ce7","Type":"ContainerDied","Data":"683a6696336b6f6a00362e560d8ceb9991e441749937fab11195f450a79954da"} Aug 02 09:41:08.491437 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:08.491104 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx" event={"ID":"9545aeef-791e-4bc2-93de-ca2571db5ce7","Type":"ContainerDied","Data":"6ed3abfa14ee65fac2362e4f0212086fd5acaefd1635c474a319d9d3ec6ac6c1"} Aug 02 09:41:08.491437 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:08.491130 2575 scope.go:117] "RemoveContainer" containerID="683a6696336b6f6a00362e560d8ceb9991e441749937fab11195f450a79954da" Aug 02 09:41:08.500275 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:08.500262 2575 scope.go:117] "RemoveContainer" containerID="683a6696336b6f6a00362e560d8ceb9991e441749937fab11195f450a79954da" Aug 02 09:41:08.500504 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:41:08.500485 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"683a6696336b6f6a00362e560d8ceb9991e441749937fab11195f450a79954da\": container with ID starting with 683a6696336b6f6a00362e560d8ceb9991e441749937fab11195f450a79954da not found: ID does not exist" containerID="683a6696336b6f6a00362e560d8ceb9991e441749937fab11195f450a79954da" Aug 02 09:41:08.500569 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:08.500515 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"683a6696336b6f6a00362e560d8ceb9991e441749937fab11195f450a79954da"} err="failed to get container status \"683a6696336b6f6a00362e560d8ceb9991e441749937fab11195f450a79954da\": rpc error: code = NotFound desc = could not find container \"683a6696336b6f6a00362e560d8ceb9991e441749937fab11195f450a79954da\": container with ID starting with 683a6696336b6f6a00362e560d8ceb9991e441749937fab11195f450a79954da not found: ID does not exist" Aug 02 09:41:08.508785 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:08.508753 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx"] Aug 02 09:41:08.519498 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:08.519478 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8tftx"] Aug 02 09:41:09.955816 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:09.955765 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9545aeef-791e-4bc2-93de-ca2571db5ce7" path="/var/lib/kubelet/pods/9545aeef-791e-4bc2-93de-ca2571db5ce7/volumes" Aug 02 09:41:23.794688 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.794651 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k"] Aug 02 09:41:23.795283 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.795226 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9545aeef-791e-4bc2-93de-ca2571db5ce7" containerName="manager" Aug 02 09:41:23.795283 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.795248 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9545aeef-791e-4bc2-93de-ca2571db5ce7" containerName="manager" Aug 02 09:41:23.795402 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.795337 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9545aeef-791e-4bc2-93de-ca2571db5ce7" containerName="manager" Aug 02 09:41:23.800721 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.800702 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.802833 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.802812 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pt7ns\"" Aug 02 09:41:23.810371 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.810347 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k"] Aug 02 09:41:23.875247 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.875217 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ffs6\" (UniqueName: \"kubernetes.io/projected/3e718494-145f-4a96-94a8-ee30e6dde29b-kube-api-access-5ffs6\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.875425 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.875274 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e718494-145f-4a96-94a8-ee30e6dde29b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.875425 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.875301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.875425 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.875328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.875425 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.875349 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.875425 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.875405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e718494-145f-4a96-94a8-ee30e6dde29b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.875656 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.875434 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.875656 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.875468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.875656 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.875492 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e718494-145f-4a96-94a8-ee30e6dde29b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.975969 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.975938 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e718494-145f-4a96-94a8-ee30e6dde29b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.975969 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.975970 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.976218 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.975991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.976218 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.976007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.976218 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.976029 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e718494-145f-4a96-94a8-ee30e6dde29b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.976218 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.976049 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.976218 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.976083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.976218 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.976106 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e718494-145f-4a96-94a8-ee30e6dde29b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.976543 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.976225 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ffs6\" (UniqueName: \"kubernetes.io/projected/3e718494-145f-4a96-94a8-ee30e6dde29b-kube-api-access-5ffs6\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.976543 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.976394 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.976543 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.976483 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.976543 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.976534 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.976762 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.976658 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.977040 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.977017 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e718494-145f-4a96-94a8-ee30e6dde29b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.978360 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.978339 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e718494-145f-4a96-94a8-ee30e6dde29b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.978569 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.978551 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e718494-145f-4a96-94a8-ee30e6dde29b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.983459 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.983431 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e718494-145f-4a96-94a8-ee30e6dde29b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:23.983644 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:23.983627 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ffs6\" (UniqueName: \"kubernetes.io/projected/3e718494-145f-4a96-94a8-ee30e6dde29b-kube-api-access-5ffs6\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jsv5k\" (UID: \"3e718494-145f-4a96-94a8-ee30e6dde29b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:24.111532 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:24.111442 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:24.247733 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:24.247712 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k"] Aug 02 09:41:24.250578 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:41:24.250552 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e718494_145f_4a96_94a8_ee30e6dde29b.slice/crio-fae0c9d707e6e0acba65124c060b5f08bcd993561d518abb2d38e5b1fa1b0533 WatchSource:0}: Error finding container fae0c9d707e6e0acba65124c060b5f08bcd993561d518abb2d38e5b1fa1b0533: Status 404 returned error can't find the container with id fae0c9d707e6e0acba65124c060b5f08bcd993561d518abb2d38e5b1fa1b0533 Aug 02 09:41:24.252555 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:24.252521 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 09:41:24.252639 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:24.252597 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 09:41:24.252639 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:24.252627 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 09:41:24.585024 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:24.584988 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" event={"ID":"3e718494-145f-4a96-94a8-ee30e6dde29b","Type":"ContainerStarted","Data":"3d4b27c335cccbeef92eb9f923cf2657e55826f582485af8a596e023f3349126"} Aug 02 09:41:24.585202 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:24.585080 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" event={"ID":"3e718494-145f-4a96-94a8-ee30e6dde29b","Type":"ContainerStarted","Data":"fae0c9d707e6e0acba65124c060b5f08bcd993561d518abb2d38e5b1fa1b0533"} Aug 02 09:41:24.601824 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:24.601755 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" podStartSLOduration=1.6017419830000001 podStartE2EDuration="1.601741983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:41:24.601116762 +0000 UTC m=+521.162272083" watchObservedRunningTime="2026-08-02 09:41:24.601741983 +0000 UTC m=+521.162897303" Aug 02 09:41:25.112536 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:25.112503 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:25.117172 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:25.117149 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:25.590932 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:25.590897 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:25.591887 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:25.591858 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:41:26.366384 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:26.366349 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-lwlw4"] Aug 02 09:41:26.370889 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:26.370869 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-lwlw4" Aug 02 09:41:26.372920 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:26.372898 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-844f9\"" Aug 02 09:41:26.376592 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:26.376572 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lwlw4"] Aug 02 09:41:26.392575 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:26.392548 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6fg7\" (UniqueName: \"kubernetes.io/projected/a048537a-b4eb-4493-b6c8-7c6ca28a0537-kube-api-access-v6fg7\") pod \"authorino-b54df94b4-lwlw4\" (UID: \"a048537a-b4eb-4493-b6c8-7c6ca28a0537\") " pod="kuadrant-system/authorino-b54df94b4-lwlw4" Aug 02 09:41:26.493304 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:26.493270 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6fg7\" (UniqueName: \"kubernetes.io/projected/a048537a-b4eb-4493-b6c8-7c6ca28a0537-kube-api-access-v6fg7\") pod \"authorino-b54df94b4-lwlw4\" (UID: \"a048537a-b4eb-4493-b6c8-7c6ca28a0537\") " pod="kuadrant-system/authorino-b54df94b4-lwlw4" Aug 02 09:41:26.500921 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:26.500896 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6fg7\" (UniqueName: \"kubernetes.io/projected/a048537a-b4eb-4493-b6c8-7c6ca28a0537-kube-api-access-v6fg7\") pod \"authorino-b54df94b4-lwlw4\" (UID: \"a048537a-b4eb-4493-b6c8-7c6ca28a0537\") " pod="kuadrant-system/authorino-b54df94b4-lwlw4" Aug 02 09:41:26.681675 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:26.681602 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-lwlw4" Aug 02 09:41:26.810344 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:26.810317 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lwlw4"] Aug 02 09:41:26.812185 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:41:26.812157 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda048537a_b4eb_4493_b6c8_7c6ca28a0537.slice/crio-bf5fc446e2f15f614c86959c4a2a3a969fd8808e3d5be3bfbd925a83f2fc9a84 WatchSource:0}: Error finding container bf5fc446e2f15f614c86959c4a2a3a969fd8808e3d5be3bfbd925a83f2fc9a84: Status 404 returned error can't find the container with id bf5fc446e2f15f614c86959c4a2a3a969fd8808e3d5be3bfbd925a83f2fc9a84 Aug 02 09:41:27.604105 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:27.604067 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-lwlw4" event={"ID":"a048537a-b4eb-4493-b6c8-7c6ca28a0537","Type":"ContainerStarted","Data":"bf5fc446e2f15f614c86959c4a2a3a969fd8808e3d5be3bfbd925a83f2fc9a84"} Aug 02 09:41:29.293481 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:29.293445 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lwlw4"] Aug 02 09:41:29.619738 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:29.619654 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-lwlw4" event={"ID":"a048537a-b4eb-4493-b6c8-7c6ca28a0537","Type":"ContainerStarted","Data":"4c53ebd45cea4cd1d27608900e8332a99184afe4a346b096cc1e82918975409c"} Aug 02 09:41:29.633696 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:29.633646 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-lwlw4" podStartSLOduration=1.4554389429999999 podStartE2EDuration="3.633630501s" totalImagesPullingTime="2.178191558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:41:29.632591557 +0000 UTC m=+526.193746876" watchObservedRunningTime="2026-08-02 09:41:29.633630501 +0000 UTC m=+526.194785819" Aug 02 09:41:30.625139 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:30.625094 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-lwlw4" podUID="a048537a-b4eb-4493-b6c8-7c6ca28a0537" containerName="authorino" containerID="cri-o://4c53ebd45cea4cd1d27608900e8332a99184afe4a346b096cc1e82918975409c" gracePeriod=30 Aug 02 09:41:30.876515 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:30.876456 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-lwlw4" Aug 02 09:41:30.932029 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:30.931989 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6fg7\" (UniqueName: \"kubernetes.io/projected/a048537a-b4eb-4493-b6c8-7c6ca28a0537-kube-api-access-v6fg7\") pod \"a048537a-b4eb-4493-b6c8-7c6ca28a0537\" (UID: \"a048537a-b4eb-4493-b6c8-7c6ca28a0537\") " Aug 02 09:41:30.934007 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:30.933977 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a048537a-b4eb-4493-b6c8-7c6ca28a0537-kube-api-access-v6fg7" (OuterVolumeSpecName: "kube-api-access-v6fg7") pod "a048537a-b4eb-4493-b6c8-7c6ca28a0537" (UID: "a048537a-b4eb-4493-b6c8-7c6ca28a0537"). InnerVolumeSpecName "kube-api-access-v6fg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:41:31.033432 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:31.033396 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6fg7\" (UniqueName: \"kubernetes.io/projected/a048537a-b4eb-4493-b6c8-7c6ca28a0537-kube-api-access-v6fg7\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:41:31.631446 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:31.631412 2575 generic.go:356] "Generic (PLEG): container finished" podID="a048537a-b4eb-4493-b6c8-7c6ca28a0537" containerID="4c53ebd45cea4cd1d27608900e8332a99184afe4a346b096cc1e82918975409c" exitCode=0 Aug 02 09:41:31.631446 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:31.631448 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-lwlw4" Aug 02 09:41:31.631941 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:31.631488 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-lwlw4" event={"ID":"a048537a-b4eb-4493-b6c8-7c6ca28a0537","Type":"ContainerDied","Data":"4c53ebd45cea4cd1d27608900e8332a99184afe4a346b096cc1e82918975409c"} Aug 02 09:41:31.631941 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:31.631517 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-lwlw4" event={"ID":"a048537a-b4eb-4493-b6c8-7c6ca28a0537","Type":"ContainerDied","Data":"bf5fc446e2f15f614c86959c4a2a3a969fd8808e3d5be3bfbd925a83f2fc9a84"} Aug 02 09:41:31.631941 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:31.631533 2575 scope.go:117] "RemoveContainer" containerID="4c53ebd45cea4cd1d27608900e8332a99184afe4a346b096cc1e82918975409c" Aug 02 09:41:31.640688 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:31.640672 2575 scope.go:117] "RemoveContainer" containerID="4c53ebd45cea4cd1d27608900e8332a99184afe4a346b096cc1e82918975409c" Aug 02 09:41:31.640967 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:41:31.640944 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c53ebd45cea4cd1d27608900e8332a99184afe4a346b096cc1e82918975409c\": container with ID starting with 4c53ebd45cea4cd1d27608900e8332a99184afe4a346b096cc1e82918975409c not found: ID does not exist" containerID="4c53ebd45cea4cd1d27608900e8332a99184afe4a346b096cc1e82918975409c" Aug 02 09:41:31.641049 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:31.640975 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c53ebd45cea4cd1d27608900e8332a99184afe4a346b096cc1e82918975409c"} err="failed to get container status \"4c53ebd45cea4cd1d27608900e8332a99184afe4a346b096cc1e82918975409c\": rpc error: code = NotFound desc = could not find container \"4c53ebd45cea4cd1d27608900e8332a99184afe4a346b096cc1e82918975409c\": container with ID starting with 4c53ebd45cea4cd1d27608900e8332a99184afe4a346b096cc1e82918975409c not found: ID does not exist" Aug 02 09:41:31.651410 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:31.651387 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lwlw4"] Aug 02 09:41:31.653477 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:31.653457 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lwlw4"] Aug 02 09:41:31.956625 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:31.956551 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a048537a-b4eb-4493-b6c8-7c6ca28a0537" path="/var/lib/kubelet/pods/a048537a-b4eb-4493-b6c8-7c6ca28a0537/volumes" Aug 02 09:41:59.449313 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.449277 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-bkqc4"] Aug 02 09:41:59.449807 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.449638 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a048537a-b4eb-4493-b6c8-7c6ca28a0537" containerName="authorino" Aug 02 09:41:59.449807 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.449649 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a048537a-b4eb-4493-b6c8-7c6ca28a0537" containerName="authorino" Aug 02 09:41:59.449807 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.449719 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a048537a-b4eb-4493-b6c8-7c6ca28a0537" containerName="authorino" Aug 02 09:41:59.455745 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.455724 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-bkqc4" Aug 02 09:41:59.458114 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.458092 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-844f9\"" Aug 02 09:41:59.460322 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.460261 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-bkqc4"] Aug 02 09:41:59.499446 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.499421 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-bkqc4"] Aug 02 09:41:59.499694 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:41:59.499672 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lrjpb], unattached volumes=[], failed to process volumes=[kube-api-access-lrjpb]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-bkqc4" podUID="e81fa681-d2cb-4e1e-b727-caf4808f7528" Aug 02 09:41:59.519804 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.519766 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-tnhww"] Aug 02 09:41:59.524086 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.524066 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-tnhww" Aug 02 09:41:59.525999 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.525981 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Aug 02 09:41:59.529872 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.529845 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-tnhww"] Aug 02 09:41:59.573686 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.573656 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrjpb\" (UniqueName: \"kubernetes.io/projected/e81fa681-d2cb-4e1e-b727-caf4808f7528-kube-api-access-lrjpb\") pod \"authorino-5dc7ccb5f-bkqc4\" (UID: \"e81fa681-d2cb-4e1e-b727-caf4808f7528\") " pod="kuadrant-system/authorino-5dc7ccb5f-bkqc4" Aug 02 09:41:59.674737 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.674696 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrjpb\" (UniqueName: \"kubernetes.io/projected/e81fa681-d2cb-4e1e-b727-caf4808f7528-kube-api-access-lrjpb\") pod \"authorino-5dc7ccb5f-bkqc4\" (UID: \"e81fa681-d2cb-4e1e-b727-caf4808f7528\") " pod="kuadrant-system/authorino-5dc7ccb5f-bkqc4" Aug 02 09:41:59.674737 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.674739 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpk4x\" (UniqueName: \"kubernetes.io/projected/241dfb95-b7d2-417f-a459-6c71f952b845-kube-api-access-gpk4x\") pod \"authorino-687bd45585-tnhww\" (UID: \"241dfb95-b7d2-417f-a459-6c71f952b845\") " pod="kuadrant-system/authorino-687bd45585-tnhww" Aug 02 09:41:59.674968 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.674817 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/241dfb95-b7d2-417f-a459-6c71f952b845-tls-cert\") pod \"authorino-687bd45585-tnhww\" (UID: \"241dfb95-b7d2-417f-a459-6c71f952b845\") " pod="kuadrant-system/authorino-687bd45585-tnhww" Aug 02 09:41:59.680888 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.680861 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-tnhww"] Aug 02 09:41:59.681164 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:41:59.681144 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gpk4x tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-tnhww" podUID="241dfb95-b7d2-417f-a459-6c71f952b845" Aug 02 09:41:59.683516 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.683493 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrjpb\" (UniqueName: \"kubernetes.io/projected/e81fa681-d2cb-4e1e-b727-caf4808f7528-kube-api-access-lrjpb\") pod \"authorino-5dc7ccb5f-bkqc4\" (UID: \"e81fa681-d2cb-4e1e-b727-caf4808f7528\") " pod="kuadrant-system/authorino-5dc7ccb5f-bkqc4" Aug 02 09:41:59.775464 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.775397 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpk4x\" (UniqueName: \"kubernetes.io/projected/241dfb95-b7d2-417f-a459-6c71f952b845-kube-api-access-gpk4x\") pod \"authorino-687bd45585-tnhww\" (UID: \"241dfb95-b7d2-417f-a459-6c71f952b845\") " pod="kuadrant-system/authorino-687bd45585-tnhww" Aug 02 09:41:59.775464 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.775451 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/241dfb95-b7d2-417f-a459-6c71f952b845-tls-cert\") pod \"authorino-687bd45585-tnhww\" (UID: \"241dfb95-b7d2-417f-a459-6c71f952b845\") " pod="kuadrant-system/authorino-687bd45585-tnhww" Aug 02 09:41:59.777831 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.777810 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/241dfb95-b7d2-417f-a459-6c71f952b845-tls-cert\") pod \"authorino-687bd45585-tnhww\" (UID: \"241dfb95-b7d2-417f-a459-6c71f952b845\") " pod="kuadrant-system/authorino-687bd45585-tnhww" Aug 02 09:41:59.781528 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.781509 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-tnhww" Aug 02 09:41:59.781624 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.781535 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-bkqc4" Aug 02 09:41:59.782412 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.782391 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpk4x\" (UniqueName: \"kubernetes.io/projected/241dfb95-b7d2-417f-a459-6c71f952b845-kube-api-access-gpk4x\") pod \"authorino-687bd45585-tnhww\" (UID: \"241dfb95-b7d2-417f-a459-6c71f952b845\") " pod="kuadrant-system/authorino-687bd45585-tnhww" Aug 02 09:41:59.800480 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.800457 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-tnhww" Aug 02 09:41:59.803340 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.803326 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-bkqc4" Aug 02 09:41:59.876520 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.876497 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrjpb\" (UniqueName: \"kubernetes.io/projected/e81fa681-d2cb-4e1e-b727-caf4808f7528-kube-api-access-lrjpb\") pod \"e81fa681-d2cb-4e1e-b727-caf4808f7528\" (UID: \"e81fa681-d2cb-4e1e-b727-caf4808f7528\") " Aug 02 09:41:59.876656 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.876547 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpk4x\" (UniqueName: \"kubernetes.io/projected/241dfb95-b7d2-417f-a459-6c71f952b845-kube-api-access-gpk4x\") pod \"241dfb95-b7d2-417f-a459-6c71f952b845\" (UID: \"241dfb95-b7d2-417f-a459-6c71f952b845\") " Aug 02 09:41:59.876656 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.876571 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/241dfb95-b7d2-417f-a459-6c71f952b845-tls-cert\") pod \"241dfb95-b7d2-417f-a459-6c71f952b845\" (UID: \"241dfb95-b7d2-417f-a459-6c71f952b845\") " Aug 02 09:41:59.878619 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.878590 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/241dfb95-b7d2-417f-a459-6c71f952b845-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "241dfb95-b7d2-417f-a459-6c71f952b845" (UID: "241dfb95-b7d2-417f-a459-6c71f952b845"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:41:59.878726 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.878671 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e81fa681-d2cb-4e1e-b727-caf4808f7528-kube-api-access-lrjpb" (OuterVolumeSpecName: "kube-api-access-lrjpb") pod "e81fa681-d2cb-4e1e-b727-caf4808f7528" (UID: "e81fa681-d2cb-4e1e-b727-caf4808f7528"). InnerVolumeSpecName "kube-api-access-lrjpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:41:59.878726 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.878703 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/241dfb95-b7d2-417f-a459-6c71f952b845-kube-api-access-gpk4x" (OuterVolumeSpecName: "kube-api-access-gpk4x") pod "241dfb95-b7d2-417f-a459-6c71f952b845" (UID: "241dfb95-b7d2-417f-a459-6c71f952b845"). InnerVolumeSpecName "kube-api-access-gpk4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:41:59.977176 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.977152 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrjpb\" (UniqueName: \"kubernetes.io/projected/e81fa681-d2cb-4e1e-b727-caf4808f7528-kube-api-access-lrjpb\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:41:59.977176 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.977175 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpk4x\" (UniqueName: \"kubernetes.io/projected/241dfb95-b7d2-417f-a459-6c71f952b845-kube-api-access-gpk4x\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:41:59.977319 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:41:59.977186 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/241dfb95-b7d2-417f-a459-6c71f952b845-tls-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:42:00.786743 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:00.786716 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-tnhww" Aug 02 09:42:00.787160 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:00.786716 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-bkqc4" Aug 02 09:42:00.818423 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:00.818386 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-bkqc4"] Aug 02 09:42:00.820946 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:00.820922 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-bkqc4"] Aug 02 09:42:00.842979 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:00.842952 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-tnhww"] Aug 02 09:42:00.845082 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:00.845063 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-tnhww"] Aug 02 09:42:01.956839 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:01.956805 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="241dfb95-b7d2-417f-a459-6c71f952b845" path="/var/lib/kubelet/pods/241dfb95-b7d2-417f-a459-6c71f952b845/volumes" Aug 02 09:42:01.957222 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:01.957035 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e81fa681-d2cb-4e1e-b727-caf4808f7528" path="/var/lib/kubelet/pods/e81fa681-d2cb-4e1e-b727-caf4808f7528/volumes" Aug 02 09:42:06.225492 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.225460 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dcb7b6dcc-nr9r5"] Aug 02 09:42:06.230376 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.230354 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" Aug 02 09:42:06.233221 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.233195 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-78kz9\"" Aug 02 09:42:06.235044 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.235014 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Aug 02 09:42:06.235164 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.235111 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Aug 02 09:42:06.247054 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.247026 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dcb7b6dcc-nr9r5"] Aug 02 09:42:06.335181 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.335147 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bphjb\" (UniqueName: \"kubernetes.io/projected/eff149d6-7b42-4c02-a962-936f2c8c9340-kube-api-access-bphjb\") pod \"maas-controller-dcb7b6dcc-nr9r5\" (UID: \"eff149d6-7b42-4c02-a962-936f2c8c9340\") " pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" Aug 02 09:42:06.335348 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.335190 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff149d6-7b42-4c02-a962-936f2c8c9340-webhook-cert\") pod \"maas-controller-dcb7b6dcc-nr9r5\" (UID: \"eff149d6-7b42-4c02-a962-936f2c8c9340\") " pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" Aug 02 09:42:06.407925 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.407886 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74bc9776f5-lrrzj"] Aug 02 09:42:06.412443 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.412421 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74bc9776f5-lrrzj" Aug 02 09:42:06.418875 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.418851 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74bc9776f5-lrrzj"] Aug 02 09:42:06.436142 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.436111 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bphjb\" (UniqueName: \"kubernetes.io/projected/eff149d6-7b42-4c02-a962-936f2c8c9340-kube-api-access-bphjb\") pod \"maas-controller-dcb7b6dcc-nr9r5\" (UID: \"eff149d6-7b42-4c02-a962-936f2c8c9340\") " pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" Aug 02 09:42:06.436364 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.436344 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff149d6-7b42-4c02-a962-936f2c8c9340-webhook-cert\") pod \"maas-controller-dcb7b6dcc-nr9r5\" (UID: \"eff149d6-7b42-4c02-a962-936f2c8c9340\") " pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" Aug 02 09:42:06.446294 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.446268 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff149d6-7b42-4c02-a962-936f2c8c9340-webhook-cert\") pod \"maas-controller-dcb7b6dcc-nr9r5\" (UID: \"eff149d6-7b42-4c02-a962-936f2c8c9340\") " pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" Aug 02 09:42:06.446451 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.446374 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bphjb\" (UniqueName: \"kubernetes.io/projected/eff149d6-7b42-4c02-a962-936f2c8c9340-kube-api-access-bphjb\") pod \"maas-controller-dcb7b6dcc-nr9r5\" (UID: \"eff149d6-7b42-4c02-a962-936f2c8c9340\") " pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" Aug 02 09:42:06.537592 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.537504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97aa94ef-d225-40ce-8c02-9883a261aced-webhook-cert\") pod \"maas-controller-74bc9776f5-lrrzj\" (UID: \"97aa94ef-d225-40ce-8c02-9883a261aced\") " pod="opendatahub/maas-controller-74bc9776f5-lrrzj" Aug 02 09:42:06.537592 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.537580 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47jtq\" (UniqueName: \"kubernetes.io/projected/97aa94ef-d225-40ce-8c02-9883a261aced-kube-api-access-47jtq\") pod \"maas-controller-74bc9776f5-lrrzj\" (UID: \"97aa94ef-d225-40ce-8c02-9883a261aced\") " pod="opendatahub/maas-controller-74bc9776f5-lrrzj" Aug 02 09:42:06.542123 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.542104 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" Aug 02 09:42:06.639254 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.639171 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97aa94ef-d225-40ce-8c02-9883a261aced-webhook-cert\") pod \"maas-controller-74bc9776f5-lrrzj\" (UID: \"97aa94ef-d225-40ce-8c02-9883a261aced\") " pod="opendatahub/maas-controller-74bc9776f5-lrrzj" Aug 02 09:42:06.639254 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.639225 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47jtq\" (UniqueName: \"kubernetes.io/projected/97aa94ef-d225-40ce-8c02-9883a261aced-kube-api-access-47jtq\") pod \"maas-controller-74bc9776f5-lrrzj\" (UID: \"97aa94ef-d225-40ce-8c02-9883a261aced\") " pod="opendatahub/maas-controller-74bc9776f5-lrrzj" Aug 02 09:42:06.641609 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.641582 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97aa94ef-d225-40ce-8c02-9883a261aced-webhook-cert\") pod \"maas-controller-74bc9776f5-lrrzj\" (UID: \"97aa94ef-d225-40ce-8c02-9883a261aced\") " pod="opendatahub/maas-controller-74bc9776f5-lrrzj" Aug 02 09:42:06.647691 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.647663 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47jtq\" (UniqueName: \"kubernetes.io/projected/97aa94ef-d225-40ce-8c02-9883a261aced-kube-api-access-47jtq\") pod \"maas-controller-74bc9776f5-lrrzj\" (UID: \"97aa94ef-d225-40ce-8c02-9883a261aced\") " pod="opendatahub/maas-controller-74bc9776f5-lrrzj" Aug 02 09:42:06.675535 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.675513 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dcb7b6dcc-nr9r5"] Aug 02 09:42:06.677586 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:42:06.677556 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff149d6_7b42_4c02_a962_936f2c8c9340.slice/crio-82885554df6da41cb68a951178dc9bd75ed23c150f196719497b9e1fe3c3e338 WatchSource:0}: Error finding container 82885554df6da41cb68a951178dc9bd75ed23c150f196719497b9e1fe3c3e338: Status 404 returned error can't find the container with id 82885554df6da41cb68a951178dc9bd75ed23c150f196719497b9e1fe3c3e338 Aug 02 09:42:06.725077 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.725048 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74bc9776f5-lrrzj" Aug 02 09:42:06.823084 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.823050 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" event={"ID":"eff149d6-7b42-4c02-a962-936f2c8c9340","Type":"ContainerStarted","Data":"82885554df6da41cb68a951178dc9bd75ed23c150f196719497b9e1fe3c3e338"} Aug 02 09:42:06.860677 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:06.860652 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74bc9776f5-lrrzj"] Aug 02 09:42:06.861650 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:42:06.861620 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97aa94ef_d225_40ce_8c02_9883a261aced.slice/crio-10c783fd1b2d73c6cce1e3032040ea7d52e56aaabcb4332ab3b9c5b99bbe89c7 WatchSource:0}: Error finding container 10c783fd1b2d73c6cce1e3032040ea7d52e56aaabcb4332ab3b9c5b99bbe89c7: Status 404 returned error can't find the container with id 10c783fd1b2d73c6cce1e3032040ea7d52e56aaabcb4332ab3b9c5b99bbe89c7 Aug 02 09:42:07.833478 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:07.833447 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74bc9776f5-lrrzj" event={"ID":"97aa94ef-d225-40ce-8c02-9883a261aced","Type":"ContainerStarted","Data":"10c783fd1b2d73c6cce1e3032040ea7d52e56aaabcb4332ab3b9c5b99bbe89c7"} Aug 02 09:42:08.841471 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:08.841426 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74bc9776f5-lrrzj" event={"ID":"97aa94ef-d225-40ce-8c02-9883a261aced","Type":"ContainerStarted","Data":"1a28fa07b0ccd9e4ed17eb34f6d6b610cca23a3e548acbaea714957b9108bd35"} Aug 02 09:42:08.842107 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:08.841511 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74bc9776f5-lrrzj" Aug 02 09:42:08.843357 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:08.843326 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" event={"ID":"eff149d6-7b42-4c02-a962-936f2c8c9340","Type":"ContainerStarted","Data":"18c180651670228ea98521aa31434162539a54f83d2ead073e514484c840dab3"} Aug 02 09:42:08.843485 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:08.843469 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" Aug 02 09:42:08.863125 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:08.863073 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74bc9776f5-lrrzj" podStartSLOduration=1.580104154 podStartE2EDuration="2.863057169s" totalImagesPullingTime="1.282953015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:42:08.860079551 +0000 UTC m=+565.421234871" watchObservedRunningTime="2026-08-02 09:42:08.863057169 +0000 UTC m=+565.424212488" Aug 02 09:42:08.884349 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:08.884306 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" podStartSLOduration=1.419856426 podStartE2EDuration="2.884291684s" totalImagesPullingTime="1.464435258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:42:08.882132695 +0000 UTC m=+565.443288014" watchObservedRunningTime="2026-08-02 09:42:08.884291684 +0000 UTC m=+565.445447007" Aug 02 09:42:19.851818 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:19.851771 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" Aug 02 09:42:19.852258 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:19.851865 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74bc9776f5-lrrzj" Aug 02 09:42:19.906863 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:19.906825 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dcb7b6dcc-nr9r5"] Aug 02 09:42:19.907103 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:19.907077 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" podUID="eff149d6-7b42-4c02-a962-936f2c8c9340" containerName="manager" containerID="cri-o://18c180651670228ea98521aa31434162539a54f83d2ead073e514484c840dab3" gracePeriod=30 Aug 02 09:42:20.163956 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.163925 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" Aug 02 09:42:20.252966 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.252932 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff149d6-7b42-4c02-a962-936f2c8c9340-webhook-cert\") pod \"eff149d6-7b42-4c02-a962-936f2c8c9340\" (UID: \"eff149d6-7b42-4c02-a962-936f2c8c9340\") " Aug 02 09:42:20.255013 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.254984 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eff149d6-7b42-4c02-a962-936f2c8c9340-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eff149d6-7b42-4c02-a962-936f2c8c9340" (UID: "eff149d6-7b42-4c02-a962-936f2c8c9340"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:42:20.354004 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.353975 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bphjb\" (UniqueName: \"kubernetes.io/projected/eff149d6-7b42-4c02-a962-936f2c8c9340-kube-api-access-bphjb\") pod \"eff149d6-7b42-4c02-a962-936f2c8c9340\" (UID: \"eff149d6-7b42-4c02-a962-936f2c8c9340\") " Aug 02 09:42:20.354204 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.354192 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff149d6-7b42-4c02-a962-936f2c8c9340-webhook-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:42:20.355984 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.355953 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eff149d6-7b42-4c02-a962-936f2c8c9340-kube-api-access-bphjb" (OuterVolumeSpecName: "kube-api-access-bphjb") pod "eff149d6-7b42-4c02-a962-936f2c8c9340" (UID: "eff149d6-7b42-4c02-a962-936f2c8c9340"). InnerVolumeSpecName "kube-api-access-bphjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:42:20.455129 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.455062 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bphjb\" (UniqueName: \"kubernetes.io/projected/eff149d6-7b42-4c02-a962-936f2c8c9340-kube-api-access-bphjb\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:42:20.909835 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.909802 2575 generic.go:356] "Generic (PLEG): container finished" podID="eff149d6-7b42-4c02-a962-936f2c8c9340" containerID="18c180651670228ea98521aa31434162539a54f83d2ead073e514484c840dab3" exitCode=0 Aug 02 09:42:20.910309 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.909863 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" Aug 02 09:42:20.910309 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.909895 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" event={"ID":"eff149d6-7b42-4c02-a962-936f2c8c9340","Type":"ContainerDied","Data":"18c180651670228ea98521aa31434162539a54f83d2ead073e514484c840dab3"} Aug 02 09:42:20.910309 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.909954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dcb7b6dcc-nr9r5" event={"ID":"eff149d6-7b42-4c02-a962-936f2c8c9340","Type":"ContainerDied","Data":"82885554df6da41cb68a951178dc9bd75ed23c150f196719497b9e1fe3c3e338"} Aug 02 09:42:20.910309 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.909980 2575 scope.go:117] "RemoveContainer" containerID="18c180651670228ea98521aa31434162539a54f83d2ead073e514484c840dab3" Aug 02 09:42:20.919353 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.919337 2575 scope.go:117] "RemoveContainer" containerID="18c180651670228ea98521aa31434162539a54f83d2ead073e514484c840dab3" Aug 02 09:42:20.919600 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:42:20.919581 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18c180651670228ea98521aa31434162539a54f83d2ead073e514484c840dab3\": container with ID starting with 18c180651670228ea98521aa31434162539a54f83d2ead073e514484c840dab3 not found: ID does not exist" containerID="18c180651670228ea98521aa31434162539a54f83d2ead073e514484c840dab3" Aug 02 09:42:20.919665 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.919607 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c180651670228ea98521aa31434162539a54f83d2ead073e514484c840dab3"} err="failed to get container status \"18c180651670228ea98521aa31434162539a54f83d2ead073e514484c840dab3\": rpc error: code = NotFound desc = could not find container \"18c180651670228ea98521aa31434162539a54f83d2ead073e514484c840dab3\": container with ID starting with 18c180651670228ea98521aa31434162539a54f83d2ead073e514484c840dab3 not found: ID does not exist" Aug 02 09:42:20.930460 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.930437 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dcb7b6dcc-nr9r5"] Aug 02 09:42:20.932573 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:20.932541 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-dcb7b6dcc-nr9r5"] Aug 02 09:42:21.955694 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:21.955660 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eff149d6-7b42-4c02-a962-936f2c8c9340" path="/var/lib/kubelet/pods/eff149d6-7b42-4c02-a962-936f2c8c9340/volumes" Aug 02 09:42:43.901191 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:43.901165 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 09:42:43.904163 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:43.904135 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 09:42:43.907927 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:43.907907 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 09:42:43.911074 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:43.911056 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 09:42:53.108068 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:53.108036 2575 generic.go:356] "Generic (PLEG): container finished" podID="3e718494-145f-4a96-94a8-ee30e6dde29b" containerID="3d4b27c335cccbeef92eb9f923cf2657e55826f582485af8a596e023f3349126" exitCode=0 Aug 02 09:42:53.108488 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:53.108122 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" event={"ID":"3e718494-145f-4a96-94a8-ee30e6dde29b","Type":"ContainerDied","Data":"3d4b27c335cccbeef92eb9f923cf2657e55826f582485af8a596e023f3349126"} Aug 02 09:42:53.108647 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:53.108630 2575 scope.go:117] "RemoveContainer" containerID="3d4b27c335cccbeef92eb9f923cf2657e55826f582485af8a596e023f3349126" Aug 02 09:42:53.109752 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:53.109725 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 09:42:53.109889 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:53.109800 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 09:42:53.109889 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:53.109833 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 09:42:54.115786 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:54.115753 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" event={"ID":"3e718494-145f-4a96-94a8-ee30e6dde29b","Type":"ContainerStarted","Data":"a8716e1af83b59d7b8a9fd91814fae9e8498e1218188fd4b565d0c1568a402c4"} Aug 02 09:42:55.112203 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:55.112160 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:42:55.113462 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:55.113440 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jsv5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Aug 02 09:42:55.113530 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:55.113489 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" podUID="3e718494-145f-4a96-94a8-ee30e6dde29b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Aug 02 09:42:55.591255 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:55.591222 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:42:56.112495 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:56.112455 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jsv5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Aug 02 09:42:56.112690 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:56.112529 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" podUID="3e718494-145f-4a96-94a8-ee30e6dde29b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Aug 02 09:42:57.112101 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:57.112065 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jsv5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Aug 02 09:42:57.112478 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:57.112126 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" podUID="3e718494-145f-4a96-94a8-ee30e6dde29b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Aug 02 09:42:58.112570 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:58.112538 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jsv5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Aug 02 09:42:58.112960 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:58.112592 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" podUID="3e718494-145f-4a96-94a8-ee30e6dde29b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Aug 02 09:42:59.112591 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:59.112559 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jsv5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Aug 02 09:42:59.112996 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:42:59.112646 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" podUID="3e718494-145f-4a96-94a8-ee30e6dde29b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Aug 02 09:43:00.116412 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:00.116377 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:43:00.117336 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:00.117314 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jsv5k" Aug 02 09:43:03.383863 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.383809 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95"] Aug 02 09:43:03.384489 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.384467 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eff149d6-7b42-4c02-a962-936f2c8c9340" containerName="manager" Aug 02 09:43:03.384653 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.384635 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="eff149d6-7b42-4c02-a962-936f2c8c9340" containerName="manager" Aug 02 09:43:03.384833 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.384819 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="eff149d6-7b42-4c02-a962-936f2c8c9340" containerName="manager" Aug 02 09:43:03.388473 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.388452 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.392273 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.392246 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Aug 02 09:43:03.392984 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.392946 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Aug 02 09:43:03.392984 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.392966 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jh287\"" Aug 02 09:43:03.393177 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.393006 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Aug 02 09:43:03.401051 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.401025 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95"] Aug 02 09:43:03.528084 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.528042 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.528270 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.528108 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.528270 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.528137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.528270 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.528165 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.528270 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.528187 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t5zr\" (UniqueName: \"kubernetes.io/projected/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-kube-api-access-5t5zr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.528425 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.528285 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.629208 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.629165 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.629393 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.629240 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.629393 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.629270 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.629393 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.629302 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.629393 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.629328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t5zr\" (UniqueName: \"kubernetes.io/projected/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-kube-api-access-5t5zr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.629605 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.629400 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.629660 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.629622 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.629712 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.629668 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.629765 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.629724 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.631793 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.631756 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.632227 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.632207 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.639559 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.639492 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t5zr\" (UniqueName: \"kubernetes.io/projected/d3a2e70e-2402-4b60-9fc5-dc915777d2fe-kube-api-access-5t5zr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qwl95\" (UID: \"d3a2e70e-2402-4b60-9fc5-dc915777d2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.700533 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.700491 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:03.850130 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.850106 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95"] Aug 02 09:43:03.852547 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:43:03.852522 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3a2e70e_2402_4b60_9fc5_dc915777d2fe.slice/crio-4d29a65f732fb29d3dfc8524802f27c90ef92f999d184bcc01e8c3497d0016cb WatchSource:0}: Error finding container 4d29a65f732fb29d3dfc8524802f27c90ef92f999d184bcc01e8c3497d0016cb: Status 404 returned error can't find the container with id 4d29a65f732fb29d3dfc8524802f27c90ef92f999d184bcc01e8c3497d0016cb Aug 02 09:43:03.853916 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:03.853896 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 02 09:43:04.198525 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:04.198398 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" event={"ID":"d3a2e70e-2402-4b60-9fc5-dc915777d2fe","Type":"ContainerStarted","Data":"4d29a65f732fb29d3dfc8524802f27c90ef92f999d184bcc01e8c3497d0016cb"} Aug 02 09:43:05.205987 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:05.205889 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" event={"ID":"d3a2e70e-2402-4b60-9fc5-dc915777d2fe","Type":"ContainerStarted","Data":"ca132615cee4b171ddace4c4d5a757fccd3622a9428c27219ff55c685feef2c7"} Aug 02 09:43:05.233249 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:05.233182 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" podStartSLOduration=1.220970254 podStartE2EDuration="2.233162323s" totalImagesPullingTime="1.012192069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:43:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:43:05.227399041 +0000 UTC m=+621.788554360" watchObservedRunningTime="2026-08-02 09:43:05.233162323 +0000 UTC m=+621.794317646" Aug 02 09:43:07.591913 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.591831 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27"] Aug 02 09:43:07.596105 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.596083 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.598718 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.598693 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Aug 02 09:43:07.609533 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.609510 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27"] Aug 02 09:43:07.768143 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.768101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/613126ea-bd5e-4888-80c1-3f6c859c433b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.768326 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.768155 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/613126ea-bd5e-4888-80c1-3f6c859c433b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.768326 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.768270 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/613126ea-bd5e-4888-80c1-3f6c859c433b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.768326 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.768314 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/613126ea-bd5e-4888-80c1-3f6c859c433b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.768513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.768349 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/613126ea-bd5e-4888-80c1-3f6c859c433b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.768513 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.768380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47vmr\" (UniqueName: \"kubernetes.io/projected/613126ea-bd5e-4888-80c1-3f6c859c433b-kube-api-access-47vmr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.869378 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.869284 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/613126ea-bd5e-4888-80c1-3f6c859c433b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.869378 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.869333 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/613126ea-bd5e-4888-80c1-3f6c859c433b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.869617 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.869447 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/613126ea-bd5e-4888-80c1-3f6c859c433b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.869617 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.869487 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47vmr\" (UniqueName: \"kubernetes.io/projected/613126ea-bd5e-4888-80c1-3f6c859c433b-kube-api-access-47vmr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.869617 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.869591 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/613126ea-bd5e-4888-80c1-3f6c859c433b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.869814 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.869647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/613126ea-bd5e-4888-80c1-3f6c859c433b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.869890 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.869848 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/613126ea-bd5e-4888-80c1-3f6c859c433b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.869938 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.869874 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/613126ea-bd5e-4888-80c1-3f6c859c433b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.869973 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.869937 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/613126ea-bd5e-4888-80c1-3f6c859c433b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.871628 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.871605 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/613126ea-bd5e-4888-80c1-3f6c859c433b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.872101 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.872082 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/613126ea-bd5e-4888-80c1-3f6c859c433b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.879205 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.879184 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47vmr\" (UniqueName: \"kubernetes.io/projected/613126ea-bd5e-4888-80c1-3f6c859c433b-kube-api-access-47vmr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-d8v27\" (UID: \"613126ea-bd5e-4888-80c1-3f6c859c433b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:07.907302 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:07.907269 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:08.057340 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:08.057306 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27"] Aug 02 09:43:08.057718 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:43:08.057694 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod613126ea_bd5e_4888_80c1_3f6c859c433b.slice/crio-ce63d2d029cd69bf7c4698b544200ddf4de0467c4d03e7e6e825a87821eacbaf WatchSource:0}: Error finding container ce63d2d029cd69bf7c4698b544200ddf4de0467c4d03e7e6e825a87821eacbaf: Status 404 returned error can't find the container with id ce63d2d029cd69bf7c4698b544200ddf4de0467c4d03e7e6e825a87821eacbaf Aug 02 09:43:08.224398 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:08.224317 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" event={"ID":"613126ea-bd5e-4888-80c1-3f6c859c433b","Type":"ContainerStarted","Data":"ce63d2d029cd69bf7c4698b544200ddf4de0467c4d03e7e6e825a87821eacbaf"} Aug 02 09:43:09.233344 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:09.233307 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" event={"ID":"613126ea-bd5e-4888-80c1-3f6c859c433b","Type":"ContainerStarted","Data":"a314a06f5f213bd4ce1e09f259811e52907a11aaf5e1235b1fe670a2ff2a5469"} Aug 02 09:43:09.272718 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:09.272647 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" podStartSLOduration=2.103877461 podStartE2EDuration="2.272625342s" totalImagesPullingTime="168.747881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:43:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:43:09.272065496 +0000 UTC m=+625.833220816" watchObservedRunningTime="2026-08-02 09:43:09.272625342 +0000 UTC m=+625.833780664" Aug 02 09:43:13.701404 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:13.701365 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:13.701920 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:13.701433 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:13.713818 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:13.713793 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:14.277733 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:14.277698 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qwl95" Aug 02 09:43:17.907676 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:17.907641 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:17.908179 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:17.907708 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:17.920324 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:17.920291 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:18.297927 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:18.297899 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-d8v27" Aug 02 09:43:58.128140 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.128080 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw"] Aug 02 09:43:58.132192 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.132166 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.137432 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.137410 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Aug 02 09:43:58.158760 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.158728 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw"] Aug 02 09:43:58.222332 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.222299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.222493 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.222385 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szsvk\" (UniqueName: \"kubernetes.io/projected/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-kube-api-access-szsvk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.222493 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.222426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.222493 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.222443 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.222607 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.222535 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.222607 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.222584 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.323983 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.323951 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szsvk\" (UniqueName: \"kubernetes.io/projected/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-kube-api-access-szsvk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.324160 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.324016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.324160 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.324139 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.324251 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.324190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.324251 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.324236 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.324357 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.324263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.324526 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.324502 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.324608 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.324550 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.324686 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.324660 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.326319 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.326288 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.326611 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.326593 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.350871 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.350843 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szsvk\" (UniqueName: \"kubernetes.io/projected/5948fb4f-fbd5-4572-853e-65faa3ea6c3c-kube-api-access-szsvk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw\" (UID: \"5948fb4f-fbd5-4572-853e-65faa3ea6c3c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.442641 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.442554 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:43:58.612268 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:43:58.612222 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5948fb4f_fbd5_4572_853e_65faa3ea6c3c.slice/crio-44a0f751016b2b6f8c296686b8ba6c9e7846d1718c679842fc347c4036c7e6bc WatchSource:0}: Error finding container 44a0f751016b2b6f8c296686b8ba6c9e7846d1718c679842fc347c4036c7e6bc: Status 404 returned error can't find the container with id 44a0f751016b2b6f8c296686b8ba6c9e7846d1718c679842fc347c4036c7e6bc Aug 02 09:43:58.612546 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:58.612521 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw"] Aug 02 09:43:59.518337 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:59.518296 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" event={"ID":"5948fb4f-fbd5-4572-853e-65faa3ea6c3c","Type":"ContainerStarted","Data":"b5791a3bb473d472e8893773ce91ae4453c10ace013ae37d72c20a77514d3e9a"} Aug 02 09:43:59.518752 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:59.518354 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" event={"ID":"5948fb4f-fbd5-4572-853e-65faa3ea6c3c","Type":"ContainerStarted","Data":"44a0f751016b2b6f8c296686b8ba6c9e7846d1718c679842fc347c4036c7e6bc"} Aug 02 09:43:59.550743 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:43:59.550693 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" podStartSLOduration=1.381247246 podStartE2EDuration="1.550678156s" totalImagesPullingTime="169.43091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:43:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:43:59.547318367 +0000 UTC m=+676.108473687" watchObservedRunningTime="2026-08-02 09:43:59.550678156 +0000 UTC m=+676.111833475" Aug 02 09:44:08.443674 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:44:08.443633 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:44:08.444118 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:44:08.443686 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:44:08.456039 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:44:08.456015 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:44:08.584005 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:44:08.583976 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw" Aug 02 09:45:36.752562 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:36.752522 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74bc9776f5-lrrzj"] Aug 02 09:45:36.753143 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:36.752743 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-74bc9776f5-lrrzj" podUID="97aa94ef-d225-40ce-8c02-9883a261aced" containerName="manager" containerID="cri-o://1a28fa07b0ccd9e4ed17eb34f6d6b610cca23a3e548acbaea714957b9108bd35" gracePeriod=30 Aug 02 09:45:37.010500 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.010435 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74bc9776f5-lrrzj" Aug 02 09:45:37.085203 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.085173 2575 generic.go:356] "Generic (PLEG): container finished" podID="97aa94ef-d225-40ce-8c02-9883a261aced" containerID="1a28fa07b0ccd9e4ed17eb34f6d6b610cca23a3e548acbaea714957b9108bd35" exitCode=0 Aug 02 09:45:37.085367 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.085215 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74bc9776f5-lrrzj" Aug 02 09:45:37.085367 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.085223 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74bc9776f5-lrrzj" event={"ID":"97aa94ef-d225-40ce-8c02-9883a261aced","Type":"ContainerDied","Data":"1a28fa07b0ccd9e4ed17eb34f6d6b610cca23a3e548acbaea714957b9108bd35"} Aug 02 09:45:37.085367 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.085264 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74bc9776f5-lrrzj" event={"ID":"97aa94ef-d225-40ce-8c02-9883a261aced","Type":"ContainerDied","Data":"10c783fd1b2d73c6cce1e3032040ea7d52e56aaabcb4332ab3b9c5b99bbe89c7"} Aug 02 09:45:37.085367 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.085284 2575 scope.go:117] "RemoveContainer" containerID="1a28fa07b0ccd9e4ed17eb34f6d6b610cca23a3e548acbaea714957b9108bd35" Aug 02 09:45:37.093620 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.093597 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47jtq\" (UniqueName: \"kubernetes.io/projected/97aa94ef-d225-40ce-8c02-9883a261aced-kube-api-access-47jtq\") pod \"97aa94ef-d225-40ce-8c02-9883a261aced\" (UID: \"97aa94ef-d225-40ce-8c02-9883a261aced\") " Aug 02 09:45:37.093754 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.093648 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97aa94ef-d225-40ce-8c02-9883a261aced-webhook-cert\") pod \"97aa94ef-d225-40ce-8c02-9883a261aced\" (UID: \"97aa94ef-d225-40ce-8c02-9883a261aced\") " Aug 02 09:45:37.094108 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.094086 2575 scope.go:117] "RemoveContainer" containerID="1a28fa07b0ccd9e4ed17eb34f6d6b610cca23a3e548acbaea714957b9108bd35" Aug 02 09:45:37.094389 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:45:37.094367 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a28fa07b0ccd9e4ed17eb34f6d6b610cca23a3e548acbaea714957b9108bd35\": container with ID starting with 1a28fa07b0ccd9e4ed17eb34f6d6b610cca23a3e548acbaea714957b9108bd35 not found: ID does not exist" containerID="1a28fa07b0ccd9e4ed17eb34f6d6b610cca23a3e548acbaea714957b9108bd35" Aug 02 09:45:37.094463 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.094397 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a28fa07b0ccd9e4ed17eb34f6d6b610cca23a3e548acbaea714957b9108bd35"} err="failed to get container status \"1a28fa07b0ccd9e4ed17eb34f6d6b610cca23a3e548acbaea714957b9108bd35\": rpc error: code = NotFound desc = could not find container \"1a28fa07b0ccd9e4ed17eb34f6d6b610cca23a3e548acbaea714957b9108bd35\": container with ID starting with 1a28fa07b0ccd9e4ed17eb34f6d6b610cca23a3e548acbaea714957b9108bd35 not found: ID does not exist" Aug 02 09:45:37.095610 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.095588 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97aa94ef-d225-40ce-8c02-9883a261aced-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "97aa94ef-d225-40ce-8c02-9883a261aced" (UID: "97aa94ef-d225-40ce-8c02-9883a261aced"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:45:37.095691 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.095621 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97aa94ef-d225-40ce-8c02-9883a261aced-kube-api-access-47jtq" (OuterVolumeSpecName: "kube-api-access-47jtq") pod "97aa94ef-d225-40ce-8c02-9883a261aced" (UID: "97aa94ef-d225-40ce-8c02-9883a261aced"). InnerVolumeSpecName "kube-api-access-47jtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:45:37.195016 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.194971 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47jtq\" (UniqueName: \"kubernetes.io/projected/97aa94ef-d225-40ce-8c02-9883a261aced-kube-api-access-47jtq\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:45:37.195016 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.195012 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97aa94ef-d225-40ce-8c02-9883a261aced-webhook-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:45:37.407350 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.407324 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74bc9776f5-lrrzj"] Aug 02 09:45:37.410925 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.410903 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74bc9776f5-lrrzj"] Aug 02 09:45:37.957616 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:45:37.957587 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97aa94ef-d225-40ce-8c02-9883a261aced" path="/var/lib/kubelet/pods/97aa94ef-d225-40ce-8c02-9883a261aced/volumes" Aug 02 09:46:38.205918 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.205881 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74bc9776f5-j65fb"] Aug 02 09:46:38.206343 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.206302 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97aa94ef-d225-40ce-8c02-9883a261aced" containerName="manager" Aug 02 09:46:38.206343 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.206316 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="97aa94ef-d225-40ce-8c02-9883a261aced" containerName="manager" Aug 02 09:46:38.206421 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.206377 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="97aa94ef-d225-40ce-8c02-9883a261aced" containerName="manager" Aug 02 09:46:38.209551 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.209535 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74bc9776f5-j65fb" Aug 02 09:46:38.211963 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.211943 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Aug 02 09:46:38.212863 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.212844 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Aug 02 09:46:38.213008 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.212988 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-78kz9\"" Aug 02 09:46:38.215991 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.215971 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74bc9776f5-j65fb"] Aug 02 09:46:38.344607 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.344578 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8f55897c-b80b-49b5-88fd-a521a291933e-webhook-cert\") pod \"maas-controller-74bc9776f5-j65fb\" (UID: \"8f55897c-b80b-49b5-88fd-a521a291933e\") " pod="opendatahub/maas-controller-74bc9776f5-j65fb" Aug 02 09:46:38.344802 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.344636 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwflg\" (UniqueName: \"kubernetes.io/projected/8f55897c-b80b-49b5-88fd-a521a291933e-kube-api-access-hwflg\") pod \"maas-controller-74bc9776f5-j65fb\" (UID: \"8f55897c-b80b-49b5-88fd-a521a291933e\") " pod="opendatahub/maas-controller-74bc9776f5-j65fb" Aug 02 09:46:38.445561 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.445533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8f55897c-b80b-49b5-88fd-a521a291933e-webhook-cert\") pod \"maas-controller-74bc9776f5-j65fb\" (UID: \"8f55897c-b80b-49b5-88fd-a521a291933e\") " pod="opendatahub/maas-controller-74bc9776f5-j65fb" Aug 02 09:46:38.445746 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.445581 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwflg\" (UniqueName: \"kubernetes.io/projected/8f55897c-b80b-49b5-88fd-a521a291933e-kube-api-access-hwflg\") pod \"maas-controller-74bc9776f5-j65fb\" (UID: \"8f55897c-b80b-49b5-88fd-a521a291933e\") " pod="opendatahub/maas-controller-74bc9776f5-j65fb" Aug 02 09:46:38.447973 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.447951 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8f55897c-b80b-49b5-88fd-a521a291933e-webhook-cert\") pod \"maas-controller-74bc9776f5-j65fb\" (UID: \"8f55897c-b80b-49b5-88fd-a521a291933e\") " pod="opendatahub/maas-controller-74bc9776f5-j65fb" Aug 02 09:46:38.453854 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.453828 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwflg\" (UniqueName: \"kubernetes.io/projected/8f55897c-b80b-49b5-88fd-a521a291933e-kube-api-access-hwflg\") pod \"maas-controller-74bc9776f5-j65fb\" (UID: \"8f55897c-b80b-49b5-88fd-a521a291933e\") " pod="opendatahub/maas-controller-74bc9776f5-j65fb" Aug 02 09:46:38.520802 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.520698 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74bc9776f5-j65fb" Aug 02 09:46:38.655629 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:38.655604 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74bc9776f5-j65fb"] Aug 02 09:46:38.657201 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:46:38.657166 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f55897c_b80b_49b5_88fd_a521a291933e.slice/crio-e28ae211e35b88d836acc392c8fab8f1c13d8099663d7745bf19206e63ab5077 WatchSource:0}: Error finding container e28ae211e35b88d836acc392c8fab8f1c13d8099663d7745bf19206e63ab5077: Status 404 returned error can't find the container with id e28ae211e35b88d836acc392c8fab8f1c13d8099663d7745bf19206e63ab5077 Aug 02 09:46:39.438183 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:39.438095 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74bc9776f5-j65fb" event={"ID":"8f55897c-b80b-49b5-88fd-a521a291933e","Type":"ContainerStarted","Data":"06f606cbf4865edbf726c23c7ab4626fe894a6a24e6461a0862626c3eceb057c"} Aug 02 09:46:39.438183 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:39.438155 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74bc9776f5-j65fb" event={"ID":"8f55897c-b80b-49b5-88fd-a521a291933e","Type":"ContainerStarted","Data":"e28ae211e35b88d836acc392c8fab8f1c13d8099663d7745bf19206e63ab5077"} Aug 02 09:46:39.438576 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:39.438231 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74bc9776f5-j65fb" Aug 02 09:46:39.456673 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:39.456617 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74bc9776f5-j65fb" podStartSLOduration=1.037087858 podStartE2EDuration="1.456596448s" totalImagesPullingTime="419.50859ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:46:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:46:39.453715284 +0000 UTC m=+836.014870605" watchObservedRunningTime="2026-08-02 09:46:39.456596448 +0000 UTC m=+836.017751769" Aug 02 09:46:50.446439 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:50.446404 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74bc9776f5-j65fb" Aug 02 09:46:55.086494 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.086456 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74bc9776f5-j65fb"] Aug 02 09:46:55.087098 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.086647 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-74bc9776f5-j65fb" podUID="8f55897c-b80b-49b5-88fd-a521a291933e" containerName="manager" containerID="cri-o://06f606cbf4865edbf726c23c7ab4626fe894a6a24e6461a0862626c3eceb057c" gracePeriod=30 Aug 02 09:46:55.330272 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.330248 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74bc9776f5-j65fb" Aug 02 09:46:55.392891 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.392805 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwflg\" (UniqueName: \"kubernetes.io/projected/8f55897c-b80b-49b5-88fd-a521a291933e-kube-api-access-hwflg\") pod \"8f55897c-b80b-49b5-88fd-a521a291933e\" (UID: \"8f55897c-b80b-49b5-88fd-a521a291933e\") " Aug 02 09:46:55.393065 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.392894 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8f55897c-b80b-49b5-88fd-a521a291933e-webhook-cert\") pod \"8f55897c-b80b-49b5-88fd-a521a291933e\" (UID: \"8f55897c-b80b-49b5-88fd-a521a291933e\") " Aug 02 09:46:55.395033 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.395000 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f55897c-b80b-49b5-88fd-a521a291933e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8f55897c-b80b-49b5-88fd-a521a291933e" (UID: "8f55897c-b80b-49b5-88fd-a521a291933e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 09:46:55.395033 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.395003 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f55897c-b80b-49b5-88fd-a521a291933e-kube-api-access-hwflg" (OuterVolumeSpecName: "kube-api-access-hwflg") pod "8f55897c-b80b-49b5-88fd-a521a291933e" (UID: "8f55897c-b80b-49b5-88fd-a521a291933e"). InnerVolumeSpecName "kube-api-access-hwflg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:46:55.493684 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.493641 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8f55897c-b80b-49b5-88fd-a521a291933e-webhook-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:46:55.493684 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.493680 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwflg\" (UniqueName: \"kubernetes.io/projected/8f55897c-b80b-49b5-88fd-a521a291933e-kube-api-access-hwflg\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:46:55.530888 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.530859 2575 generic.go:356] "Generic (PLEG): container finished" podID="8f55897c-b80b-49b5-88fd-a521a291933e" containerID="06f606cbf4865edbf726c23c7ab4626fe894a6a24e6461a0862626c3eceb057c" exitCode=0 Aug 02 09:46:55.531062 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.530904 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74bc9776f5-j65fb" Aug 02 09:46:55.531062 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.530940 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74bc9776f5-j65fb" event={"ID":"8f55897c-b80b-49b5-88fd-a521a291933e","Type":"ContainerDied","Data":"06f606cbf4865edbf726c23c7ab4626fe894a6a24e6461a0862626c3eceb057c"} Aug 02 09:46:55.531062 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.530998 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74bc9776f5-j65fb" event={"ID":"8f55897c-b80b-49b5-88fd-a521a291933e","Type":"ContainerDied","Data":"e28ae211e35b88d836acc392c8fab8f1c13d8099663d7745bf19206e63ab5077"} Aug 02 09:46:55.531062 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.531031 2575 scope.go:117] "RemoveContainer" containerID="06f606cbf4865edbf726c23c7ab4626fe894a6a24e6461a0862626c3eceb057c" Aug 02 09:46:55.540899 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.540883 2575 scope.go:117] "RemoveContainer" containerID="06f606cbf4865edbf726c23c7ab4626fe894a6a24e6461a0862626c3eceb057c" Aug 02 09:46:55.541136 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:46:55.541120 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06f606cbf4865edbf726c23c7ab4626fe894a6a24e6461a0862626c3eceb057c\": container with ID starting with 06f606cbf4865edbf726c23c7ab4626fe894a6a24e6461a0862626c3eceb057c not found: ID does not exist" containerID="06f606cbf4865edbf726c23c7ab4626fe894a6a24e6461a0862626c3eceb057c" Aug 02 09:46:55.541176 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.541146 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06f606cbf4865edbf726c23c7ab4626fe894a6a24e6461a0862626c3eceb057c"} err="failed to get container status \"06f606cbf4865edbf726c23c7ab4626fe894a6a24e6461a0862626c3eceb057c\": rpc error: code = NotFound desc = could not find container \"06f606cbf4865edbf726c23c7ab4626fe894a6a24e6461a0862626c3eceb057c\": container with ID starting with 06f606cbf4865edbf726c23c7ab4626fe894a6a24e6461a0862626c3eceb057c not found: ID does not exist" Aug 02 09:46:55.553942 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.553921 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74bc9776f5-j65fb"] Aug 02 09:46:55.557141 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.557122 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74bc9776f5-j65fb"] Aug 02 09:46:55.957788 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:55.957744 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f55897c-b80b-49b5-88fd-a521a291933e" path="/var/lib/kubelet/pods/8f55897c-b80b-49b5-88fd-a521a291933e/volumes" Aug 02 09:46:56.350287 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.350250 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74bc9776f5-tddkm"] Aug 02 09:46:56.350848 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.350829 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f55897c-b80b-49b5-88fd-a521a291933e" containerName="manager" Aug 02 09:46:56.350940 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.350851 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f55897c-b80b-49b5-88fd-a521a291933e" containerName="manager" Aug 02 09:46:56.351004 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.350987 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f55897c-b80b-49b5-88fd-a521a291933e" containerName="manager" Aug 02 09:46:56.355264 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.355243 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74bc9776f5-tddkm" Aug 02 09:46:56.357743 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.357725 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Aug 02 09:46:56.358590 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.358572 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Aug 02 09:46:56.358677 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.358574 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-78kz9\"" Aug 02 09:46:56.364710 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.364690 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74bc9776f5-tddkm"] Aug 02 09:46:56.401482 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.401458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzng8\" (UniqueName: \"kubernetes.io/projected/b60d6ae5-dce6-42cb-89c3-0a11a811b77b-kube-api-access-fzng8\") pod \"maas-controller-74bc9776f5-tddkm\" (UID: \"b60d6ae5-dce6-42cb-89c3-0a11a811b77b\") " pod="opendatahub/maas-controller-74bc9776f5-tddkm" Aug 02 09:46:56.401618 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.401494 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b60d6ae5-dce6-42cb-89c3-0a11a811b77b-webhook-cert\") pod \"maas-controller-74bc9776f5-tddkm\" (UID: \"b60d6ae5-dce6-42cb-89c3-0a11a811b77b\") " pod="opendatahub/maas-controller-74bc9776f5-tddkm" Aug 02 09:46:56.502607 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.502577 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b60d6ae5-dce6-42cb-89c3-0a11a811b77b-webhook-cert\") pod \"maas-controller-74bc9776f5-tddkm\" (UID: \"b60d6ae5-dce6-42cb-89c3-0a11a811b77b\") " pod="opendatahub/maas-controller-74bc9776f5-tddkm" Aug 02 09:46:56.502811 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.502701 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzng8\" (UniqueName: \"kubernetes.io/projected/b60d6ae5-dce6-42cb-89c3-0a11a811b77b-kube-api-access-fzng8\") pod \"maas-controller-74bc9776f5-tddkm\" (UID: \"b60d6ae5-dce6-42cb-89c3-0a11a811b77b\") " pod="opendatahub/maas-controller-74bc9776f5-tddkm" Aug 02 09:46:56.505219 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.505188 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b60d6ae5-dce6-42cb-89c3-0a11a811b77b-webhook-cert\") pod \"maas-controller-74bc9776f5-tddkm\" (UID: \"b60d6ae5-dce6-42cb-89c3-0a11a811b77b\") " pod="opendatahub/maas-controller-74bc9776f5-tddkm" Aug 02 09:46:56.512172 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.512142 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzng8\" (UniqueName: \"kubernetes.io/projected/b60d6ae5-dce6-42cb-89c3-0a11a811b77b-kube-api-access-fzng8\") pod \"maas-controller-74bc9776f5-tddkm\" (UID: \"b60d6ae5-dce6-42cb-89c3-0a11a811b77b\") " pod="opendatahub/maas-controller-74bc9776f5-tddkm" Aug 02 09:46:56.666288 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.666207 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74bc9776f5-tddkm" Aug 02 09:46:56.803238 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:56.803215 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74bc9776f5-tddkm"] Aug 02 09:46:56.804837 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:46:56.804815 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60d6ae5_dce6_42cb_89c3_0a11a811b77b.slice/crio-51cb569aac8caaedf09a0c2cdb5454c7ba1f95acfd52475a51fb6051ca5fe161 WatchSource:0}: Error finding container 51cb569aac8caaedf09a0c2cdb5454c7ba1f95acfd52475a51fb6051ca5fe161: Status 404 returned error can't find the container with id 51cb569aac8caaedf09a0c2cdb5454c7ba1f95acfd52475a51fb6051ca5fe161 Aug 02 09:46:57.545104 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:57.545072 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74bc9776f5-tddkm" event={"ID":"b60d6ae5-dce6-42cb-89c3-0a11a811b77b","Type":"ContainerStarted","Data":"b93bb05ff71be95e4874e80d77c4a09924b63469935493b6f41b6093b9a5bdbe"} Aug 02 09:46:57.545508 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:57.545152 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74bc9776f5-tddkm" event={"ID":"b60d6ae5-dce6-42cb-89c3-0a11a811b77b","Type":"ContainerStarted","Data":"51cb569aac8caaedf09a0c2cdb5454c7ba1f95acfd52475a51fb6051ca5fe161"} Aug 02 09:46:57.545508 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:57.545221 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74bc9776f5-tddkm" Aug 02 09:46:57.562345 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:46:57.562296 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74bc9776f5-tddkm" podStartSLOduration=1.266446841 podStartE2EDuration="1.562281161s" totalImagesPullingTime="295.83432ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:46:57.560491927 +0000 UTC m=+854.121647247" watchObservedRunningTime="2026-08-02 09:46:57.562281161 +0000 UTC m=+854.123436494" Aug 02 09:47:08.553307 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:47:08.553281 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74bc9776f5-tddkm" Aug 02 09:47:43.940640 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:47:43.940562 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 09:47:43.944094 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:47:43.944067 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 09:47:43.944260 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:47:43.944241 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 09:47:43.947323 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:47:43.947305 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 09:52:43.981541 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:52:43.981503 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 09:52:43.982070 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:52:43.981672 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 09:52:43.984582 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:52:43.984562 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 09:52:43.984817 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:52:43.984797 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 09:53:20.901957 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:20.901922 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9"] Aug 02 09:53:20.902509 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:20.902159 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" podUID="5cc76436-aaa7-4357-8146-fe8a50520bec" containerName="manager" containerID="cri-o://1bb4aa076163124857ae3993ac22cc14ae30a12fe724448bd3830220d9da1db1" gracePeriod=10 Aug 02 09:53:21.153848 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.153757 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" Aug 02 09:53:21.284947 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.284909 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf8bx\" (UniqueName: \"kubernetes.io/projected/5cc76436-aaa7-4357-8146-fe8a50520bec-kube-api-access-gf8bx\") pod \"5cc76436-aaa7-4357-8146-fe8a50520bec\" (UID: \"5cc76436-aaa7-4357-8146-fe8a50520bec\") " Aug 02 09:53:21.285093 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.285005 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cc76436-aaa7-4357-8146-fe8a50520bec-extensions-socket-volume\") pod \"5cc76436-aaa7-4357-8146-fe8a50520bec\" (UID: \"5cc76436-aaa7-4357-8146-fe8a50520bec\") " Aug 02 09:53:21.285384 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.285363 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cc76436-aaa7-4357-8146-fe8a50520bec-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5cc76436-aaa7-4357-8146-fe8a50520bec" (UID: "5cc76436-aaa7-4357-8146-fe8a50520bec"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 09:53:21.287088 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.287067 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cc76436-aaa7-4357-8146-fe8a50520bec-kube-api-access-gf8bx" (OuterVolumeSpecName: "kube-api-access-gf8bx") pod "5cc76436-aaa7-4357-8146-fe8a50520bec" (UID: "5cc76436-aaa7-4357-8146-fe8a50520bec"). InnerVolumeSpecName "kube-api-access-gf8bx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 09:53:21.386231 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.386192 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf8bx\" (UniqueName: \"kubernetes.io/projected/5cc76436-aaa7-4357-8146-fe8a50520bec-kube-api-access-gf8bx\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:53:21.386231 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.386225 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cc76436-aaa7-4357-8146-fe8a50520bec-extensions-socket-volume\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 09:53:21.758901 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.758862 2575 generic.go:356] "Generic (PLEG): container finished" podID="5cc76436-aaa7-4357-8146-fe8a50520bec" containerID="1bb4aa076163124857ae3993ac22cc14ae30a12fe724448bd3830220d9da1db1" exitCode=0 Aug 02 09:53:21.759103 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.758912 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" Aug 02 09:53:21.759103 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.758951 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" event={"ID":"5cc76436-aaa7-4357-8146-fe8a50520bec","Type":"ContainerDied","Data":"1bb4aa076163124857ae3993ac22cc14ae30a12fe724448bd3830220d9da1db1"} Aug 02 09:53:21.759103 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.759018 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9" event={"ID":"5cc76436-aaa7-4357-8146-fe8a50520bec","Type":"ContainerDied","Data":"9bebab456186d468dc619d5c62fbba3a47d60898223a154a5b1ad934dcac3f72"} Aug 02 09:53:21.759103 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.759051 2575 scope.go:117] "RemoveContainer" containerID="1bb4aa076163124857ae3993ac22cc14ae30a12fe724448bd3830220d9da1db1" Aug 02 09:53:21.769516 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.769495 2575 scope.go:117] "RemoveContainer" containerID="1bb4aa076163124857ae3993ac22cc14ae30a12fe724448bd3830220d9da1db1" Aug 02 09:53:21.769848 ip-10-0-142-118 kubenswrapper[2575]: E0802 09:53:21.769823 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bb4aa076163124857ae3993ac22cc14ae30a12fe724448bd3830220d9da1db1\": container with ID starting with 1bb4aa076163124857ae3993ac22cc14ae30a12fe724448bd3830220d9da1db1 not found: ID does not exist" containerID="1bb4aa076163124857ae3993ac22cc14ae30a12fe724448bd3830220d9da1db1" Aug 02 09:53:21.769914 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.769855 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bb4aa076163124857ae3993ac22cc14ae30a12fe724448bd3830220d9da1db1"} err="failed to get container status \"1bb4aa076163124857ae3993ac22cc14ae30a12fe724448bd3830220d9da1db1\": rpc error: code = NotFound desc = could not find container \"1bb4aa076163124857ae3993ac22cc14ae30a12fe724448bd3830220d9da1db1\": container with ID starting with 1bb4aa076163124857ae3993ac22cc14ae30a12fe724448bd3830220d9da1db1 not found: ID does not exist" Aug 02 09:53:21.780104 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.780085 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9"] Aug 02 09:53:21.783907 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.783888 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-qv2g9"] Aug 02 09:53:21.956584 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:53:21.956549 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cc76436-aaa7-4357-8146-fe8a50520bec" path="/var/lib/kubelet/pods/5cc76436-aaa7-4357-8146-fe8a50520bec/volumes" Aug 02 09:54:21.628579 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:21.628543 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch"] Aug 02 09:54:21.629103 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:21.628983 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cc76436-aaa7-4357-8146-fe8a50520bec" containerName="manager" Aug 02 09:54:21.629103 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:21.628994 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cc76436-aaa7-4357-8146-fe8a50520bec" containerName="manager" Aug 02 09:54:21.629103 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:21.629060 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cc76436-aaa7-4357-8146-fe8a50520bec" containerName="manager" Aug 02 09:54:21.632257 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:21.632239 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" Aug 02 09:54:21.634950 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:21.634928 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sd755\"" Aug 02 09:54:21.649610 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:21.649584 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch"] Aug 02 09:54:21.816538 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:21.816504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2hh9\" (UniqueName: \"kubernetes.io/projected/bc66086d-1cb1-4f3a-bffd-bc520f0abc07-kube-api-access-v2hh9\") pod \"kuadrant-operator-controller-manager-68cf589589-hmpch\" (UID: \"bc66086d-1cb1-4f3a-bffd-bc520f0abc07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" Aug 02 09:54:21.816731 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:21.816647 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc66086d-1cb1-4f3a-bffd-bc520f0abc07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-hmpch\" (UID: \"bc66086d-1cb1-4f3a-bffd-bc520f0abc07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" Aug 02 09:54:21.917659 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:21.917573 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc66086d-1cb1-4f3a-bffd-bc520f0abc07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-hmpch\" (UID: \"bc66086d-1cb1-4f3a-bffd-bc520f0abc07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" Aug 02 09:54:21.917659 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:21.917624 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2hh9\" (UniqueName: \"kubernetes.io/projected/bc66086d-1cb1-4f3a-bffd-bc520f0abc07-kube-api-access-v2hh9\") pod \"kuadrant-operator-controller-manager-68cf589589-hmpch\" (UID: \"bc66086d-1cb1-4f3a-bffd-bc520f0abc07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" Aug 02 09:54:21.917954 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:21.917934 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc66086d-1cb1-4f3a-bffd-bc520f0abc07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-hmpch\" (UID: \"bc66086d-1cb1-4f3a-bffd-bc520f0abc07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" Aug 02 09:54:21.930902 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:21.930875 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2hh9\" (UniqueName: \"kubernetes.io/projected/bc66086d-1cb1-4f3a-bffd-bc520f0abc07-kube-api-access-v2hh9\") pod \"kuadrant-operator-controller-manager-68cf589589-hmpch\" (UID: \"bc66086d-1cb1-4f3a-bffd-bc520f0abc07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" Aug 02 09:54:21.942712 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:21.942692 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" Aug 02 09:54:22.083754 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:22.083730 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch"] Aug 02 09:54:22.085917 ip-10-0-142-118 kubenswrapper[2575]: W0802 09:54:22.085890 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc66086d_1cb1_4f3a_bffd_bc520f0abc07.slice/crio-244693e276cf813e9b331cd8668b44d0ff6d215e7fdb9ebff6a6fe8af413c135 WatchSource:0}: Error finding container 244693e276cf813e9b331cd8668b44d0ff6d215e7fdb9ebff6a6fe8af413c135: Status 404 returned error can't find the container with id 244693e276cf813e9b331cd8668b44d0ff6d215e7fdb9ebff6a6fe8af413c135 Aug 02 09:54:23.098700 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:23.098660 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" event={"ID":"bc66086d-1cb1-4f3a-bffd-bc520f0abc07","Type":"ContainerStarted","Data":"1095833d18bf17564bc18999a8851aec913c2c303e2f04774d34af384feb0753"} Aug 02 09:54:23.099119 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:23.098738 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" event={"ID":"bc66086d-1cb1-4f3a-bffd-bc520f0abc07","Type":"ContainerStarted","Data":"244693e276cf813e9b331cd8668b44d0ff6d215e7fdb9ebff6a6fe8af413c135"} Aug 02 09:54:23.099119 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:23.098808 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" Aug 02 09:54:23.125027 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:23.124978 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" podStartSLOduration=2.124963586 podStartE2EDuration="2.124963586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 09:54:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 09:54:23.121296289 +0000 UTC m=+1299.682451609" watchObservedRunningTime="2026-08-02 09:54:23.124963586 +0000 UTC m=+1299.686118906" Aug 02 09:54:34.106389 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:54:34.106359 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" Aug 02 09:57:44.032891 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:57:44.032865 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 09:57:44.035552 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:57:44.035531 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 09:57:44.035985 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:57:44.035963 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 09:57:44.038953 ip-10-0-142-118 kubenswrapper[2575]: I0802 09:57:44.038934 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:01:51.247284 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.247247 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk"] Aug 02 10:01:51.250651 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.250635 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.253010 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.252990 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ea933196-openshift-default-dockercfg-sm9tx\"" Aug 02 10:01:51.270905 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.270878 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk"] Aug 02 10:01:51.345277 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.345213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-envoy\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.345471 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.345380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-podinfo\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.345471 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.345440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istiod-ca-cert\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.345599 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.345483 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-data\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.345599 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.345532 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-token\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.345599 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.345580 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-workload-socket\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.345805 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.345622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-credential-socket\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.345805 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.345655 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-workload-certs\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.345805 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.345686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5qgk\" (UniqueName: \"kubernetes.io/projected/4baf6621-a7aa-4af7-8a71-7e8294d10b65-kube-api-access-p5qgk\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.446900 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.446862 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-envoy\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.447069 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.447019 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-podinfo\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.447142 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.447072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istiod-ca-cert\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.447142 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.447105 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-data\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.447142 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.447125 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-token\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.447301 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.447150 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-workload-socket\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.447301 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.447176 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-credential-socket\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.447415 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.447320 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-workload-certs\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.447415 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.447367 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5qgk\" (UniqueName: \"kubernetes.io/projected/4baf6621-a7aa-4af7-8a71-7e8294d10b65-kube-api-access-p5qgk\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.447538 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.447500 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-data\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.447653 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.447629 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-workload-socket\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.447843 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.447822 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-workload-certs\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.447944 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.447847 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-credential-socket\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.448020 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.448001 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istiod-ca-cert\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.449298 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.449269 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-envoy\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.449507 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.449491 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-podinfo\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.454607 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.454589 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-token\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.454801 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.454767 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5qgk\" (UniqueName: \"kubernetes.io/projected/4baf6621-a7aa-4af7-8a71-7e8294d10b65-kube-api-access-p5qgk\") pod \"e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.561195 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.561158 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:51.708730 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.708699 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk"] Aug 02 10:01:51.710731 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:01:51.710704 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4baf6621_a7aa_4af7_8a71_7e8294d10b65.slice/crio-fbdf9ec6fc3ccf10e29d4b037b70d8c751fd186ef15484e6505fc9c48b9788cb WatchSource:0}: Error finding container fbdf9ec6fc3ccf10e29d4b037b70d8c751fd186ef15484e6505fc9c48b9788cb: Status 404 returned error can't find the container with id fbdf9ec6fc3ccf10e29d4b037b70d8c751fd186ef15484e6505fc9c48b9788cb Aug 02 10:01:51.712809 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.712749 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 10:01:51.712905 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.712842 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 10:01:51.712905 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:51.712877 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 10:01:52.677658 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:52.677623 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" event={"ID":"4baf6621-a7aa-4af7-8a71-7e8294d10b65","Type":"ContainerStarted","Data":"295ea8ab339b98d37e5ada5f0487a50aaa689ec3ee352afe035454b269e5f489"} Aug 02 10:01:52.678123 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:52.677679 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" event={"ID":"4baf6621-a7aa-4af7-8a71-7e8294d10b65","Type":"ContainerStarted","Data":"fbdf9ec6fc3ccf10e29d4b037b70d8c751fd186ef15484e6505fc9c48b9788cb"} Aug 02 10:01:52.705456 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:52.705401 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" podStartSLOduration=1.705385548 podStartE2EDuration="1.705385548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:01:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:01:52.703246239 +0000 UTC m=+1749.264401560" watchObservedRunningTime="2026-08-02 10:01:52.705385548 +0000 UTC m=+1749.266540868" Aug 02 10:01:53.561785 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:53.561753 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:53.566730 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:53.566706 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:53.683379 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:53.683353 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:01:53.684422 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:01:53.684397 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:02:08.684573 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:08.684505 2575 patch_prober.go:28] interesting pod/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Aug 02 10:02:08.684983 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:08.684567 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Aug 02 10:02:08.778971 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:08.778892 2575 generic.go:356] "Generic (PLEG): container finished" podID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerID="295ea8ab339b98d37e5ada5f0487a50aaa689ec3ee352afe035454b269e5f489" exitCode=0 Aug 02 10:02:08.779137 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:08.778967 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" event={"ID":"4baf6621-a7aa-4af7-8a71-7e8294d10b65","Type":"ContainerDied","Data":"295ea8ab339b98d37e5ada5f0487a50aaa689ec3ee352afe035454b269e5f489"} Aug 02 10:02:08.779383 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:08.779368 2575 scope.go:117] "RemoveContainer" containerID="295ea8ab339b98d37e5ada5f0487a50aaa689ec3ee352afe035454b269e5f489" Aug 02 10:02:08.780379 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:08.780353 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 10:02:08.780432 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:08.780418 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 10:02:08.780479 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:08.780468 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 10:02:09.786640 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:09.786602 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" event={"ID":"4baf6621-a7aa-4af7-8a71-7e8294d10b65","Type":"ContainerStarted","Data":"6cf908cfa104d8624660e9b98de8eabb8825f5690316e53ec591cddbb7bae171"} Aug 02 10:02:10.561537 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:10.561503 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:02:10.561717 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:10.561703 2575 patch_prober.go:28] interesting pod/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Aug 02 10:02:10.561761 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:10.561743 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Aug 02 10:02:11.562456 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:11.562419 2575 patch_prober.go:28] interesting pod/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Aug 02 10:02:11.562896 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:11.562472 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Aug 02 10:02:12.562244 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:12.562205 2575 patch_prober.go:28] interesting pod/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Aug 02 10:02:12.562443 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:12.562265 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Aug 02 10:02:13.561609 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:13.561568 2575 patch_prober.go:28] interesting pod/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Aug 02 10:02:13.562030 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:13.561630 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Aug 02 10:02:14.562553 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:14.562516 2575 patch_prober.go:28] interesting pod/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Aug 02 10:02:14.562959 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:14.562575 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Aug 02 10:02:15.566202 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:15.566169 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:02:15.566648 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:15.566438 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:02:15.567147 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:15.567132 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:02:27.801139 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:27.801105 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk"] Aug 02 10:02:27.801603 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:27.801328 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerName="istio-proxy" containerID="cri-o://6cf908cfa104d8624660e9b98de8eabb8825f5690316e53ec591cddbb7bae171" gracePeriod=30 Aug 02 10:02:30.569011 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:30.568975 2575 patch_prober.go:28] interesting pod/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 02 10:02:30.569401 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:30.569047 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 02 10:02:32.926412 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:32.926384 2575 generic.go:356] "Generic (PLEG): container finished" podID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerID="6cf908cfa104d8624660e9b98de8eabb8825f5690316e53ec591cddbb7bae171" exitCode=0 Aug 02 10:02:32.926813 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:32.926420 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" event={"ID":"4baf6621-a7aa-4af7-8a71-7e8294d10b65","Type":"ContainerDied","Data":"6cf908cfa104d8624660e9b98de8eabb8825f5690316e53ec591cddbb7bae171"} Aug 02 10:02:32.926813 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:32.926468 2575 scope.go:117] "RemoveContainer" containerID="295ea8ab339b98d37e5ada5f0487a50aaa689ec3ee352afe035454b269e5f489" Aug 02 10:02:33.057853 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.057824 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:02:33.167797 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.167674 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-podinfo\") pod \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " Aug 02 10:02:33.167797 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.167727 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-workload-certs\") pod \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " Aug 02 10:02:33.167797 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.167769 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-workload-socket\") pod \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " Aug 02 10:02:33.168089 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.167821 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-token\") pod \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " Aug 02 10:02:33.168089 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.167845 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istiod-ca-cert\") pod \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " Aug 02 10:02:33.168089 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.167932 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-envoy\") pod \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " Aug 02 10:02:33.168089 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.167953 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-data\") pod \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " Aug 02 10:02:33.168089 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.168007 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-credential-socket\") pod \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " Aug 02 10:02:33.168089 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.168033 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5qgk\" (UniqueName: \"kubernetes.io/projected/4baf6621-a7aa-4af7-8a71-7e8294d10b65-kube-api-access-p5qgk\") pod \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\" (UID: \"4baf6621-a7aa-4af7-8a71-7e8294d10b65\") " Aug 02 10:02:33.168403 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.168118 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4baf6621-a7aa-4af7-8a71-7e8294d10b65" (UID: "4baf6621-a7aa-4af7-8a71-7e8294d10b65"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:02:33.168403 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.168279 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4baf6621-a7aa-4af7-8a71-7e8294d10b65" (UID: "4baf6621-a7aa-4af7-8a71-7e8294d10b65"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:02:33.168403 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.168277 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-data" (OuterVolumeSpecName: "istio-data") pod "4baf6621-a7aa-4af7-8a71-7e8294d10b65" (UID: "4baf6621-a7aa-4af7-8a71-7e8294d10b65"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:02:33.168566 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.168483 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4baf6621-a7aa-4af7-8a71-7e8294d10b65" (UID: "4baf6621-a7aa-4af7-8a71-7e8294d10b65"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:02:33.168566 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.168538 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4baf6621-a7aa-4af7-8a71-7e8294d10b65" (UID: "4baf6621-a7aa-4af7-8a71-7e8294d10b65"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:02:33.168671 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.168656 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-credential-socket\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:02:33.168728 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.168674 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-workload-certs\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:02:33.168728 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.168689 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-workload-socket\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:02:33.168728 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.168704 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istiod-ca-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:02:33.168728 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.168716 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-data\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:02:33.170637 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.170604 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-token" (OuterVolumeSpecName: "istio-token") pod "4baf6621-a7aa-4af7-8a71-7e8294d10b65" (UID: "4baf6621-a7aa-4af7-8a71-7e8294d10b65"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:02:33.170637 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.170620 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4baf6621-a7aa-4af7-8a71-7e8294d10b65" (UID: "4baf6621-a7aa-4af7-8a71-7e8294d10b65"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 02 10:02:33.170637 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.170616 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4baf6621-a7aa-4af7-8a71-7e8294d10b65-kube-api-access-p5qgk" (OuterVolumeSpecName: "kube-api-access-p5qgk") pod "4baf6621-a7aa-4af7-8a71-7e8294d10b65" (UID: "4baf6621-a7aa-4af7-8a71-7e8294d10b65"). InnerVolumeSpecName "kube-api-access-p5qgk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:02:33.170863 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.170636 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4baf6621-a7aa-4af7-8a71-7e8294d10b65" (UID: "4baf6621-a7aa-4af7-8a71-7e8294d10b65"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:02:33.270051 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.270016 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-envoy\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:02:33.270051 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.270060 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5qgk\" (UniqueName: \"kubernetes.io/projected/4baf6621-a7aa-4af7-8a71-7e8294d10b65-kube-api-access-p5qgk\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:02:33.270266 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.270070 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-podinfo\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:02:33.270266 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.270078 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4baf6621-a7aa-4af7-8a71-7e8294d10b65-istio-token\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:02:33.933921 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.933887 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" Aug 02 10:02:33.933921 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.933917 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk" event={"ID":"4baf6621-a7aa-4af7-8a71-7e8294d10b65","Type":"ContainerDied","Data":"fbdf9ec6fc3ccf10e29d4b037b70d8c751fd186ef15484e6505fc9c48b9788cb"} Aug 02 10:02:33.934456 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.933972 2575 scope.go:117] "RemoveContainer" containerID="6cf908cfa104d8624660e9b98de8eabb8825f5690316e53ec591cddbb7bae171" Aug 02 10:02:33.958846 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.958820 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk"] Aug 02 10:02:33.962495 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:33.962476 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ea933196-openshift-default-6c874d64bb-gbzsk"] Aug 02 10:02:35.956377 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:35.956340 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" path="/var/lib/kubelet/pods/4baf6621-a7aa-4af7-8a71-7e8294d10b65/volumes" Aug 02 10:02:44.070060 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:44.070034 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:02:44.073327 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:44.073303 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:02:44.074696 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:44.074677 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:02:44.077809 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:44.077767 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:02:58.798362 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:58.798325 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc"] Aug 02 10:02:58.798787 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:58.798705 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerName="istio-proxy" Aug 02 10:02:58.798787 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:58.798716 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerName="istio-proxy" Aug 02 10:02:58.798871 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:58.798824 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerName="istio-proxy" Aug 02 10:02:58.798871 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:58.798832 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerName="istio-proxy" Aug 02 10:02:58.801922 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:58.801904 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc" Aug 02 10:02:58.804037 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:58.804016 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7lxd\"" Aug 02 10:02:58.804175 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:58.804059 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 02 10:02:58.808961 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:58.808935 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc"] Aug 02 10:02:58.896875 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:58.896839 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8937295a-562c-401f-9b78-2945a86890b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc\" (UID: \"8937295a-562c-401f-9b78-2945a86890b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc" Aug 02 10:02:58.998262 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:58.998226 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8937295a-562c-401f-9b78-2945a86890b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc\" (UID: \"8937295a-562c-401f-9b78-2945a86890b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc" Aug 02 10:02:58.998873 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:58.998855 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8937295a-562c-401f-9b78-2945a86890b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc\" (UID: \"8937295a-562c-401f-9b78-2945a86890b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc" Aug 02 10:02:59.115809 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:59.115708 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc" Aug 02 10:02:59.253071 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:59.253040 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc"] Aug 02 10:02:59.254859 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:02:59.254830 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8937295a_562c_401f_9b78_2945a86890b9.slice/crio-d9516377b844ed680ef5aad3eeb0d01552935f66e1b8b90a7099483b89d310f4 WatchSource:0}: Error finding container d9516377b844ed680ef5aad3eeb0d01552935f66e1b8b90a7099483b89d310f4: Status 404 returned error can't find the container with id d9516377b844ed680ef5aad3eeb0d01552935f66e1b8b90a7099483b89d310f4 Aug 02 10:02:59.256952 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:02:59.256934 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 02 10:03:00.088106 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:00.088071 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc" event={"ID":"8937295a-562c-401f-9b78-2945a86890b9","Type":"ContainerStarted","Data":"d9516377b844ed680ef5aad3eeb0d01552935f66e1b8b90a7099483b89d310f4"} Aug 02 10:03:02.102463 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:02.102427 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc" event={"ID":"8937295a-562c-401f-9b78-2945a86890b9","Type":"ContainerStarted","Data":"94a33eec0d865a3da1e6fb4c7741b7a3e99010e4107d08bd42ecf7e5afa82559"} Aug 02 10:03:02.121060 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:02.120999 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc" podStartSLOduration=1.917478416 podStartE2EDuration="4.120984422s" totalImagesPullingTime="2.203506006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:03:02.117827851 +0000 UTC m=+1818.678983148" watchObservedRunningTime="2026-08-02 10:03:02.120984422 +0000 UTC m=+1818.682139742" Aug 02 10:03:03.109375 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:03.109341 2575 generic.go:356] "Generic (PLEG): container finished" podID="8937295a-562c-401f-9b78-2945a86890b9" containerID="94a33eec0d865a3da1e6fb4c7741b7a3e99010e4107d08bd42ecf7e5afa82559" exitCode=0 Aug 02 10:03:03.109802 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:03.109426 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc" event={"ID":"8937295a-562c-401f-9b78-2945a86890b9","Type":"ContainerDied","Data":"94a33eec0d865a3da1e6fb4c7741b7a3e99010e4107d08bd42ecf7e5afa82559"} Aug 02 10:03:04.253958 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:04.253933 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc" Aug 02 10:03:04.349353 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:04.349324 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8937295a-562c-401f-9b78-2945a86890b9-maas-api-service-ca\") pod \"8937295a-562c-401f-9b78-2945a86890b9\" (UID: \"8937295a-562c-401f-9b78-2945a86890b9\") " Aug 02 10:03:04.349710 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:04.349686 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8937295a-562c-401f-9b78-2945a86890b9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8937295a-562c-401f-9b78-2945a86890b9" (UID: "8937295a-562c-401f-9b78-2945a86890b9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:03:04.450190 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:04.450104 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8937295a-562c-401f-9b78-2945a86890b9-maas-api-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:03:05.121921 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:05.121891 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc" Aug 02 10:03:05.122072 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:05.121936 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc" event={"ID":"8937295a-562c-401f-9b78-2945a86890b9","Type":"ContainerDied","Data":"d9516377b844ed680ef5aad3eeb0d01552935f66e1b8b90a7099483b89d310f4"} Aug 02 10:03:05.122072 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:05.121983 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9516377b844ed680ef5aad3eeb0d01552935f66e1b8b90a7099483b89d310f4" Aug 02 10:03:15.500496 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:15.500458 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc"] Aug 02 10:03:15.503401 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:15.503374 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d0cd833-67ctc"] Aug 02 10:03:15.956505 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:15.956469 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8937295a-562c-401f-9b78-2945a86890b9" path="/var/lib/kubelet/pods/8937295a-562c-401f-9b78-2945a86890b9/volumes" Aug 02 10:03:44.749120 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:44.749082 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q"] Aug 02 10:03:44.749537 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:44.749522 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8937295a-562c-401f-9b78-2945a86890b9" containerName="revoke-keys" Aug 02 10:03:44.749582 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:44.749540 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8937295a-562c-401f-9b78-2945a86890b9" containerName="revoke-keys" Aug 02 10:03:44.749582 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:44.749568 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerName="istio-proxy" Aug 02 10:03:44.749582 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:44.749575 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4baf6621-a7aa-4af7-8a71-7e8294d10b65" containerName="istio-proxy" Aug 02 10:03:44.749676 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:44.749644 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8937295a-562c-401f-9b78-2945a86890b9" containerName="revoke-keys" Aug 02 10:03:44.757891 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:44.757865 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q" Aug 02 10:03:44.759795 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:44.759756 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q"] Aug 02 10:03:44.760405 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:44.760382 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 02 10:03:44.760529 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:44.760382 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7lxd\"" Aug 02 10:03:44.825947 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:44.825908 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f71bb1-4c3d-449b-887f-46bee7d66275-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-973f165e-nl74q\" (UID: \"12f71bb1-4c3d-449b-887f-46bee7d66275\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q" Aug 02 10:03:44.926612 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:44.926582 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f71bb1-4c3d-449b-887f-46bee7d66275-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-973f165e-nl74q\" (UID: \"12f71bb1-4c3d-449b-887f-46bee7d66275\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q" Aug 02 10:03:44.927194 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:44.927175 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f71bb1-4c3d-449b-887f-46bee7d66275-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-973f165e-nl74q\" (UID: \"12f71bb1-4c3d-449b-887f-46bee7d66275\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q" Aug 02 10:03:45.071012 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:45.070974 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q" Aug 02 10:03:45.209708 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:45.209681 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q"] Aug 02 10:03:45.210856 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:03:45.210818 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f71bb1_4c3d_449b_887f_46bee7d66275.slice/crio-e12135201ae8a6d5f5233460079d3da876278f9bf27d4c91140c218715e0c125 WatchSource:0}: Error finding container e12135201ae8a6d5f5233460079d3da876278f9bf27d4c91140c218715e0c125: Status 404 returned error can't find the container with id e12135201ae8a6d5f5233460079d3da876278f9bf27d4c91140c218715e0c125 Aug 02 10:03:45.365824 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:45.365721 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q" event={"ID":"12f71bb1-4c3d-449b-887f-46bee7d66275","Type":"ContainerStarted","Data":"e12135201ae8a6d5f5233460079d3da876278f9bf27d4c91140c218715e0c125"} Aug 02 10:03:46.373309 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:46.373274 2575 generic.go:356] "Generic (PLEG): container finished" podID="12f71bb1-4c3d-449b-887f-46bee7d66275" containerID="b5b85eba3465265986e6e11bca773c72e70a0df8eedcb11cb73af83d15aa4277" exitCode=0 Aug 02 10:03:46.373723 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:46.373356 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q" event={"ID":"12f71bb1-4c3d-449b-887f-46bee7d66275","Type":"ContainerDied","Data":"b5b85eba3465265986e6e11bca773c72e70a0df8eedcb11cb73af83d15aa4277"} Aug 02 10:03:47.514884 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:47.514849 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q" Aug 02 10:03:47.651586 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:47.651487 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f71bb1-4c3d-449b-887f-46bee7d66275-maas-api-service-ca\") pod \"12f71bb1-4c3d-449b-887f-46bee7d66275\" (UID: \"12f71bb1-4c3d-449b-887f-46bee7d66275\") " Aug 02 10:03:47.651887 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:47.651862 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12f71bb1-4c3d-449b-887f-46bee7d66275-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "12f71bb1-4c3d-449b-887f-46bee7d66275" (UID: "12f71bb1-4c3d-449b-887f-46bee7d66275"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:03:47.752599 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:47.752562 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f71bb1-4c3d-449b-887f-46bee7d66275-maas-api-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:03:48.386046 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:48.386015 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q" Aug 02 10:03:48.386046 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:48.386027 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q" event={"ID":"12f71bb1-4c3d-449b-887f-46bee7d66275","Type":"ContainerDied","Data":"e12135201ae8a6d5f5233460079d3da876278f9bf27d4c91140c218715e0c125"} Aug 02 10:03:48.386262 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:48.386075 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e12135201ae8a6d5f5233460079d3da876278f9bf27d4c91140c218715e0c125" Aug 02 10:03:50.896474 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:50.896400 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q"] Aug 02 10:03:50.899165 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:50.899143 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-973f165e-nl74q"] Aug 02 10:03:51.956264 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:03:51.956230 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12f71bb1-4c3d-449b-887f-46bee7d66275" path="/var/lib/kubelet/pods/12f71bb1-4c3d-449b-887f-46bee7d66275/volumes" Aug 02 10:04:19.965917 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:19.965837 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64"] Aug 02 10:04:19.966375 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:19.966254 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12f71bb1-4c3d-449b-887f-46bee7d66275" containerName="revoke-keys" Aug 02 10:04:19.966375 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:19.966268 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="12f71bb1-4c3d-449b-887f-46bee7d66275" containerName="revoke-keys" Aug 02 10:04:19.966375 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:19.966336 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="12f71bb1-4c3d-449b-887f-46bee7d66275" containerName="revoke-keys" Aug 02 10:04:19.969417 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:19.969397 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64" Aug 02 10:04:19.971907 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:19.971886 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7lxd\"" Aug 02 10:04:19.972042 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:19.971948 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 02 10:04:19.976660 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:19.976634 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64"] Aug 02 10:04:20.045848 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:20.045799 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5779bf50-1eb1-4341-8326-d8365f0e3a75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64\" (UID: \"5779bf50-1eb1-4341-8326-d8365f0e3a75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64" Aug 02 10:04:20.147177 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:20.147138 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5779bf50-1eb1-4341-8326-d8365f0e3a75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64\" (UID: \"5779bf50-1eb1-4341-8326-d8365f0e3a75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64" Aug 02 10:04:20.147856 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:20.147835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5779bf50-1eb1-4341-8326-d8365f0e3a75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64\" (UID: \"5779bf50-1eb1-4341-8326-d8365f0e3a75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64" Aug 02 10:04:20.281628 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:20.281549 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64" Aug 02 10:04:20.418487 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:20.418454 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64"] Aug 02 10:04:20.420577 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:04:20.420545 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5779bf50_1eb1_4341_8326_d8365f0e3a75.slice/crio-45efe49ef46464dd87f02b350a7ea78b36b5f93ab128240b51fe7178bd476594 WatchSource:0}: Error finding container 45efe49ef46464dd87f02b350a7ea78b36b5f93ab128240b51fe7178bd476594: Status 404 returned error can't find the container with id 45efe49ef46464dd87f02b350a7ea78b36b5f93ab128240b51fe7178bd476594 Aug 02 10:04:20.577674 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:20.577642 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64" event={"ID":"5779bf50-1eb1-4341-8326-d8365f0e3a75","Type":"ContainerStarted","Data":"45efe49ef46464dd87f02b350a7ea78b36b5f93ab128240b51fe7178bd476594"} Aug 02 10:04:21.584763 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:21.584731 2575 generic.go:356] "Generic (PLEG): container finished" podID="5779bf50-1eb1-4341-8326-d8365f0e3a75" containerID="466cd56c182b4df0e28426378e41351cc7e670d872cec77aa75cd3f76de86556" exitCode=0 Aug 02 10:04:21.585172 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:21.584815 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64" event={"ID":"5779bf50-1eb1-4341-8326-d8365f0e3a75","Type":"ContainerDied","Data":"466cd56c182b4df0e28426378e41351cc7e670d872cec77aa75cd3f76de86556"} Aug 02 10:04:22.729249 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:22.729225 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64" Aug 02 10:04:22.770495 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:22.770463 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5779bf50-1eb1-4341-8326-d8365f0e3a75-maas-api-service-ca\") pod \"5779bf50-1eb1-4341-8326-d8365f0e3a75\" (UID: \"5779bf50-1eb1-4341-8326-d8365f0e3a75\") " Aug 02 10:04:22.770897 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:22.770871 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5779bf50-1eb1-4341-8326-d8365f0e3a75-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5779bf50-1eb1-4341-8326-d8365f0e3a75" (UID: "5779bf50-1eb1-4341-8326-d8365f0e3a75"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:04:22.871448 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:22.871366 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5779bf50-1eb1-4341-8326-d8365f0e3a75-maas-api-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:04:23.597707 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:23.597674 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64" event={"ID":"5779bf50-1eb1-4341-8326-d8365f0e3a75","Type":"ContainerDied","Data":"45efe49ef46464dd87f02b350a7ea78b36b5f93ab128240b51fe7178bd476594"} Aug 02 10:04:23.597707 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:23.597692 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64" Aug 02 10:04:23.597952 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:23.597723 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45efe49ef46464dd87f02b350a7ea78b36b5f93ab128240b51fe7178bd476594" Aug 02 10:04:26.825398 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:26.825357 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64"] Aug 02 10:04:26.827646 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:26.827614 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4ad08e62-pfb64"] Aug 02 10:04:27.957628 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:04:27.957594 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5779bf50-1eb1-4341-8326-d8365f0e3a75" path="/var/lib/kubelet/pods/5779bf50-1eb1-4341-8326-d8365f0e3a75/volumes" Aug 02 10:07:00.588022 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:00.587985 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542"] Aug 02 10:07:00.588463 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:00.588369 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5779bf50-1eb1-4341-8326-d8365f0e3a75" containerName="revoke-keys" Aug 02 10:07:00.588463 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:00.588381 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5779bf50-1eb1-4341-8326-d8365f0e3a75" containerName="revoke-keys" Aug 02 10:07:00.588463 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:00.588456 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5779bf50-1eb1-4341-8326-d8365f0e3a75" containerName="revoke-keys" Aug 02 10:07:00.591668 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:00.591651 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542" Aug 02 10:07:00.593913 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:00.593887 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 02 10:07:00.594045 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:00.593889 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7lxd\"" Aug 02 10:07:00.598289 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:00.598267 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542"] Aug 02 10:07:00.728110 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:00.728074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-756eaa56-tb542\" (UID: \"88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542" Aug 02 10:07:00.828745 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:00.828702 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-756eaa56-tb542\" (UID: \"88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542" Aug 02 10:07:00.829361 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:00.829341 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-756eaa56-tb542\" (UID: \"88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542" Aug 02 10:07:00.903401 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:00.903320 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542" Aug 02 10:07:01.043873 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:01.043839 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542"] Aug 02 10:07:01.044912 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:07:01.044883 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ffd757_8fe8_4ace_a37f_7e9a2b2ac44d.slice/crio-278967f1a21e84301b0f96700d1dc586eced19f8ea7be4f8ae4f38125ae108fc WatchSource:0}: Error finding container 278967f1a21e84301b0f96700d1dc586eced19f8ea7be4f8ae4f38125ae108fc: Status 404 returned error can't find the container with id 278967f1a21e84301b0f96700d1dc586eced19f8ea7be4f8ae4f38125ae108fc Aug 02 10:07:01.523172 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:01.523069 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542" event={"ID":"88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d","Type":"ContainerStarted","Data":"5fbb25ffa78d78b3edbe7e2f5196ecd60daf3fd31db7e5d3c7454adbf3ebe821"} Aug 02 10:07:01.523172 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:01.523137 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542" event={"ID":"88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d","Type":"ContainerStarted","Data":"278967f1a21e84301b0f96700d1dc586eced19f8ea7be4f8ae4f38125ae108fc"} Aug 02 10:07:01.540953 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:01.540895 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542" podStartSLOduration=1.540879738 podStartE2EDuration="1.540879738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:07:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:07:01.538668312 +0000 UTC m=+2058.099823633" watchObservedRunningTime="2026-08-02 10:07:01.540879738 +0000 UTC m=+2058.102035058" Aug 02 10:07:02.530058 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:02.530021 2575 generic.go:356] "Generic (PLEG): container finished" podID="88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d" containerID="5fbb25ffa78d78b3edbe7e2f5196ecd60daf3fd31db7e5d3c7454adbf3ebe821" exitCode=0 Aug 02 10:07:02.530519 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:02.530106 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542" event={"ID":"88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d","Type":"ContainerDied","Data":"5fbb25ffa78d78b3edbe7e2f5196ecd60daf3fd31db7e5d3c7454adbf3ebe821"} Aug 02 10:07:03.681033 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:03.681005 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542" Aug 02 10:07:03.755573 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:03.755531 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d-maas-api-service-ca\") pod \"88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d\" (UID: \"88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d\") " Aug 02 10:07:03.755972 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:03.755950 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d" (UID: "88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:07:03.857236 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:03.857197 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d-maas-api-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:07:04.545415 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:04.545387 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542" Aug 02 10:07:04.545631 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:04.545422 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542" event={"ID":"88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d","Type":"ContainerDied","Data":"278967f1a21e84301b0f96700d1dc586eced19f8ea7be4f8ae4f38125ae108fc"} Aug 02 10:07:04.545631 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:04.545490 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="278967f1a21e84301b0f96700d1dc586eced19f8ea7be4f8ae4f38125ae108fc" Aug 02 10:07:11.256174 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:11.256123 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542"] Aug 02 10:07:11.258674 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:11.258653 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-756eaa56-tb542"] Aug 02 10:07:11.956769 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:11.956737 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d" path="/var/lib/kubelet/pods/88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d/volumes" Aug 02 10:07:44.107114 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:44.107087 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:07:44.110394 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:44.110369 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:07:44.114297 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:44.114276 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:07:44.117416 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:44.117396 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:07:58.280714 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.280668 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch"] Aug 02 10:07:58.281153 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.280952 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" podUID="bc66086d-1cb1-4f3a-bffd-bc520f0abc07" containerName="manager" containerID="cri-o://1095833d18bf17564bc18999a8851aec913c2c303e2f04774d34af384feb0753" gracePeriod=10 Aug 02 10:07:58.545409 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.545383 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" Aug 02 10:07:58.670857 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.670814 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2hh9\" (UniqueName: \"kubernetes.io/projected/bc66086d-1cb1-4f3a-bffd-bc520f0abc07-kube-api-access-v2hh9\") pod \"bc66086d-1cb1-4f3a-bffd-bc520f0abc07\" (UID: \"bc66086d-1cb1-4f3a-bffd-bc520f0abc07\") " Aug 02 10:07:58.671059 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.670955 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc66086d-1cb1-4f3a-bffd-bc520f0abc07-extensions-socket-volume\") pod \"bc66086d-1cb1-4f3a-bffd-bc520f0abc07\" (UID: \"bc66086d-1cb1-4f3a-bffd-bc520f0abc07\") " Aug 02 10:07:58.671322 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.671296 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc66086d-1cb1-4f3a-bffd-bc520f0abc07-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bc66086d-1cb1-4f3a-bffd-bc520f0abc07" (UID: "bc66086d-1cb1-4f3a-bffd-bc520f0abc07"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:07:58.673212 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.673179 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc66086d-1cb1-4f3a-bffd-bc520f0abc07-kube-api-access-v2hh9" (OuterVolumeSpecName: "kube-api-access-v2hh9") pod "bc66086d-1cb1-4f3a-bffd-bc520f0abc07" (UID: "bc66086d-1cb1-4f3a-bffd-bc520f0abc07"). InnerVolumeSpecName "kube-api-access-v2hh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:07:58.772623 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.772578 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc66086d-1cb1-4f3a-bffd-bc520f0abc07-extensions-socket-volume\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:07:58.772623 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.772616 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2hh9\" (UniqueName: \"kubernetes.io/projected/bc66086d-1cb1-4f3a-bffd-bc520f0abc07-kube-api-access-v2hh9\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:07:58.874021 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.873915 2575 generic.go:356] "Generic (PLEG): container finished" podID="bc66086d-1cb1-4f3a-bffd-bc520f0abc07" containerID="1095833d18bf17564bc18999a8851aec913c2c303e2f04774d34af384feb0753" exitCode=0 Aug 02 10:07:58.874021 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.873961 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" Aug 02 10:07:58.874021 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.874002 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" event={"ID":"bc66086d-1cb1-4f3a-bffd-bc520f0abc07","Type":"ContainerDied","Data":"1095833d18bf17564bc18999a8851aec913c2c303e2f04774d34af384feb0753"} Aug 02 10:07:58.874303 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.874059 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch" event={"ID":"bc66086d-1cb1-4f3a-bffd-bc520f0abc07","Type":"ContainerDied","Data":"244693e276cf813e9b331cd8668b44d0ff6d215e7fdb9ebff6a6fe8af413c135"} Aug 02 10:07:58.874303 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.874088 2575 scope.go:117] "RemoveContainer" containerID="1095833d18bf17564bc18999a8851aec913c2c303e2f04774d34af384feb0753" Aug 02 10:07:58.885084 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.885068 2575 scope.go:117] "RemoveContainer" containerID="1095833d18bf17564bc18999a8851aec913c2c303e2f04774d34af384feb0753" Aug 02 10:07:58.885343 ip-10-0-142-118 kubenswrapper[2575]: E0802 10:07:58.885323 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1095833d18bf17564bc18999a8851aec913c2c303e2f04774d34af384feb0753\": container with ID starting with 1095833d18bf17564bc18999a8851aec913c2c303e2f04774d34af384feb0753 not found: ID does not exist" containerID="1095833d18bf17564bc18999a8851aec913c2c303e2f04774d34af384feb0753" Aug 02 10:07:58.885385 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.885354 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1095833d18bf17564bc18999a8851aec913c2c303e2f04774d34af384feb0753"} err="failed to get container status \"1095833d18bf17564bc18999a8851aec913c2c303e2f04774d34af384feb0753\": rpc error: code = NotFound desc = could not find container \"1095833d18bf17564bc18999a8851aec913c2c303e2f04774d34af384feb0753\": container with ID starting with 1095833d18bf17564bc18999a8851aec913c2c303e2f04774d34af384feb0753 not found: ID does not exist" Aug 02 10:07:58.896440 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.896388 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch"] Aug 02 10:07:58.899172 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:58.899149 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-hmpch"] Aug 02 10:07:59.956937 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:07:59.956899 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc66086d-1cb1-4f3a-bffd-bc520f0abc07" path="/var/lib/kubelet/pods/bc66086d-1cb1-4f3a-bffd-bc520f0abc07/volumes" Aug 02 10:09:13.941516 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:13.941475 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d"] Aug 02 10:09:13.942071 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:13.941977 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc66086d-1cb1-4f3a-bffd-bc520f0abc07" containerName="manager" Aug 02 10:09:13.942071 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:13.941991 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc66086d-1cb1-4f3a-bffd-bc520f0abc07" containerName="manager" Aug 02 10:09:13.942071 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:13.942001 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d" containerName="revoke-keys" Aug 02 10:09:13.942071 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:13.942006 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d" containerName="revoke-keys" Aug 02 10:09:13.942071 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:13.942072 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="88ffd757-8fe8-4ace-a37f-7e9a2b2ac44d" containerName="revoke-keys" Aug 02 10:09:13.942245 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:13.942082 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc66086d-1cb1-4f3a-bffd-bc520f0abc07" containerName="manager" Aug 02 10:09:13.945097 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:13.945081 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d" Aug 02 10:09:13.947295 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:13.947271 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sd755\"" Aug 02 10:09:13.958064 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:13.958043 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d"] Aug 02 10:09:14.070837 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:14.070796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmjxl\" (UniqueName: \"kubernetes.io/projected/a4c12eba-d002-44a4-87de-5d0b5dcb5b96-kube-api-access-wmjxl\") pod \"kuadrant-operator-controller-manager-68cf589589-49m4d\" (UID: \"a4c12eba-d002-44a4-87de-5d0b5dcb5b96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d" Aug 02 10:09:14.071033 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:14.070901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4c12eba-d002-44a4-87de-5d0b5dcb5b96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-49m4d\" (UID: \"a4c12eba-d002-44a4-87de-5d0b5dcb5b96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d" Aug 02 10:09:14.171817 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:14.171752 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmjxl\" (UniqueName: \"kubernetes.io/projected/a4c12eba-d002-44a4-87de-5d0b5dcb5b96-kube-api-access-wmjxl\") pod \"kuadrant-operator-controller-manager-68cf589589-49m4d\" (UID: \"a4c12eba-d002-44a4-87de-5d0b5dcb5b96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d" Aug 02 10:09:14.172008 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:14.171865 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4c12eba-d002-44a4-87de-5d0b5dcb5b96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-49m4d\" (UID: \"a4c12eba-d002-44a4-87de-5d0b5dcb5b96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d" Aug 02 10:09:14.172270 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:14.172248 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4c12eba-d002-44a4-87de-5d0b5dcb5b96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-49m4d\" (UID: \"a4c12eba-d002-44a4-87de-5d0b5dcb5b96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d" Aug 02 10:09:14.179999 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:14.179973 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmjxl\" (UniqueName: \"kubernetes.io/projected/a4c12eba-d002-44a4-87de-5d0b5dcb5b96-kube-api-access-wmjxl\") pod \"kuadrant-operator-controller-manager-68cf589589-49m4d\" (UID: \"a4c12eba-d002-44a4-87de-5d0b5dcb5b96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d" Aug 02 10:09:14.256619 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:14.256524 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d" Aug 02 10:09:14.401938 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:14.401910 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d"] Aug 02 10:09:14.403370 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:09:14.403333 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c12eba_d002_44a4_87de_5d0b5dcb5b96.slice/crio-1a49fb7cab07ef94bad857f35da51153ad833ba993a1de65d7ca60cee619e730 WatchSource:0}: Error finding container 1a49fb7cab07ef94bad857f35da51153ad833ba993a1de65d7ca60cee619e730: Status 404 returned error can't find the container with id 1a49fb7cab07ef94bad857f35da51153ad833ba993a1de65d7ca60cee619e730 Aug 02 10:09:15.311396 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:15.311362 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d" event={"ID":"a4c12eba-d002-44a4-87de-5d0b5dcb5b96","Type":"ContainerStarted","Data":"a7deaaf1f67eba4812cd0f5edc4a612feb871e6338c7b7c2bf19cdf782f52351"} Aug 02 10:09:15.311886 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:15.311420 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d" Aug 02 10:09:15.311886 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:15.311436 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d" event={"ID":"a4c12eba-d002-44a4-87de-5d0b5dcb5b96","Type":"ContainerStarted","Data":"1a49fb7cab07ef94bad857f35da51153ad833ba993a1de65d7ca60cee619e730"} Aug 02 10:09:15.334630 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:15.334576 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d" podStartSLOduration=2.334557754 podStartE2EDuration="2.334557754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:09:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:09:15.331158398 +0000 UTC m=+2191.892313719" watchObservedRunningTime="2026-08-02 10:09:15.334557754 +0000 UTC m=+2191.895713073" Aug 02 10:09:26.319922 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:26.319893 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-49m4d" Aug 02 10:09:44.230461 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:09:44.230427 2575 scope.go:117] "RemoveContainer" containerID="94a33eec0d865a3da1e6fb4c7741b7a3e99010e4107d08bd42ecf7e5afa82559" Aug 02 10:10:44.254567 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:10:44.254535 2575 scope.go:117] "RemoveContainer" containerID="b5b85eba3465265986e6e11bca773c72e70a0df8eedcb11cb73af83d15aa4277" Aug 02 10:10:44.263674 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:10:44.263652 2575 scope.go:117] "RemoveContainer" containerID="466cd56c182b4df0e28426378e41351cc7e670d872cec77aa75cd3f76de86556" Aug 02 10:12:44.151870 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:12:44.151831 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:12:44.155014 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:12:44.154993 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:12:44.164413 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:12:44.164392 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:12:44.167409 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:12:44.167390 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:13:44.306411 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:44.306379 2575 scope.go:117] "RemoveContainer" containerID="5fbb25ffa78d78b3edbe7e2f5196ecd60daf3fd31db7e5d3c7454adbf3ebe821" Aug 02 10:13:48.995721 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:48.995675 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh"] Aug 02 10:13:49.000718 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:49.000689 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh" Aug 02 10:13:49.003198 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:49.003173 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 02 10:13:49.003342 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:49.003197 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7lxd\"" Aug 02 10:13:49.015135 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:49.015109 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh"] Aug 02 10:13:49.096337 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:49.096295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3415d6c6-8946-4a3d-afb3-349777ac0cb5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh\" (UID: \"3415d6c6-8946-4a3d-afb3-349777ac0cb5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh" Aug 02 10:13:49.197209 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:49.197171 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3415d6c6-8946-4a3d-afb3-349777ac0cb5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh\" (UID: \"3415d6c6-8946-4a3d-afb3-349777ac0cb5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh" Aug 02 10:13:49.197856 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:49.197835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3415d6c6-8946-4a3d-afb3-349777ac0cb5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh\" (UID: \"3415d6c6-8946-4a3d-afb3-349777ac0cb5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh" Aug 02 10:13:49.310557 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:49.310526 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh" Aug 02 10:13:49.453432 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:49.453396 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh"] Aug 02 10:13:49.454932 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:13:49.454903 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3415d6c6_8946_4a3d_afb3_349777ac0cb5.slice/crio-e81bf25e96ff33ca2f65db6e22df6bb89c53f96900fefc440493fb48196a9da2 WatchSource:0}: Error finding container e81bf25e96ff33ca2f65db6e22df6bb89c53f96900fefc440493fb48196a9da2: Status 404 returned error can't find the container with id e81bf25e96ff33ca2f65db6e22df6bb89c53f96900fefc440493fb48196a9da2 Aug 02 10:13:49.911633 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:49.911547 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh" event={"ID":"3415d6c6-8946-4a3d-afb3-349777ac0cb5","Type":"ContainerStarted","Data":"7af0c8eeaffcb6548e3aa2d0124ad4bbeed37aeb64965e4df69dc9337a5f0f35"} Aug 02 10:13:49.911633 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:49.911605 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh" event={"ID":"3415d6c6-8946-4a3d-afb3-349777ac0cb5","Type":"ContainerStarted","Data":"e81bf25e96ff33ca2f65db6e22df6bb89c53f96900fefc440493fb48196a9da2"} Aug 02 10:13:49.930096 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:49.930038 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh" podStartSLOduration=1.9300205400000001 podStartE2EDuration="1.93002054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:13:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:13:49.927311917 +0000 UTC m=+2466.488467239" watchObservedRunningTime="2026-08-02 10:13:49.93002054 +0000 UTC m=+2466.491175859" Aug 02 10:13:50.919249 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:50.919211 2575 generic.go:356] "Generic (PLEG): container finished" podID="3415d6c6-8946-4a3d-afb3-349777ac0cb5" containerID="7af0c8eeaffcb6548e3aa2d0124ad4bbeed37aeb64965e4df69dc9337a5f0f35" exitCode=0 Aug 02 10:13:50.919674 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:50.919292 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh" event={"ID":"3415d6c6-8946-4a3d-afb3-349777ac0cb5","Type":"ContainerDied","Data":"7af0c8eeaffcb6548e3aa2d0124ad4bbeed37aeb64965e4df69dc9337a5f0f35"} Aug 02 10:13:52.070140 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:52.070111 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh" Aug 02 10:13:52.124580 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:52.124547 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3415d6c6-8946-4a3d-afb3-349777ac0cb5-maas-api-service-ca\") pod \"3415d6c6-8946-4a3d-afb3-349777ac0cb5\" (UID: \"3415d6c6-8946-4a3d-afb3-349777ac0cb5\") " Aug 02 10:13:52.125009 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:52.124987 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3415d6c6-8946-4a3d-afb3-349777ac0cb5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3415d6c6-8946-4a3d-afb3-349777ac0cb5" (UID: "3415d6c6-8946-4a3d-afb3-349777ac0cb5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:13:52.226197 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:52.226110 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3415d6c6-8946-4a3d-afb3-349777ac0cb5-maas-api-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:13:52.931752 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:52.931718 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh" Aug 02 10:13:52.931956 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:52.931753 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh" event={"ID":"3415d6c6-8946-4a3d-afb3-349777ac0cb5","Type":"ContainerDied","Data":"e81bf25e96ff33ca2f65db6e22df6bb89c53f96900fefc440493fb48196a9da2"} Aug 02 10:13:52.931956 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:13:52.931825 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e81bf25e96ff33ca2f65db6e22df6bb89c53f96900fefc440493fb48196a9da2" Aug 02 10:14:04.721118 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:14:04.721082 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh"] Aug 02 10:14:04.723457 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:14:04.723434 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7e5ef7e7-scgmh"] Aug 02 10:14:05.956852 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:14:05.956810 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3415d6c6-8946-4a3d-afb3-349777ac0cb5" path="/var/lib/kubelet/pods/3415d6c6-8946-4a3d-afb3-349777ac0cb5/volumes" Aug 02 10:17:44.195349 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:17:44.195226 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:17:44.199506 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:17:44.199481 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:17:44.207655 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:17:44.207634 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:17:44.213708 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:17:44.213688 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:18:56.951787 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:56.951746 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h"] Aug 02 10:18:56.952293 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:56.952170 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3415d6c6-8946-4a3d-afb3-349777ac0cb5" containerName="revoke-keys" Aug 02 10:18:56.952293 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:56.952183 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3415d6c6-8946-4a3d-afb3-349777ac0cb5" containerName="revoke-keys" Aug 02 10:18:56.952293 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:56.952265 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3415d6c6-8946-4a3d-afb3-349777ac0cb5" containerName="revoke-keys" Aug 02 10:18:56.955365 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:56.955349 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h" Aug 02 10:18:56.957654 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:56.957633 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7lxd\"" Aug 02 10:18:56.957771 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:56.957652 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 02 10:18:56.965587 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:56.965563 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h"] Aug 02 10:18:57.083291 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:57.083253 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9199402c-19fd-4d1d-9ccd-252fa54ff978-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h\" (UID: \"9199402c-19fd-4d1d-9ccd-252fa54ff978\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h" Aug 02 10:18:57.184753 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:57.184712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9199402c-19fd-4d1d-9ccd-252fa54ff978-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h\" (UID: \"9199402c-19fd-4d1d-9ccd-252fa54ff978\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h" Aug 02 10:18:57.185405 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:57.185379 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9199402c-19fd-4d1d-9ccd-252fa54ff978-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h\" (UID: \"9199402c-19fd-4d1d-9ccd-252fa54ff978\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h" Aug 02 10:18:57.267623 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:57.267534 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h" Aug 02 10:18:57.418315 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:57.418282 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h"] Aug 02 10:18:57.420070 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:18:57.420045 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9199402c_19fd_4d1d_9ccd_252fa54ff978.slice/crio-f726b5feeb6fcdfd4fcbc7ea5fc50d40b30045cc27ad7e0a11f5a86780723e92 WatchSource:0}: Error finding container f726b5feeb6fcdfd4fcbc7ea5fc50d40b30045cc27ad7e0a11f5a86780723e92: Status 404 returned error can't find the container with id f726b5feeb6fcdfd4fcbc7ea5fc50d40b30045cc27ad7e0a11f5a86780723e92 Aug 02 10:18:57.698336 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:57.698298 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h" event={"ID":"9199402c-19fd-4d1d-9ccd-252fa54ff978","Type":"ContainerStarted","Data":"f726b5feeb6fcdfd4fcbc7ea5fc50d40b30045cc27ad7e0a11f5a86780723e92"} Aug 02 10:18:58.706127 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:58.706089 2575 generic.go:356] "Generic (PLEG): container finished" podID="9199402c-19fd-4d1d-9ccd-252fa54ff978" containerID="e86f9d994db3ac469bd9d3ed0f1f4ce8ca5e388121dd1c8eb6c3f24ceca9382a" exitCode=0 Aug 02 10:18:58.706573 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:58.706178 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h" event={"ID":"9199402c-19fd-4d1d-9ccd-252fa54ff978","Type":"ContainerDied","Data":"e86f9d994db3ac469bd9d3ed0f1f4ce8ca5e388121dd1c8eb6c3f24ceca9382a"} Aug 02 10:18:59.862376 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:18:59.862345 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h" Aug 02 10:19:00.011046 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:00.010965 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9199402c-19fd-4d1d-9ccd-252fa54ff978-maas-api-service-ca\") pod \"9199402c-19fd-4d1d-9ccd-252fa54ff978\" (UID: \"9199402c-19fd-4d1d-9ccd-252fa54ff978\") " Aug 02 10:19:00.011336 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:00.011316 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9199402c-19fd-4d1d-9ccd-252fa54ff978-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9199402c-19fd-4d1d-9ccd-252fa54ff978" (UID: "9199402c-19fd-4d1d-9ccd-252fa54ff978"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:19:00.112654 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:00.112619 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9199402c-19fd-4d1d-9ccd-252fa54ff978-maas-api-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:19:00.721892 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:00.721859 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h" Aug 02 10:19:00.721892 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:00.721884 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h" event={"ID":"9199402c-19fd-4d1d-9ccd-252fa54ff978","Type":"ContainerDied","Data":"f726b5feeb6fcdfd4fcbc7ea5fc50d40b30045cc27ad7e0a11f5a86780723e92"} Aug 02 10:19:00.722143 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:00.721979 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f726b5feeb6fcdfd4fcbc7ea5fc50d40b30045cc27ad7e0a11f5a86780723e92" Aug 02 10:19:01.999766 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:01.999729 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h"] Aug 02 10:19:02.011241 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:02.011209 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e3a61d-cs69h"] Aug 02 10:19:03.958530 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:03.958494 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9199402c-19fd-4d1d-9ccd-252fa54ff978" path="/var/lib/kubelet/pods/9199402c-19fd-4d1d-9ccd-252fa54ff978/volumes" Aug 02 10:19:13.913982 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:13.913897 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv"] Aug 02 10:19:13.914351 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:13.914313 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9199402c-19fd-4d1d-9ccd-252fa54ff978" containerName="revoke-keys" Aug 02 10:19:13.914351 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:13.914324 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9199402c-19fd-4d1d-9ccd-252fa54ff978" containerName="revoke-keys" Aug 02 10:19:13.914432 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:13.914397 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9199402c-19fd-4d1d-9ccd-252fa54ff978" containerName="revoke-keys" Aug 02 10:19:13.918729 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:13.918709 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv" Aug 02 10:19:13.921154 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:13.921133 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 02 10:19:13.921282 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:13.921261 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7lxd\"" Aug 02 10:19:13.927229 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:13.926612 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv"] Aug 02 10:19:14.040869 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:14.040834 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c15b72-47a2-4a69-be39-5dc153dea24e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv\" (UID: \"67c15b72-47a2-4a69-be39-5dc153dea24e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv" Aug 02 10:19:14.142381 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:14.142343 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c15b72-47a2-4a69-be39-5dc153dea24e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv\" (UID: \"67c15b72-47a2-4a69-be39-5dc153dea24e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv" Aug 02 10:19:14.143029 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:14.143010 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c15b72-47a2-4a69-be39-5dc153dea24e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv\" (UID: \"67c15b72-47a2-4a69-be39-5dc153dea24e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv" Aug 02 10:19:14.232217 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:14.232130 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv" Aug 02 10:19:14.387955 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:19:14.387916 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c15b72_47a2_4a69_be39_5dc153dea24e.slice/crio-1461743cde4888b588c75cbc4b79ca237c2c4271b59cd753633bb0fdf878a548 WatchSource:0}: Error finding container 1461743cde4888b588c75cbc4b79ca237c2c4271b59cd753633bb0fdf878a548: Status 404 returned error can't find the container with id 1461743cde4888b588c75cbc4b79ca237c2c4271b59cd753633bb0fdf878a548 Aug 02 10:19:14.388509 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:14.388484 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv"] Aug 02 10:19:14.811418 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:14.811325 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv" event={"ID":"67c15b72-47a2-4a69-be39-5dc153dea24e","Type":"ContainerStarted","Data":"02a0f03478f8a1376697e3229740f59ffc07462d3ea6a4a34eac9f0012311f7c"} Aug 02 10:19:14.811418 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:14.811385 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv" event={"ID":"67c15b72-47a2-4a69-be39-5dc153dea24e","Type":"ContainerStarted","Data":"1461743cde4888b588c75cbc4b79ca237c2c4271b59cd753633bb0fdf878a548"} Aug 02 10:19:14.833166 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:14.833104 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv" podStartSLOduration=1.833088461 podStartE2EDuration="1.833088461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:19:14.830338756 +0000 UTC m=+2791.391494073" watchObservedRunningTime="2026-08-02 10:19:14.833088461 +0000 UTC m=+2791.394243780" Aug 02 10:19:15.818531 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:15.818497 2575 generic.go:356] "Generic (PLEG): container finished" podID="67c15b72-47a2-4a69-be39-5dc153dea24e" containerID="02a0f03478f8a1376697e3229740f59ffc07462d3ea6a4a34eac9f0012311f7c" exitCode=0 Aug 02 10:19:15.818996 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:15.818575 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv" event={"ID":"67c15b72-47a2-4a69-be39-5dc153dea24e","Type":"ContainerDied","Data":"02a0f03478f8a1376697e3229740f59ffc07462d3ea6a4a34eac9f0012311f7c"} Aug 02 10:19:16.965755 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:16.965731 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv" Aug 02 10:19:17.072894 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:17.072855 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c15b72-47a2-4a69-be39-5dc153dea24e-maas-api-service-ca\") pod \"67c15b72-47a2-4a69-be39-5dc153dea24e\" (UID: \"67c15b72-47a2-4a69-be39-5dc153dea24e\") " Aug 02 10:19:17.073269 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:17.073248 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67c15b72-47a2-4a69-be39-5dc153dea24e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "67c15b72-47a2-4a69-be39-5dc153dea24e" (UID: "67c15b72-47a2-4a69-be39-5dc153dea24e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:19:17.174191 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:17.174087 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c15b72-47a2-4a69-be39-5dc153dea24e-maas-api-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:19:17.832233 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:17.832201 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv" Aug 02 10:19:17.832403 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:17.832243 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv" event={"ID":"67c15b72-47a2-4a69-be39-5dc153dea24e","Type":"ContainerDied","Data":"1461743cde4888b588c75cbc4b79ca237c2c4271b59cd753633bb0fdf878a548"} Aug 02 10:19:17.832403 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:17.832330 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1461743cde4888b588c75cbc4b79ca237c2c4271b59cd753633bb0fdf878a548" Aug 02 10:19:24.549060 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:24.549019 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv"] Aug 02 10:19:24.552357 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:24.552327 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c8adc-w98zv"] Aug 02 10:19:25.957495 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:19:25.957458 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67c15b72-47a2-4a69-be39-5dc153dea24e" path="/var/lib/kubelet/pods/67c15b72-47a2-4a69-be39-5dc153dea24e/volumes" Aug 02 10:20:32.531352 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:32.531312 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97"] Aug 02 10:20:32.532009 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:32.531983 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67c15b72-47a2-4a69-be39-5dc153dea24e" containerName="revoke-keys" Aug 02 10:20:32.532009 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:32.532006 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="67c15b72-47a2-4a69-be39-5dc153dea24e" containerName="revoke-keys" Aug 02 10:20:32.532142 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:32.532115 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="67c15b72-47a2-4a69-be39-5dc153dea24e" containerName="revoke-keys" Aug 02 10:20:32.535307 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:32.535284 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97" Aug 02 10:20:32.538110 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:32.538077 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 02 10:20:32.538228 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:32.538140 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7lxd\"" Aug 02 10:20:32.547444 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:32.547408 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97"] Aug 02 10:20:32.668002 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:32.667953 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9773d508-be44-4dd3-a7c9-a27c69f86e6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-931e8a-hfc97\" (UID: \"9773d508-be44-4dd3-a7c9-a27c69f86e6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97" Aug 02 10:20:32.769201 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:32.769162 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9773d508-be44-4dd3-a7c9-a27c69f86e6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-931e8a-hfc97\" (UID: \"9773d508-be44-4dd3-a7c9-a27c69f86e6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97" Aug 02 10:20:32.769889 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:32.769869 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9773d508-be44-4dd3-a7c9-a27c69f86e6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-931e8a-hfc97\" (UID: \"9773d508-be44-4dd3-a7c9-a27c69f86e6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97" Aug 02 10:20:32.848540 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:32.848503 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97" Aug 02 10:20:32.992723 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:20:32.992687 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9773d508_be44_4dd3_a7c9_a27c69f86e6d.slice/crio-fc99ad552a30c96686b54f69f2e90e04b5b6099d1ed196d1186194ad340af3ad WatchSource:0}: Error finding container fc99ad552a30c96686b54f69f2e90e04b5b6099d1ed196d1186194ad340af3ad: Status 404 returned error can't find the container with id fc99ad552a30c96686b54f69f2e90e04b5b6099d1ed196d1186194ad340af3ad Aug 02 10:20:32.993184 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:32.993162 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97"] Aug 02 10:20:33.276720 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:33.276684 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97" event={"ID":"9773d508-be44-4dd3-a7c9-a27c69f86e6d","Type":"ContainerStarted","Data":"fedffecb80f62f338af11fa29e83eab4e5539314b37f10cde62ba760fa502ae6"} Aug 02 10:20:33.276895 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:33.276738 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97" event={"ID":"9773d508-be44-4dd3-a7c9-a27c69f86e6d","Type":"ContainerStarted","Data":"fc99ad552a30c96686b54f69f2e90e04b5b6099d1ed196d1186194ad340af3ad"} Aug 02 10:20:33.301810 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:33.301740 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97" podStartSLOduration=1.301724628 podStartE2EDuration="1.301724628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:20:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:20:33.299751 +0000 UTC m=+2869.860906312" watchObservedRunningTime="2026-08-02 10:20:33.301724628 +0000 UTC m=+2869.862879948" Aug 02 10:20:34.284618 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:34.284521 2575 generic.go:356] "Generic (PLEG): container finished" podID="9773d508-be44-4dd3-a7c9-a27c69f86e6d" containerID="fedffecb80f62f338af11fa29e83eab4e5539314b37f10cde62ba760fa502ae6" exitCode=0 Aug 02 10:20:34.284618 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:34.284561 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97" event={"ID":"9773d508-be44-4dd3-a7c9-a27c69f86e6d","Type":"ContainerDied","Data":"fedffecb80f62f338af11fa29e83eab4e5539314b37f10cde62ba760fa502ae6"} Aug 02 10:20:35.427072 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:35.427046 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97" Aug 02 10:20:35.594912 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:35.594800 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9773d508-be44-4dd3-a7c9-a27c69f86e6d-maas-api-service-ca\") pod \"9773d508-be44-4dd3-a7c9-a27c69f86e6d\" (UID: \"9773d508-be44-4dd3-a7c9-a27c69f86e6d\") " Aug 02 10:20:35.595165 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:35.595143 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9773d508-be44-4dd3-a7c9-a27c69f86e6d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9773d508-be44-4dd3-a7c9-a27c69f86e6d" (UID: "9773d508-be44-4dd3-a7c9-a27c69f86e6d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:20:35.696156 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:35.696116 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9773d508-be44-4dd3-a7c9-a27c69f86e6d-maas-api-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:20:36.296997 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:36.296969 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97" event={"ID":"9773d508-be44-4dd3-a7c9-a27c69f86e6d","Type":"ContainerDied","Data":"fc99ad552a30c96686b54f69f2e90e04b5b6099d1ed196d1186194ad340af3ad"} Aug 02 10:20:36.297142 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:36.297022 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc99ad552a30c96686b54f69f2e90e04b5b6099d1ed196d1186194ad340af3ad" Aug 02 10:20:36.297142 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:36.296976 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97" Aug 02 10:20:44.383769 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:44.383726 2575 scope.go:117] "RemoveContainer" containerID="7af0c8eeaffcb6548e3aa2d0124ad4bbeed37aeb64965e4df69dc9337a5f0f35" Aug 02 10:20:48.175007 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:48.174968 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97"] Aug 02 10:20:48.178348 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:48.178319 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-931e8a-hfc97"] Aug 02 10:20:49.957003 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:49.956971 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9773d508-be44-4dd3-a7c9-a27c69f86e6d" path="/var/lib/kubelet/pods/9773d508-be44-4dd3-a7c9-a27c69f86e6d/volumes" Aug 02 10:20:55.115992 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:55.115959 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl"] Aug 02 10:20:55.116400 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:55.116368 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9773d508-be44-4dd3-a7c9-a27c69f86e6d" containerName="revoke-keys" Aug 02 10:20:55.116400 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:55.116380 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9773d508-be44-4dd3-a7c9-a27c69f86e6d" containerName="revoke-keys" Aug 02 10:20:55.116490 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:55.116444 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9773d508-be44-4dd3-a7c9-a27c69f86e6d" containerName="revoke-keys" Aug 02 10:20:55.119533 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:55.119517 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl" Aug 02 10:20:55.123146 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:55.123125 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 02 10:20:55.123444 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:55.123427 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7lxd\"" Aug 02 10:20:55.139094 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:55.139069 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl"] Aug 02 10:20:55.168729 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:55.168690 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d559fcc1-f384-4997-a7ea-2a1aef976517-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2ea423-fnchl\" (UID: \"d559fcc1-f384-4997-a7ea-2a1aef976517\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl" Aug 02 10:20:55.270156 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:55.270117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d559fcc1-f384-4997-a7ea-2a1aef976517-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2ea423-fnchl\" (UID: \"d559fcc1-f384-4997-a7ea-2a1aef976517\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl" Aug 02 10:20:55.270759 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:55.270738 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d559fcc1-f384-4997-a7ea-2a1aef976517-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2ea423-fnchl\" (UID: \"d559fcc1-f384-4997-a7ea-2a1aef976517\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl" Aug 02 10:20:55.429958 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:55.429867 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl" Aug 02 10:20:55.587133 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:55.587099 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl"] Aug 02 10:20:55.588533 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:20:55.588505 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd559fcc1_f384_4997_a7ea_2a1aef976517.slice/crio-6cd65eac98a44578ce64a0c57324e2e5dd0da78b74ed2676d09b401a48416c0c WatchSource:0}: Error finding container 6cd65eac98a44578ce64a0c57324e2e5dd0da78b74ed2676d09b401a48416c0c: Status 404 returned error can't find the container with id 6cd65eac98a44578ce64a0c57324e2e5dd0da78b74ed2676d09b401a48416c0c Aug 02 10:20:56.416530 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:56.416493 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl" event={"ID":"d559fcc1-f384-4997-a7ea-2a1aef976517","Type":"ContainerStarted","Data":"0397295fbd80222238b8d643ce9e655f0ece824b0ec0f8bec02c6180e80955fe"} Aug 02 10:20:56.417082 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:56.416555 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl" event={"ID":"d559fcc1-f384-4997-a7ea-2a1aef976517","Type":"ContainerStarted","Data":"6cd65eac98a44578ce64a0c57324e2e5dd0da78b74ed2676d09b401a48416c0c"} Aug 02 10:20:56.434159 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:56.434098 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl" podStartSLOduration=1.434076557 podStartE2EDuration="1.434076557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:20:56.431297622 +0000 UTC m=+2892.992452943" watchObservedRunningTime="2026-08-02 10:20:56.434076557 +0000 UTC m=+2892.995231877" Aug 02 10:20:57.423885 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:57.423844 2575 generic.go:356] "Generic (PLEG): container finished" podID="d559fcc1-f384-4997-a7ea-2a1aef976517" containerID="0397295fbd80222238b8d643ce9e655f0ece824b0ec0f8bec02c6180e80955fe" exitCode=0 Aug 02 10:20:57.424295 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:57.423917 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl" event={"ID":"d559fcc1-f384-4997-a7ea-2a1aef976517","Type":"ContainerDied","Data":"0397295fbd80222238b8d643ce9e655f0ece824b0ec0f8bec02c6180e80955fe"} Aug 02 10:20:58.577244 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:58.577219 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl" Aug 02 10:20:58.703243 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:58.703153 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d559fcc1-f384-4997-a7ea-2a1aef976517-maas-api-service-ca\") pod \"d559fcc1-f384-4997-a7ea-2a1aef976517\" (UID: \"d559fcc1-f384-4997-a7ea-2a1aef976517\") " Aug 02 10:20:58.703551 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:58.703530 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d559fcc1-f384-4997-a7ea-2a1aef976517-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d559fcc1-f384-4997-a7ea-2a1aef976517" (UID: "d559fcc1-f384-4997-a7ea-2a1aef976517"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:20:58.804552 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:58.804516 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d559fcc1-f384-4997-a7ea-2a1aef976517-maas-api-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:20:59.436654 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:59.436619 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl" Aug 02 10:20:59.436654 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:59.436633 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl" event={"ID":"d559fcc1-f384-4997-a7ea-2a1aef976517","Type":"ContainerDied","Data":"6cd65eac98a44578ce64a0c57324e2e5dd0da78b74ed2676d09b401a48416c0c"} Aug 02 10:20:59.436948 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:20:59.436681 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cd65eac98a44578ce64a0c57324e2e5dd0da78b74ed2676d09b401a48416c0c" Aug 02 10:21:10.681262 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:21:10.681222 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl"] Aug 02 10:21:10.683633 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:21:10.683607 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2ea423-fnchl"] Aug 02 10:21:11.957435 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:21:11.957391 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d559fcc1-f384-4997-a7ea-2a1aef976517" path="/var/lib/kubelet/pods/d559fcc1-f384-4997-a7ea-2a1aef976517/volumes" Aug 02 10:22:44.235927 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:22:44.235815 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:22:44.242372 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:22:44.242349 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:22:44.254279 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:22:44.254253 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:22:44.257145 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:22:44.257126 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:25:44.444436 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:25:44.444400 2575 scope.go:117] "RemoveContainer" containerID="02a0f03478f8a1376697e3229740f59ffc07462d3ea6a4a34eac9f0012311f7c" Aug 02 10:25:44.453516 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:25:44.453492 2575 scope.go:117] "RemoveContainer" containerID="e86f9d994db3ac469bd9d3ed0f1f4ce8ca5e388121dd1c8eb6c3f24ceca9382a" Aug 02 10:26:44.478550 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:26:44.478470 2575 scope.go:117] "RemoveContainer" containerID="fedffecb80f62f338af11fa29e83eab4e5539314b37f10cde62ba760fa502ae6" Aug 02 10:27:44.277634 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:27:44.277531 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:27:44.280855 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:27:44.280807 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:27:44.293666 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:27:44.293645 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:27:44.296448 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:27:44.296427 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:27:44.501801 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:27:44.501733 2575 scope.go:117] "RemoveContainer" containerID="0397295fbd80222238b8d643ce9e655f0ece824b0ec0f8bec02c6180e80955fe" Aug 02 10:31:39.831535 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:39.831496 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140659742678576"] Aug 02 10:31:39.832093 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:39.831960 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d559fcc1-f384-4997-a7ea-2a1aef976517" containerName="revoke-keys" Aug 02 10:31:39.832093 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:39.831974 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d559fcc1-f384-4997-a7ea-2a1aef976517" containerName="revoke-keys" Aug 02 10:31:39.832093 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:39.832043 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d559fcc1-f384-4997-a7ea-2a1aef976517" containerName="revoke-keys" Aug 02 10:31:39.835079 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:39.835060 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742678576" Aug 02 10:31:39.838095 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:39.838073 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5xs5m\"" Aug 02 10:31:39.848531 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:39.848505 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140659742678576"] Aug 02 10:31:39.908767 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:39.908735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lghq9\" (UniqueName: \"kubernetes.io/projected/9159c660-bf5b-4536-8320-9dc704beac33-kube-api-access-lghq9\") pod \"test-curl-7576-140659742678576\" (UID: \"9159c660-bf5b-4536-8320-9dc704beac33\") " pod="opendatahub/test-curl-7576-140659742678576" Aug 02 10:31:40.009764 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:40.009728 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lghq9\" (UniqueName: \"kubernetes.io/projected/9159c660-bf5b-4536-8320-9dc704beac33-kube-api-access-lghq9\") pod \"test-curl-7576-140659742678576\" (UID: \"9159c660-bf5b-4536-8320-9dc704beac33\") " pod="opendatahub/test-curl-7576-140659742678576" Aug 02 10:31:40.019330 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:40.019304 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lghq9\" (UniqueName: \"kubernetes.io/projected/9159c660-bf5b-4536-8320-9dc704beac33-kube-api-access-lghq9\") pod \"test-curl-7576-140659742678576\" (UID: \"9159c660-bf5b-4536-8320-9dc704beac33\") " pod="opendatahub/test-curl-7576-140659742678576" Aug 02 10:31:40.144158 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:40.144072 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742678576" Aug 02 10:31:40.295177 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:40.295147 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140659742678576"] Aug 02 10:31:40.296446 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:31:40.296416 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9159c660_bf5b_4536_8320_9dc704beac33.slice/crio-cd4cc2b08940ca011397c2e11d07760a34e35f0f3c8973fdac651bb880ae119d WatchSource:0}: Error finding container cd4cc2b08940ca011397c2e11d07760a34e35f0f3c8973fdac651bb880ae119d: Status 404 returned error can't find the container with id cd4cc2b08940ca011397c2e11d07760a34e35f0f3c8973fdac651bb880ae119d Aug 02 10:31:40.297719 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:40.297697 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 02 10:31:41.216600 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:41.216567 2575 generic.go:356] "Generic (PLEG): container finished" podID="9159c660-bf5b-4536-8320-9dc704beac33" containerID="da33e00d7504322cc10211fef66ce33ef5b3f67dd9f64f7adfc37cf9fd0d3b1f" exitCode=0 Aug 02 10:31:41.217021 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:41.216613 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140659742678576" event={"ID":"9159c660-bf5b-4536-8320-9dc704beac33","Type":"ContainerDied","Data":"da33e00d7504322cc10211fef66ce33ef5b3f67dd9f64f7adfc37cf9fd0d3b1f"} Aug 02 10:31:41.217021 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:41.216646 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140659742678576" event={"ID":"9159c660-bf5b-4536-8320-9dc704beac33","Type":"ContainerStarted","Data":"cd4cc2b08940ca011397c2e11d07760a34e35f0f3c8973fdac651bb880ae119d"} Aug 02 10:31:42.366515 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.366486 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742678576" Aug 02 10:31:42.435833 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.435770 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lghq9\" (UniqueName: \"kubernetes.io/projected/9159c660-bf5b-4536-8320-9dc704beac33-kube-api-access-lghq9\") pod \"9159c660-bf5b-4536-8320-9dc704beac33\" (UID: \"9159c660-bf5b-4536-8320-9dc704beac33\") " Aug 02 10:31:42.437927 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.437866 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9159c660-bf5b-4536-8320-9dc704beac33-kube-api-access-lghq9" (OuterVolumeSpecName: "kube-api-access-lghq9") pod "9159c660-bf5b-4536-8320-9dc704beac33" (UID: "9159c660-bf5b-4536-8320-9dc704beac33"). InnerVolumeSpecName "kube-api-access-lghq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:31:42.477955 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.477859 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140659742678576_9159c660-bf5b-4536-8320-9dc704beac33/test-curl-7576-140659742678576/0.log" Aug 02 10:31:42.530290 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.530250 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140659742678576"] Aug 02 10:31:42.536981 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.536955 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lghq9\" (UniqueName: \"kubernetes.io/projected/9159c660-bf5b-4536-8320-9dc704beac33-kube-api-access-lghq9\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:31:42.544023 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.543992 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140659742678576"] Aug 02 10:31:42.702608 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.702571 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140659742678448"] Aug 02 10:31:42.703029 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.703014 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9159c660-bf5b-4536-8320-9dc704beac33" containerName="test-curl-7576-140659742678576" Aug 02 10:31:42.703096 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.703031 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9159c660-bf5b-4536-8320-9dc704beac33" containerName="test-curl-7576-140659742678576" Aug 02 10:31:42.703136 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.703102 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9159c660-bf5b-4536-8320-9dc704beac33" containerName="test-curl-7576-140659742678576" Aug 02 10:31:42.706182 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.706165 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742678448" Aug 02 10:31:42.710633 ip-10-0-142-118 kubenswrapper[2575]: E0802 10:31:42.710608 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7576-140659742678448\" is forbidden: User \"system:node:ip-10-0-142-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-118.ec2.internal' and this object" podUID="b148d94d-03fc-41ae-b3d1-0244f3d77551" pod="opendatahub/test-curl-7576-140659742678448" Aug 02 10:31:42.739961 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.739876 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140659742678448"] Aug 02 10:31:42.839513 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.839481 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxgd\" (UniqueName: \"kubernetes.io/projected/b148d94d-03fc-41ae-b3d1-0244f3d77551-kube-api-access-8cxgd\") pod \"test-curl-7576-140659742678448\" (UID: \"b148d94d-03fc-41ae-b3d1-0244f3d77551\") " pod="opendatahub/test-curl-7576-140659742678448" Aug 02 10:31:42.940839 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.940801 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxgd\" (UniqueName: \"kubernetes.io/projected/b148d94d-03fc-41ae-b3d1-0244f3d77551-kube-api-access-8cxgd\") pod \"test-curl-7576-140659742678448\" (UID: \"b148d94d-03fc-41ae-b3d1-0244f3d77551\") " pod="opendatahub/test-curl-7576-140659742678448" Aug 02 10:31:42.960576 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:42.960541 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxgd\" (UniqueName: \"kubernetes.io/projected/b148d94d-03fc-41ae-b3d1-0244f3d77551-kube-api-access-8cxgd\") pod \"test-curl-7576-140659742678448\" (UID: \"b148d94d-03fc-41ae-b3d1-0244f3d77551\") " pod="opendatahub/test-curl-7576-140659742678448" Aug 02 10:31:43.015086 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:43.015005 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742678448" Aug 02 10:31:43.172209 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:43.172181 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140659742678448"] Aug 02 10:31:43.174108 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:31:43.174083 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb148d94d_03fc_41ae_b3d1_0244f3d77551.slice/crio-8cca97dac87ea4272a690ec437489718508a4e59a0fc973a2df48b97a06aaff5 WatchSource:0}: Error finding container 8cca97dac87ea4272a690ec437489718508a4e59a0fc973a2df48b97a06aaff5: Status 404 returned error can't find the container with id 8cca97dac87ea4272a690ec437489718508a4e59a0fc973a2df48b97a06aaff5 Aug 02 10:31:43.229487 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:43.229456 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140659742678448" event={"ID":"b148d94d-03fc-41ae-b3d1-0244f3d77551","Type":"ContainerStarted","Data":"8cca97dac87ea4272a690ec437489718508a4e59a0fc973a2df48b97a06aaff5"} Aug 02 10:31:43.230931 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:43.230909 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd4cc2b08940ca011397c2e11d07760a34e35f0f3c8973fdac651bb880ae119d" Aug 02 10:31:43.230931 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:43.230936 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742678576" Aug 02 10:31:43.268834 ip-10-0-142-118 kubenswrapper[2575]: E0802 10:31:43.266732 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7576-140659742678576\" is forbidden: User \"system:node:ip-10-0-142-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-118.ec2.internal' and this object" podUID="9159c660-bf5b-4536-8320-9dc704beac33" pod="opendatahub/test-curl-7576-140659742678576" Aug 02 10:31:43.955478 ip-10-0-142-118 kubenswrapper[2575]: E0802 10:31:43.955386 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7576-140659742678576\" is forbidden: User \"system:node:ip-10-0-142-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-118.ec2.internal' and this object" podUID="9159c660-bf5b-4536-8320-9dc704beac33" pod="opendatahub/test-curl-7576-140659742678576" Aug 02 10:31:43.957830 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:43.957796 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9159c660-bf5b-4536-8320-9dc704beac33" path="/var/lib/kubelet/pods/9159c660-bf5b-4536-8320-9dc704beac33/volumes" Aug 02 10:31:44.237980 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:44.237889 2575 generic.go:356] "Generic (PLEG): container finished" podID="b148d94d-03fc-41ae-b3d1-0244f3d77551" containerID="d209d41a3895b09c97cd1e631d2b837cb5e453efe0dd7b630e06724f24f7b22b" exitCode=0 Aug 02 10:31:44.238133 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:44.237984 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140659742678448" event={"ID":"b148d94d-03fc-41ae-b3d1-0244f3d77551","Type":"ContainerDied","Data":"d209d41a3895b09c97cd1e631d2b837cb5e453efe0dd7b630e06724f24f7b22b"} Aug 02 10:31:45.391617 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.391584 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742678448" Aug 02 10:31:45.428233 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.428204 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140659742678448_b148d94d-03fc-41ae-b3d1-0244f3d77551/test-curl-7576-140659742678448/0.log" Aug 02 10:31:45.461846 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.461764 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cxgd\" (UniqueName: \"kubernetes.io/projected/b148d94d-03fc-41ae-b3d1-0244f3d77551-kube-api-access-8cxgd\") pod \"b148d94d-03fc-41ae-b3d1-0244f3d77551\" (UID: \"b148d94d-03fc-41ae-b3d1-0244f3d77551\") " Aug 02 10:31:45.463966 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.463939 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b148d94d-03fc-41ae-b3d1-0244f3d77551-kube-api-access-8cxgd" (OuterVolumeSpecName: "kube-api-access-8cxgd") pod "b148d94d-03fc-41ae-b3d1-0244f3d77551" (UID: "b148d94d-03fc-41ae-b3d1-0244f3d77551"). InnerVolumeSpecName "kube-api-access-8cxgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:31:45.469251 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.469226 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140659742678448"] Aug 02 10:31:45.474655 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.474632 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140659742678448"] Aug 02 10:31:45.563432 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.563396 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cxgd\" (UniqueName: \"kubernetes.io/projected/b148d94d-03fc-41ae-b3d1-0244f3d77551-kube-api-access-8cxgd\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:31:45.662487 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.662449 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140659742630368"] Aug 02 10:31:45.662980 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.662959 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b148d94d-03fc-41ae-b3d1-0244f3d77551" containerName="test-curl-7576-140659742678448" Aug 02 10:31:45.663093 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.662982 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b148d94d-03fc-41ae-b3d1-0244f3d77551" containerName="test-curl-7576-140659742678448" Aug 02 10:31:45.663155 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.663101 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b148d94d-03fc-41ae-b3d1-0244f3d77551" containerName="test-curl-7576-140659742678448" Aug 02 10:31:45.666286 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.666265 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742630368" Aug 02 10:31:45.681503 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.681477 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140659742630368"] Aug 02 10:31:45.765226 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.765191 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbvg5\" (UniqueName: \"kubernetes.io/projected/9be96ba7-84b2-4cfc-bdcc-925b393340b7-kube-api-access-qbvg5\") pod \"test-curl-7576-140659742630368\" (UID: \"9be96ba7-84b2-4cfc-bdcc-925b393340b7\") " pod="opendatahub/test-curl-7576-140659742630368" Aug 02 10:31:45.866832 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.866726 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbvg5\" (UniqueName: \"kubernetes.io/projected/9be96ba7-84b2-4cfc-bdcc-925b393340b7-kube-api-access-qbvg5\") pod \"test-curl-7576-140659742630368\" (UID: \"9be96ba7-84b2-4cfc-bdcc-925b393340b7\") " pod="opendatahub/test-curl-7576-140659742630368" Aug 02 10:31:45.890356 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.890320 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbvg5\" (UniqueName: \"kubernetes.io/projected/9be96ba7-84b2-4cfc-bdcc-925b393340b7-kube-api-access-qbvg5\") pod \"test-curl-7576-140659742630368\" (UID: \"9be96ba7-84b2-4cfc-bdcc-925b393340b7\") " pod="opendatahub/test-curl-7576-140659742630368" Aug 02 10:31:45.957676 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.957636 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b148d94d-03fc-41ae-b3d1-0244f3d77551" path="/var/lib/kubelet/pods/b148d94d-03fc-41ae-b3d1-0244f3d77551/volumes" Aug 02 10:31:45.975708 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:45.975676 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742630368" Aug 02 10:31:46.135658 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:46.135627 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140659742630368"] Aug 02 10:31:46.137394 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:31:46.137364 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9be96ba7_84b2_4cfc_bdcc_925b393340b7.slice/crio-e3b7a53122b6a378a631982740c3fb0c187cc0f4b7dbdabedf0d94d07c69d9b5 WatchSource:0}: Error finding container e3b7a53122b6a378a631982740c3fb0c187cc0f4b7dbdabedf0d94d07c69d9b5: Status 404 returned error can't find the container with id e3b7a53122b6a378a631982740c3fb0c187cc0f4b7dbdabedf0d94d07c69d9b5 Aug 02 10:31:46.254741 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:46.254711 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742678448" Aug 02 10:31:46.254741 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:46.254738 2575 scope.go:117] "RemoveContainer" containerID="d209d41a3895b09c97cd1e631d2b837cb5e453efe0dd7b630e06724f24f7b22b" Aug 02 10:31:46.256104 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:46.255951 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140659742630368" event={"ID":"9be96ba7-84b2-4cfc-bdcc-925b393340b7","Type":"ContainerStarted","Data":"e3b7a53122b6a378a631982740c3fb0c187cc0f4b7dbdabedf0d94d07c69d9b5"} Aug 02 10:31:47.263937 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:47.263902 2575 generic.go:356] "Generic (PLEG): container finished" podID="9be96ba7-84b2-4cfc-bdcc-925b393340b7" containerID="7ea94203d0539fe88fbe8ca765057df9a2096ff99d4357b1767bf7e463f85fcc" exitCode=0 Aug 02 10:31:47.264354 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:47.263974 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140659742630368" event={"ID":"9be96ba7-84b2-4cfc-bdcc-925b393340b7","Type":"ContainerDied","Data":"7ea94203d0539fe88fbe8ca765057df9a2096ff99d4357b1767bf7e463f85fcc"} Aug 02 10:31:48.413755 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.413727 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742630368" Aug 02 10:31:48.444049 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.444005 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140659742630368_9be96ba7-84b2-4cfc-bdcc-925b393340b7/test-curl-7576-140659742630368/0.log" Aug 02 10:31:48.487303 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.487269 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140659742630368"] Aug 02 10:31:48.492622 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.492595 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbvg5\" (UniqueName: \"kubernetes.io/projected/9be96ba7-84b2-4cfc-bdcc-925b393340b7-kube-api-access-qbvg5\") pod \"9be96ba7-84b2-4cfc-bdcc-925b393340b7\" (UID: \"9be96ba7-84b2-4cfc-bdcc-925b393340b7\") " Aug 02 10:31:48.494859 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.494832 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9be96ba7-84b2-4cfc-bdcc-925b393340b7-kube-api-access-qbvg5" (OuterVolumeSpecName: "kube-api-access-qbvg5") pod "9be96ba7-84b2-4cfc-bdcc-925b393340b7" (UID: "9be96ba7-84b2-4cfc-bdcc-925b393340b7"). InnerVolumeSpecName "kube-api-access-qbvg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:31:48.495250 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.495231 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140659742630368"] Aug 02 10:31:48.593370 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.593335 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbvg5\" (UniqueName: \"kubernetes.io/projected/9be96ba7-84b2-4cfc-bdcc-925b393340b7-kube-api-access-qbvg5\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:31:48.620179 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.620145 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140659742630368"] Aug 02 10:31:48.620638 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.620620 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9be96ba7-84b2-4cfc-bdcc-925b393340b7" containerName="test-curl-7576-140659742630368" Aug 02 10:31:48.620747 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.620640 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9be96ba7-84b2-4cfc-bdcc-925b393340b7" containerName="test-curl-7576-140659742630368" Aug 02 10:31:48.620817 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.620767 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9be96ba7-84b2-4cfc-bdcc-925b393340b7" containerName="test-curl-7576-140659742630368" Aug 02 10:31:48.623906 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.623885 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742630368" Aug 02 10:31:48.637584 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.637495 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140659742630368"] Aug 02 10:31:48.693939 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.693898 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-788n9\" (UniqueName: \"kubernetes.io/projected/d9450baf-d0d8-4a53-a063-5338b44e0dfa-kube-api-access-788n9\") pod \"test-curl-7576-140659742630368\" (UID: \"d9450baf-d0d8-4a53-a063-5338b44e0dfa\") " pod="opendatahub/test-curl-7576-140659742630368" Aug 02 10:31:48.795410 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.795350 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-788n9\" (UniqueName: \"kubernetes.io/projected/d9450baf-d0d8-4a53-a063-5338b44e0dfa-kube-api-access-788n9\") pod \"test-curl-7576-140659742630368\" (UID: \"d9450baf-d0d8-4a53-a063-5338b44e0dfa\") " pod="opendatahub/test-curl-7576-140659742630368" Aug 02 10:31:48.809000 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.808968 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-788n9\" (UniqueName: \"kubernetes.io/projected/d9450baf-d0d8-4a53-a063-5338b44e0dfa-kube-api-access-788n9\") pod \"test-curl-7576-140659742630368\" (UID: \"d9450baf-d0d8-4a53-a063-5338b44e0dfa\") " pod="opendatahub/test-curl-7576-140659742630368" Aug 02 10:31:48.933173 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:48.933076 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742630368" Aug 02 10:31:49.073070 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:49.073043 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140659742630368"] Aug 02 10:31:49.075985 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:31:49.075953 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9450baf_d0d8_4a53_a063_5338b44e0dfa.slice/crio-b5df6d92dbab2bf1c2a047c9e9adbe6e963b4d6ded068a79f621d6d102926a80 WatchSource:0}: Error finding container b5df6d92dbab2bf1c2a047c9e9adbe6e963b4d6ded068a79f621d6d102926a80: Status 404 returned error can't find the container with id b5df6d92dbab2bf1c2a047c9e9adbe6e963b4d6ded068a79f621d6d102926a80 Aug 02 10:31:49.277131 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:49.277034 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140659742630368" event={"ID":"d9450baf-d0d8-4a53-a063-5338b44e0dfa","Type":"ContainerStarted","Data":"b5df6d92dbab2bf1c2a047c9e9adbe6e963b4d6ded068a79f621d6d102926a80"} Aug 02 10:31:49.278409 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:49.278388 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742630368" Aug 02 10:31:49.278558 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:49.278436 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3b7a53122b6a378a631982740c3fb0c187cc0f4b7dbdabedf0d94d07c69d9b5" Aug 02 10:31:49.290898 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:49.290868 2575 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7576-140659742630368" oldPodUID="9be96ba7-84b2-4cfc-bdcc-925b393340b7" podUID="d9450baf-d0d8-4a53-a063-5338b44e0dfa" Aug 02 10:31:49.957001 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:49.956968 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9be96ba7-84b2-4cfc-bdcc-925b393340b7" path="/var/lib/kubelet/pods/9be96ba7-84b2-4cfc-bdcc-925b393340b7/volumes" Aug 02 10:31:50.285997 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:50.285907 2575 generic.go:356] "Generic (PLEG): container finished" podID="d9450baf-d0d8-4a53-a063-5338b44e0dfa" containerID="2679c6a8a35743750c494c0c20d45d52459798da4dca5da6f4bb8758cfe48fcf" exitCode=0 Aug 02 10:31:50.286135 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:50.285999 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140659742630368" event={"ID":"d9450baf-d0d8-4a53-a063-5338b44e0dfa","Type":"ContainerDied","Data":"2679c6a8a35743750c494c0c20d45d52459798da4dca5da6f4bb8758cfe48fcf"} Aug 02 10:31:51.444547 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.444521 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742630368" Aug 02 10:31:51.466238 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.466206 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140659742630368_d9450baf-d0d8-4a53-a063-5338b44e0dfa/test-curl-7576-140659742630368/0.log" Aug 02 10:31:51.494585 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.494548 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140659742630368"] Aug 02 10:31:51.497717 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.497688 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140659742630368"] Aug 02 10:31:51.522271 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.522246 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-788n9\" (UniqueName: \"kubernetes.io/projected/d9450baf-d0d8-4a53-a063-5338b44e0dfa-kube-api-access-788n9\") pod \"d9450baf-d0d8-4a53-a063-5338b44e0dfa\" (UID: \"d9450baf-d0d8-4a53-a063-5338b44e0dfa\") " Aug 02 10:31:51.524352 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.524331 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9450baf-d0d8-4a53-a063-5338b44e0dfa-kube-api-access-788n9" (OuterVolumeSpecName: "kube-api-access-788n9") pod "d9450baf-d0d8-4a53-a063-5338b44e0dfa" (UID: "d9450baf-d0d8-4a53-a063-5338b44e0dfa"). InnerVolumeSpecName "kube-api-access-788n9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:31:51.623870 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.623753 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-788n9\" (UniqueName: \"kubernetes.io/projected/d9450baf-d0d8-4a53-a063-5338b44e0dfa-kube-api-access-788n9\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:31:51.626311 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.626287 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140659742631376"] Aug 02 10:31:51.626704 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.626692 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9450baf-d0d8-4a53-a063-5338b44e0dfa" containerName="test-curl-7576-140659742630368" Aug 02 10:31:51.626746 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.626707 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9450baf-d0d8-4a53-a063-5338b44e0dfa" containerName="test-curl-7576-140659742630368" Aug 02 10:31:51.626797 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.626768 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9450baf-d0d8-4a53-a063-5338b44e0dfa" containerName="test-curl-7576-140659742630368" Aug 02 10:31:51.629765 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.629748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742631376" Aug 02 10:31:51.636683 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.636654 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140659742631376"] Aug 02 10:31:51.724553 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.724511 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mcf9\" (UniqueName: \"kubernetes.io/projected/7a8d6f5a-87ce-4e39-b62a-44518144a776-kube-api-access-6mcf9\") pod \"test-curl-7576-140659742631376\" (UID: \"7a8d6f5a-87ce-4e39-b62a-44518144a776\") " pod="opendatahub/test-curl-7576-140659742631376" Aug 02 10:31:51.827823 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.825702 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mcf9\" (UniqueName: \"kubernetes.io/projected/7a8d6f5a-87ce-4e39-b62a-44518144a776-kube-api-access-6mcf9\") pod \"test-curl-7576-140659742631376\" (UID: \"7a8d6f5a-87ce-4e39-b62a-44518144a776\") " pod="opendatahub/test-curl-7576-140659742631376" Aug 02 10:31:51.836648 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.836615 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mcf9\" (UniqueName: \"kubernetes.io/projected/7a8d6f5a-87ce-4e39-b62a-44518144a776-kube-api-access-6mcf9\") pod \"test-curl-7576-140659742631376\" (UID: \"7a8d6f5a-87ce-4e39-b62a-44518144a776\") " pod="opendatahub/test-curl-7576-140659742631376" Aug 02 10:31:51.941110 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.941014 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742631376" Aug 02 10:31:51.958262 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:51.958230 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9450baf-d0d8-4a53-a063-5338b44e0dfa" path="/var/lib/kubelet/pods/d9450baf-d0d8-4a53-a063-5338b44e0dfa/volumes" Aug 02 10:31:52.084027 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:52.083999 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140659742631376"] Aug 02 10:31:52.085433 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:31:52.085401 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a8d6f5a_87ce_4e39_b62a_44518144a776.slice/crio-a7b2354ceb1d420a6ccdf298c9b6a4da34cb2392119d83fc65b669246b6e976a WatchSource:0}: Error finding container a7b2354ceb1d420a6ccdf298c9b6a4da34cb2392119d83fc65b669246b6e976a: Status 404 returned error can't find the container with id a7b2354ceb1d420a6ccdf298c9b6a4da34cb2392119d83fc65b669246b6e976a Aug 02 10:31:52.299157 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:52.299123 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140659742631376" event={"ID":"7a8d6f5a-87ce-4e39-b62a-44518144a776","Type":"ContainerStarted","Data":"a7b2354ceb1d420a6ccdf298c9b6a4da34cb2392119d83fc65b669246b6e976a"} Aug 02 10:31:52.300344 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:52.300321 2575 scope.go:117] "RemoveContainer" containerID="2679c6a8a35743750c494c0c20d45d52459798da4dca5da6f4bb8758cfe48fcf" Aug 02 10:31:52.300470 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:52.300322 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742630368" Aug 02 10:31:53.307832 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:53.307794 2575 generic.go:356] "Generic (PLEG): container finished" podID="7a8d6f5a-87ce-4e39-b62a-44518144a776" containerID="a1222480fa0ecb3a00bacea638a6a9250191d8c7f069fdf0509c2f869b3138cb" exitCode=0 Aug 02 10:31:53.308230 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:53.307876 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140659742631376" event={"ID":"7a8d6f5a-87ce-4e39-b62a-44518144a776","Type":"ContainerDied","Data":"a1222480fa0ecb3a00bacea638a6a9250191d8c7f069fdf0509c2f869b3138cb"} Aug 02 10:31:54.459248 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.459222 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742631376" Aug 02 10:31:54.482229 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.482200 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140659742631376_7a8d6f5a-87ce-4e39-b62a-44518144a776/test-curl-7576-140659742631376/0.log" Aug 02 10:31:54.510922 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.510881 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140659742631376"] Aug 02 10:31:54.513428 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.513401 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140659742631376"] Aug 02 10:31:54.551090 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.551053 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mcf9\" (UniqueName: \"kubernetes.io/projected/7a8d6f5a-87ce-4e39-b62a-44518144a776-kube-api-access-6mcf9\") pod \"7a8d6f5a-87ce-4e39-b62a-44518144a776\" (UID: \"7a8d6f5a-87ce-4e39-b62a-44518144a776\") " Aug 02 10:31:54.553251 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.553224 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a8d6f5a-87ce-4e39-b62a-44518144a776-kube-api-access-6mcf9" (OuterVolumeSpecName: "kube-api-access-6mcf9") pod "7a8d6f5a-87ce-4e39-b62a-44518144a776" (UID: "7a8d6f5a-87ce-4e39-b62a-44518144a776"). InnerVolumeSpecName "kube-api-access-6mcf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:31:54.644694 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.644609 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140659742631376"] Aug 02 10:31:54.645064 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.645049 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a8d6f5a-87ce-4e39-b62a-44518144a776" containerName="test-curl-7576-140659742631376" Aug 02 10:31:54.645119 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.645068 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a8d6f5a-87ce-4e39-b62a-44518144a776" containerName="test-curl-7576-140659742631376" Aug 02 10:31:54.645157 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.645152 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a8d6f5a-87ce-4e39-b62a-44518144a776" containerName="test-curl-7576-140659742631376" Aug 02 10:31:54.648256 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.648241 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742631376" Aug 02 10:31:54.652473 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.652451 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mcf9\" (UniqueName: \"kubernetes.io/projected/7a8d6f5a-87ce-4e39-b62a-44518144a776-kube-api-access-6mcf9\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:31:54.658464 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.658442 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140659742631376"] Aug 02 10:31:54.753269 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.753226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d7jt\" (UniqueName: \"kubernetes.io/projected/930f5245-b297-477f-9566-f2f3b7a48160-kube-api-access-2d7jt\") pod \"test-curl-7576-140659742631376\" (UID: \"930f5245-b297-477f-9566-f2f3b7a48160\") " pod="opendatahub/test-curl-7576-140659742631376" Aug 02 10:31:54.854105 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.854068 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d7jt\" (UniqueName: \"kubernetes.io/projected/930f5245-b297-477f-9566-f2f3b7a48160-kube-api-access-2d7jt\") pod \"test-curl-7576-140659742631376\" (UID: \"930f5245-b297-477f-9566-f2f3b7a48160\") " pod="opendatahub/test-curl-7576-140659742631376" Aug 02 10:31:54.864162 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.864127 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d7jt\" (UniqueName: \"kubernetes.io/projected/930f5245-b297-477f-9566-f2f3b7a48160-kube-api-access-2d7jt\") pod \"test-curl-7576-140659742631376\" (UID: \"930f5245-b297-477f-9566-f2f3b7a48160\") " pod="opendatahub/test-curl-7576-140659742631376" Aug 02 10:31:54.958386 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:54.958295 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742631376" Aug 02 10:31:55.101829 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:55.101798 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140659742631376"] Aug 02 10:31:55.103051 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:31:55.103021 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod930f5245_b297_477f_9566_f2f3b7a48160.slice/crio-bb563f0cd8068398833b22b97f507e2aded2031dd0f3cbc7abaea07e54bf19ac WatchSource:0}: Error finding container bb563f0cd8068398833b22b97f507e2aded2031dd0f3cbc7abaea07e54bf19ac: Status 404 returned error can't find the container with id bb563f0cd8068398833b22b97f507e2aded2031dd0f3cbc7abaea07e54bf19ac Aug 02 10:31:55.321223 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:55.321187 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140659742631376" event={"ID":"930f5245-b297-477f-9566-f2f3b7a48160","Type":"ContainerStarted","Data":"bb563f0cd8068398833b22b97f507e2aded2031dd0f3cbc7abaea07e54bf19ac"} Aug 02 10:31:55.322443 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:55.322424 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7b2354ceb1d420a6ccdf298c9b6a4da34cb2392119d83fc65b669246b6e976a" Aug 02 10:31:55.322554 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:55.322445 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742631376" Aug 02 10:31:55.334627 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:55.334603 2575 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7576-140659742631376" oldPodUID="7a8d6f5a-87ce-4e39-b62a-44518144a776" podUID="930f5245-b297-477f-9566-f2f3b7a48160" Aug 02 10:31:55.957086 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:55.957057 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a8d6f5a-87ce-4e39-b62a-44518144a776" path="/var/lib/kubelet/pods/7a8d6f5a-87ce-4e39-b62a-44518144a776/volumes" Aug 02 10:31:56.329274 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:56.329239 2575 generic.go:356] "Generic (PLEG): container finished" podID="930f5245-b297-477f-9566-f2f3b7a48160" containerID="bebf1fe1eb04f7088aed134f1093e07ecfc1c49fedb9fd0934363f8af594a2a5" exitCode=0 Aug 02 10:31:56.329468 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:56.329295 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140659742631376" event={"ID":"930f5245-b297-477f-9566-f2f3b7a48160","Type":"ContainerDied","Data":"bebf1fe1eb04f7088aed134f1093e07ecfc1c49fedb9fd0934363f8af594a2a5"} Aug 02 10:31:57.479364 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:57.479336 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742631376" Aug 02 10:31:57.509847 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:57.509771 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140659742631376_930f5245-b297-477f-9566-f2f3b7a48160/test-curl-7576-140659742631376/0.log" Aug 02 10:31:57.548851 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:57.548814 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140659742631376"] Aug 02 10:31:57.553211 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:57.553185 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140659742631376"] Aug 02 10:31:57.579096 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:57.579060 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d7jt\" (UniqueName: \"kubernetes.io/projected/930f5245-b297-477f-9566-f2f3b7a48160-kube-api-access-2d7jt\") pod \"930f5245-b297-477f-9566-f2f3b7a48160\" (UID: \"930f5245-b297-477f-9566-f2f3b7a48160\") " Aug 02 10:31:57.581202 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:57.581167 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/930f5245-b297-477f-9566-f2f3b7a48160-kube-api-access-2d7jt" (OuterVolumeSpecName: "kube-api-access-2d7jt") pod "930f5245-b297-477f-9566-f2f3b7a48160" (UID: "930f5245-b297-477f-9566-f2f3b7a48160"). InnerVolumeSpecName "kube-api-access-2d7jt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:31:57.679812 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:57.679740 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d7jt\" (UniqueName: \"kubernetes.io/projected/930f5245-b297-477f-9566-f2f3b7a48160-kube-api-access-2d7jt\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:31:57.956693 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:57.956609 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="930f5245-b297-477f-9566-f2f3b7a48160" path="/var/lib/kubelet/pods/930f5245-b297-477f-9566-f2f3b7a48160/volumes" Aug 02 10:31:58.342832 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.342802 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140659742631376" Aug 02 10:31:58.343011 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.342848 2575 scope.go:117] "RemoveContainer" containerID="bebf1fe1eb04f7088aed134f1093e07ecfc1c49fedb9fd0934363f8af594a2a5" Aug 02 10:31:58.431197 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.431159 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq"] Aug 02 10:31:58.431821 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.431800 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="930f5245-b297-477f-9566-f2f3b7a48160" containerName="test-curl-7576-140659742631376" Aug 02 10:31:58.431885 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.431826 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="930f5245-b297-477f-9566-f2f3b7a48160" containerName="test-curl-7576-140659742631376" Aug 02 10:31:58.431973 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.431961 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="930f5245-b297-477f-9566-f2f3b7a48160" containerName="test-curl-7576-140659742631376" Aug 02 10:31:58.436538 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.436514 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.439269 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.439251 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-5c4717-openshift-default-dockercfg-sztzz\"" Aug 02 10:31:58.452958 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.452932 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq"] Aug 02 10:31:58.588534 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.588499 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-token\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.588951 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.588540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-workload-certs\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.588951 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.588573 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-podinfo\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.588951 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.588625 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-envoy\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.588951 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.588668 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-data\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.588951 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.588696 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-workload-socket\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.588951 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.588713 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istiod-ca-cert\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.588951 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.588729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncvqw\" (UniqueName: \"kubernetes.io/projected/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-kube-api-access-ncvqw\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.588951 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.588830 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-credential-socket\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.689567 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.689483 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-token\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.689567 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.689525 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-workload-certs\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.689567 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.689551 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-podinfo\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.689886 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.689615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-envoy\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.689886 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.689698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-data\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.689886 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.689746 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-workload-socket\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.689886 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.689766 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istiod-ca-cert\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.689886 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.689800 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncvqw\" (UniqueName: \"kubernetes.io/projected/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-kube-api-access-ncvqw\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.690155 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.690133 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-workload-socket\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.690212 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.690185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-data\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.690292 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.690273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-credential-socket\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.690382 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.690345 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-workload-certs\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.690530 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.690511 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istiod-ca-cert\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.690627 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.690603 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-credential-socket\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.691938 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.691916 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-envoy\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.692189 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.692171 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-podinfo\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.697909 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.697886 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-token\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.698455 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.698435 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncvqw\" (UniqueName: \"kubernetes.io/projected/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-kube-api-access-ncvqw\") pod \"e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.747480 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.747442 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:58.906606 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.906574 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq"] Aug 02 10:31:58.907148 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:31:58.907122 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b7b62a2_9c6c_423a_825f_fb44dbfe582f.slice/crio-bd76017be53facb38a3e45fd73c0a167f8af415cee1bf38ed91e7d14e03c67cd WatchSource:0}: Error finding container bd76017be53facb38a3e45fd73c0a167f8af415cee1bf38ed91e7d14e03c67cd: Status 404 returned error can't find the container with id bd76017be53facb38a3e45fd73c0a167f8af415cee1bf38ed91e7d14e03c67cd Aug 02 10:31:58.909708 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.909668 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 10:31:58.909800 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.909757 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 10:31:58.909863 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:58.909819 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 10:31:59.351028 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:59.350980 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" event={"ID":"7b7b62a2-9c6c-423a-825f-fb44dbfe582f","Type":"ContainerStarted","Data":"b8d8041afca34d257e4ffb21c82adcd2178c963902a5b025bb459dd9d22dcec1"} Aug 02 10:31:59.351243 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:59.351050 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" event={"ID":"7b7b62a2-9c6c-423a-825f-fb44dbfe582f","Type":"ContainerStarted","Data":"bd76017be53facb38a3e45fd73c0a167f8af415cee1bf38ed91e7d14e03c67cd"} Aug 02 10:31:59.378088 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:59.378032 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" podStartSLOduration=1.3780125029999999 podStartE2EDuration="1.378012503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:31:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:31:59.37584102 +0000 UTC m=+3555.936996339" watchObservedRunningTime="2026-08-02 10:31:59.378012503 +0000 UTC m=+3555.939167823" Aug 02 10:31:59.747966 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:59.747766 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:31:59.753138 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:31:59.753113 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:32:00.357843 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:00.357805 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:32:00.358791 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:00.358756 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:32:15.834122 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:15.833230 2575 patch_prober.go:28] interesting pod/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": read tcp 10.132.0.2:54324->10.132.0.82:15021: read: connection reset by peer" start-of-body= Aug 02 10:32:15.834122 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:15.833310 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": read tcp 10.132.0.2:54324->10.132.0.82:15021: read: connection reset by peer" Aug 02 10:32:16.462689 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:16.462655 2575 generic.go:356] "Generic (PLEG): container finished" podID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerID="b8d8041afca34d257e4ffb21c82adcd2178c963902a5b025bb459dd9d22dcec1" exitCode=0 Aug 02 10:32:16.462901 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:16.462730 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" event={"ID":"7b7b62a2-9c6c-423a-825f-fb44dbfe582f","Type":"ContainerDied","Data":"b8d8041afca34d257e4ffb21c82adcd2178c963902a5b025bb459dd9d22dcec1"} Aug 02 10:32:16.463204 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:16.463185 2575 scope.go:117] "RemoveContainer" containerID="b8d8041afca34d257e4ffb21c82adcd2178c963902a5b025bb459dd9d22dcec1" Aug 02 10:32:16.464364 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:16.464337 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 10:32:16.464424 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:16.464402 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 10:32:16.464460 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:16.464434 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 10:32:17.471562 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:17.471523 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" event={"ID":"7b7b62a2-9c6c-423a-825f-fb44dbfe582f","Type":"ContainerStarted","Data":"110ee29c8c5957bfc3f603696679613c97e7ba804bc8403a944e163443fb20f7"} Aug 02 10:32:17.747877 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:17.747753 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:32:17.748303 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:17.748255 2575 patch_prober.go:28] interesting pod/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body= Aug 02 10:32:17.748393 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:17.748357 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" Aug 02 10:32:18.748865 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:18.748810 2575 patch_prober.go:28] interesting pod/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body= Aug 02 10:32:18.749396 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:18.748879 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" Aug 02 10:32:19.748627 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:19.748586 2575 patch_prober.go:28] interesting pod/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body= Aug 02 10:32:19.749081 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:19.749046 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" Aug 02 10:32:20.748314 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:20.748270 2575 patch_prober.go:28] interesting pod/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body= Aug 02 10:32:20.748541 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:20.748350 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" Aug 02 10:32:21.748249 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:21.748207 2575 patch_prober.go:28] interesting pod/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body= Aug 02 10:32:21.749309 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:21.748894 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" Aug 02 10:32:22.752627 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:22.752593 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:32:22.753120 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:22.753034 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:32:22.753637 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:22.753617 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:32:32.164695 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.164652 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6"] Aug 02 10:32:32.168290 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.168272 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" Aug 02 10:32:32.170575 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.170554 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-c167c0\"" Aug 02 10:32:32.170705 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.170554 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-c167c0-dockercfg-tszkc\"" Aug 02 10:32:32.180228 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.180203 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6"] Aug 02 10:32:32.225350 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.225313 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r"] Aug 02 10:32:32.228867 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.228848 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" Aug 02 10:32:32.239544 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.239513 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r"] Aug 02 10:32:32.333870 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.333820 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twr82\" (UniqueName: \"kubernetes.io/projected/8700078e-a32e-4c88-994b-585b3e24934a-kube-api-access-twr82\") pod \"payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r\" (UID: \"8700078e-a32e-4c88-994b-585b3e24934a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" Aug 02 10:32:32.334091 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.333901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8700078e-a32e-4c88-994b-585b3e24934a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r\" (UID: \"8700078e-a32e-4c88-994b-585b3e24934a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" Aug 02 10:32:32.334091 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.333959 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxggj\" (UniqueName: \"kubernetes.io/projected/3658e31e-ed80-41b3-a799-f6bb99509236-kube-api-access-qxggj\") pod \"payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6\" (UID: \"3658e31e-ed80-41b3-a799-f6bb99509236\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" Aug 02 10:32:32.334091 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.334019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3658e31e-ed80-41b3-a799-f6bb99509236-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6\" (UID: \"3658e31e-ed80-41b3-a799-f6bb99509236\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" Aug 02 10:32:32.435143 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.435029 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8700078e-a32e-4c88-994b-585b3e24934a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r\" (UID: \"8700078e-a32e-4c88-994b-585b3e24934a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" Aug 02 10:32:32.435143 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.435112 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxggj\" (UniqueName: \"kubernetes.io/projected/3658e31e-ed80-41b3-a799-f6bb99509236-kube-api-access-qxggj\") pod \"payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6\" (UID: \"3658e31e-ed80-41b3-a799-f6bb99509236\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" Aug 02 10:32:32.435143 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.435136 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3658e31e-ed80-41b3-a799-f6bb99509236-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6\" (UID: \"3658e31e-ed80-41b3-a799-f6bb99509236\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" Aug 02 10:32:32.435436 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.435196 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twr82\" (UniqueName: \"kubernetes.io/projected/8700078e-a32e-4c88-994b-585b3e24934a-kube-api-access-twr82\") pod \"payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r\" (UID: \"8700078e-a32e-4c88-994b-585b3e24934a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" Aug 02 10:32:32.436057 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.436027 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8700078e-a32e-4c88-994b-585b3e24934a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r\" (UID: \"8700078e-a32e-4c88-994b-585b3e24934a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" Aug 02 10:32:32.436223 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.436027 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3658e31e-ed80-41b3-a799-f6bb99509236-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6\" (UID: \"3658e31e-ed80-41b3-a799-f6bb99509236\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" Aug 02 10:32:32.444876 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.444849 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twr82\" (UniqueName: \"kubernetes.io/projected/8700078e-a32e-4c88-994b-585b3e24934a-kube-api-access-twr82\") pod \"payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r\" (UID: \"8700078e-a32e-4c88-994b-585b3e24934a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" Aug 02 10:32:32.445004 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.444928 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxggj\" (UniqueName: \"kubernetes.io/projected/3658e31e-ed80-41b3-a799-f6bb99509236-kube-api-access-qxggj\") pod \"payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6\" (UID: \"3658e31e-ed80-41b3-a799-f6bb99509236\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" Aug 02 10:32:32.479765 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.479731 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" Aug 02 10:32:32.540987 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.540955 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" Aug 02 10:32:32.707985 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.707957 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r"] Aug 02 10:32:32.708753 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:32:32.708730 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8700078e_a32e_4c88_994b_585b3e24934a.slice/crio-043d14c20fc1a4c44cbdc4a8ddef1568c4ed7e7d10a3f63f91b116b1f650f2f6 WatchSource:0}: Error finding container 043d14c20fc1a4c44cbdc4a8ddef1568c4ed7e7d10a3f63f91b116b1f650f2f6: Status 404 returned error can't find the container with id 043d14c20fc1a4c44cbdc4a8ddef1568c4ed7e7d10a3f63f91b116b1f650f2f6 Aug 02 10:32:32.849003 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:32.848975 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6"] Aug 02 10:32:32.850416 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:32:32.850384 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3658e31e_ed80_41b3_a799_f6bb99509236.slice/crio-da73bc9de6c23ebb8f983e609abdef847659cf016b2e978e8eea1be1e6056ebf WatchSource:0}: Error finding container da73bc9de6c23ebb8f983e609abdef847659cf016b2e978e8eea1be1e6056ebf: Status 404 returned error can't find the container with id da73bc9de6c23ebb8f983e609abdef847659cf016b2e978e8eea1be1e6056ebf Aug 02 10:32:33.581451 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:33.581406 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" event={"ID":"3658e31e-ed80-41b3-a799-f6bb99509236","Type":"ContainerStarted","Data":"da73bc9de6c23ebb8f983e609abdef847659cf016b2e978e8eea1be1e6056ebf"} Aug 02 10:32:33.583291 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:33.583259 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" event={"ID":"8700078e-a32e-4c88-994b-585b3e24934a","Type":"ContainerStarted","Data":"043d14c20fc1a4c44cbdc4a8ddef1568c4ed7e7d10a3f63f91b116b1f650f2f6"} Aug 02 10:32:35.597944 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:35.597909 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" event={"ID":"3658e31e-ed80-41b3-a799-f6bb99509236","Type":"ContainerStarted","Data":"7106def157161a552af9ebdd80168b3b24ed690e6629d27c3925170fd6b3d33e"} Aug 02 10:32:35.598427 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:35.598002 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" Aug 02 10:32:35.599489 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:35.599468 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" event={"ID":"8700078e-a32e-4c88-994b-585b3e24934a","Type":"ContainerStarted","Data":"7362f78c9edd915f61629ae49a1b67a17019df2f4475915321010a17d3cfb1c5"} Aug 02 10:32:35.599597 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:35.599584 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" Aug 02 10:32:35.616973 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:35.616928 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" podStartSLOduration=1.7947684000000002 podStartE2EDuration="3.616914114s" totalImagesPullingTime="1.822145714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:32:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:32:35.616019479 +0000 UTC m=+3592.177174811" watchObservedRunningTime="2026-08-02 10:32:35.616914114 +0000 UTC m=+3592.178069491" Aug 02 10:32:35.632665 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:35.632608 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" podStartSLOduration=1.67529619 podStartE2EDuration="3.632587924s" totalImagesPullingTime="1.957291734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:32:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:32:35.631404607 +0000 UTC m=+3592.192559927" watchObservedRunningTime="2026-08-02 10:32:35.632587924 +0000 UTC m=+3592.193743244" Aug 02 10:32:44.325072 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:44.325043 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:32:44.328214 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:44.328188 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:32:44.335139 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:44.335116 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:32:44.338015 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:44.337996 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbjf_8a99e78f-f418-412c-afa5-1ed095c705e8/ovn-acl-logging/0.log" Aug 02 10:32:46.607507 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:46.607478 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" Aug 02 10:32:46.607912 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:32:46.607541 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" Aug 02 10:33:02.437221 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:02.437191 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6_3658e31e-ed80-41b3-a799-f6bb99509236/payload-processing/0.log" Aug 02 10:33:47.503721 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:47.503689 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6_3658e31e-ed80-41b3-a799-f6bb99509236/payload-processing/0.log" Aug 02 10:33:52.464528 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:52.464492 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89"] Aug 02 10:33:52.468315 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:52.468297 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" Aug 02 10:33:52.473022 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:52.473002 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-80d516\"" Aug 02 10:33:52.473183 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:52.473166 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-80d516-dockercfg-wdqzw\"" Aug 02 10:33:52.493638 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:52.493608 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89"] Aug 02 10:33:52.598573 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:52.598528 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2797a8e-bde3-4770-9d75-aad1128ae788-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89\" (UID: \"f2797a8e-bde3-4770-9d75-aad1128ae788\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" Aug 02 10:33:52.598805 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:52.598578 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r8tf\" (UniqueName: \"kubernetes.io/projected/f2797a8e-bde3-4770-9d75-aad1128ae788-kube-api-access-5r8tf\") pod \"payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89\" (UID: \"f2797a8e-bde3-4770-9d75-aad1128ae788\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" Aug 02 10:33:52.700077 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:52.700037 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2797a8e-bde3-4770-9d75-aad1128ae788-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89\" (UID: \"f2797a8e-bde3-4770-9d75-aad1128ae788\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" Aug 02 10:33:52.700264 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:52.700089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r8tf\" (UniqueName: \"kubernetes.io/projected/f2797a8e-bde3-4770-9d75-aad1128ae788-kube-api-access-5r8tf\") pod \"payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89\" (UID: \"f2797a8e-bde3-4770-9d75-aad1128ae788\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" Aug 02 10:33:52.700900 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:52.700877 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2797a8e-bde3-4770-9d75-aad1128ae788-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89\" (UID: \"f2797a8e-bde3-4770-9d75-aad1128ae788\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" Aug 02 10:33:52.708931 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:52.708903 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r8tf\" (UniqueName: \"kubernetes.io/projected/f2797a8e-bde3-4770-9d75-aad1128ae788-kube-api-access-5r8tf\") pod \"payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89\" (UID: \"f2797a8e-bde3-4770-9d75-aad1128ae788\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" Aug 02 10:33:52.779229 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:52.779142 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" Aug 02 10:33:53.136939 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:53.134665 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89"] Aug 02 10:33:54.080176 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:54.080140 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" event={"ID":"f2797a8e-bde3-4770-9d75-aad1128ae788","Type":"ContainerStarted","Data":"edd0c12d19c96d8e39a54ec23f1ffe40bd5aa31fe2853692e67d26363e357a21"} Aug 02 10:33:54.080589 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:54.080208 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" Aug 02 10:33:54.080589 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:54.080228 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" event={"ID":"f2797a8e-bde3-4770-9d75-aad1128ae788","Type":"ContainerStarted","Data":"5c2ef7ab4210af0c4d39e22223eea9d748b8934517911fd56bb8e6e75d148f1d"} Aug 02 10:33:54.098000 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:33:54.097944 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" podStartSLOduration=2.097926478 podStartE2EDuration="2.097926478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:33:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:54.095277996 +0000 UTC m=+3670.656433318" watchObservedRunningTime="2026-08-02 10:33:54.097926478 +0000 UTC m=+3670.659081797" Aug 02 10:34:05.088604 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:05.088577 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" Aug 02 10:34:16.327446 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:16.327355 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2"] Aug 02 10:34:16.331339 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:16.331314 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2" Aug 02 10:34:16.333664 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:16.333640 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7lxd\"" Aug 02 10:34:16.333807 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:16.333651 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 02 10:34:16.339990 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:16.339864 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2"] Aug 02 10:34:16.429433 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:16.429398 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b65a69-a229-4007-bc38-3856d1f1bb17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2\" (UID: \"88b65a69-a229-4007-bc38-3856d1f1bb17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2" Aug 02 10:34:16.530355 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:16.530313 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b65a69-a229-4007-bc38-3856d1f1bb17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2\" (UID: \"88b65a69-a229-4007-bc38-3856d1f1bb17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2" Aug 02 10:34:16.531044 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:16.531017 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b65a69-a229-4007-bc38-3856d1f1bb17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2\" (UID: \"88b65a69-a229-4007-bc38-3856d1f1bb17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2" Aug 02 10:34:16.643445 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:16.643347 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2" Aug 02 10:34:16.789437 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:16.789403 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2"] Aug 02 10:34:16.790803 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:34:16.790745 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b65a69_a229_4007_bc38_3856d1f1bb17.slice/crio-9ab522f5a45c94efd3f98d13ba6ba020f86fccc6061678e82c4b986252783e89 WatchSource:0}: Error finding container 9ab522f5a45c94efd3f98d13ba6ba020f86fccc6061678e82c4b986252783e89: Status 404 returned error can't find the container with id 9ab522f5a45c94efd3f98d13ba6ba020f86fccc6061678e82c4b986252783e89 Aug 02 10:34:17.219930 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:17.219893 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2" event={"ID":"88b65a69-a229-4007-bc38-3856d1f1bb17","Type":"ContainerStarted","Data":"d72ba36e58d06fe759af96767217d7b63f6702f01b9d35dbfad7b6cd3b44bb33"} Aug 02 10:34:17.220133 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:17.219954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2" event={"ID":"88b65a69-a229-4007-bc38-3856d1f1bb17","Type":"ContainerStarted","Data":"9ab522f5a45c94efd3f98d13ba6ba020f86fccc6061678e82c4b986252783e89"} Aug 02 10:34:17.236840 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:17.236709 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2" podStartSLOduration=1.236688563 podStartE2EDuration="1.236688563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:34:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:34:17.236021358 +0000 UTC m=+3693.797176679" watchObservedRunningTime="2026-08-02 10:34:17.236688563 +0000 UTC m=+3693.797843886" Aug 02 10:34:18.226899 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:18.226864 2575 generic.go:356] "Generic (PLEG): container finished" podID="88b65a69-a229-4007-bc38-3856d1f1bb17" containerID="d72ba36e58d06fe759af96767217d7b63f6702f01b9d35dbfad7b6cd3b44bb33" exitCode=0 Aug 02 10:34:18.227328 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:18.226942 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2" event={"ID":"88b65a69-a229-4007-bc38-3856d1f1bb17","Type":"ContainerDied","Data":"d72ba36e58d06fe759af96767217d7b63f6702f01b9d35dbfad7b6cd3b44bb33"} Aug 02 10:34:19.377398 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:19.377374 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2" Aug 02 10:34:19.452401 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:19.452363 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b65a69-a229-4007-bc38-3856d1f1bb17-maas-api-service-ca\") pod \"88b65a69-a229-4007-bc38-3856d1f1bb17\" (UID: \"88b65a69-a229-4007-bc38-3856d1f1bb17\") " Aug 02 10:34:19.452822 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:19.452771 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88b65a69-a229-4007-bc38-3856d1f1bb17-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "88b65a69-a229-4007-bc38-3856d1f1bb17" (UID: "88b65a69-a229-4007-bc38-3856d1f1bb17"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:34:19.553770 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:19.553740 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b65a69-a229-4007-bc38-3856d1f1bb17-maas-api-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:34:20.240742 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:20.240654 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2" event={"ID":"88b65a69-a229-4007-bc38-3856d1f1bb17","Type":"ContainerDied","Data":"9ab522f5a45c94efd3f98d13ba6ba020f86fccc6061678e82c4b986252783e89"} Aug 02 10:34:20.240742 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:20.240680 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2" Aug 02 10:34:20.240742 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:20.240704 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ab522f5a45c94efd3f98d13ba6ba020f86fccc6061678e82c4b986252783e89" Aug 02 10:34:22.543293 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:22.543256 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89"] Aug 02 10:34:22.543828 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:22.543530 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" podUID="f2797a8e-bde3-4770-9d75-aad1128ae788" containerName="payload-processing" containerID="cri-o://edd0c12d19c96d8e39a54ec23f1ffe40bd5aa31fe2853692e67d26363e357a21" gracePeriod=30 Aug 02 10:34:22.698231 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:22.698195 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2"] Aug 02 10:34:22.700832 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:22.700803 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-80d516-pwgw2"] Aug 02 10:34:22.814536 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:22.814511 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" Aug 02 10:34:22.884420 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:22.884386 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2797a8e-bde3-4770-9d75-aad1128ae788-plugins-config-volume\") pod \"f2797a8e-bde3-4770-9d75-aad1128ae788\" (UID: \"f2797a8e-bde3-4770-9d75-aad1128ae788\") " Aug 02 10:34:22.884595 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:22.884455 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r8tf\" (UniqueName: \"kubernetes.io/projected/f2797a8e-bde3-4770-9d75-aad1128ae788-kube-api-access-5r8tf\") pod \"f2797a8e-bde3-4770-9d75-aad1128ae788\" (UID: \"f2797a8e-bde3-4770-9d75-aad1128ae788\") " Aug 02 10:34:22.884836 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:22.884816 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2797a8e-bde3-4770-9d75-aad1128ae788-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f2797a8e-bde3-4770-9d75-aad1128ae788" (UID: "f2797a8e-bde3-4770-9d75-aad1128ae788"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:34:22.886521 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:22.886499 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2797a8e-bde3-4770-9d75-aad1128ae788-kube-api-access-5r8tf" (OuterVolumeSpecName: "kube-api-access-5r8tf") pod "f2797a8e-bde3-4770-9d75-aad1128ae788" (UID: "f2797a8e-bde3-4770-9d75-aad1128ae788"). InnerVolumeSpecName "kube-api-access-5r8tf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:34:22.986317 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:22.986273 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r8tf\" (UniqueName: \"kubernetes.io/projected/f2797a8e-bde3-4770-9d75-aad1128ae788-kube-api-access-5r8tf\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:34:22.986317 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:22.986311 2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2797a8e-bde3-4770-9d75-aad1128ae788-plugins-config-volume\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:34:23.262515 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:23.262425 2575 generic.go:356] "Generic (PLEG): container finished" podID="f2797a8e-bde3-4770-9d75-aad1128ae788" containerID="edd0c12d19c96d8e39a54ec23f1ffe40bd5aa31fe2853692e67d26363e357a21" exitCode=0 Aug 02 10:34:23.262515 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:23.262470 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" Aug 02 10:34:23.262720 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:23.262504 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" event={"ID":"f2797a8e-bde3-4770-9d75-aad1128ae788","Type":"ContainerDied","Data":"edd0c12d19c96d8e39a54ec23f1ffe40bd5aa31fe2853692e67d26363e357a21"} Aug 02 10:34:23.262720 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:23.262562 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89" event={"ID":"f2797a8e-bde3-4770-9d75-aad1128ae788","Type":"ContainerDied","Data":"5c2ef7ab4210af0c4d39e22223eea9d748b8934517911fd56bb8e6e75d148f1d"} Aug 02 10:34:23.262720 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:23.262585 2575 scope.go:117] "RemoveContainer" containerID="edd0c12d19c96d8e39a54ec23f1ffe40bd5aa31fe2853692e67d26363e357a21" Aug 02 10:34:23.275445 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:23.275422 2575 scope.go:117] "RemoveContainer" containerID="edd0c12d19c96d8e39a54ec23f1ffe40bd5aa31fe2853692e67d26363e357a21" Aug 02 10:34:23.275868 ip-10-0-142-118 kubenswrapper[2575]: E0802 10:34:23.275846 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edd0c12d19c96d8e39a54ec23f1ffe40bd5aa31fe2853692e67d26363e357a21\": container with ID starting with edd0c12d19c96d8e39a54ec23f1ffe40bd5aa31fe2853692e67d26363e357a21 not found: ID does not exist" containerID="edd0c12d19c96d8e39a54ec23f1ffe40bd5aa31fe2853692e67d26363e357a21" Aug 02 10:34:23.275954 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:23.275882 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edd0c12d19c96d8e39a54ec23f1ffe40bd5aa31fe2853692e67d26363e357a21"} err="failed to get container status \"edd0c12d19c96d8e39a54ec23f1ffe40bd5aa31fe2853692e67d26363e357a21\": rpc error: code = NotFound desc = could not find container \"edd0c12d19c96d8e39a54ec23f1ffe40bd5aa31fe2853692e67d26363e357a21\": container with ID starting with edd0c12d19c96d8e39a54ec23f1ffe40bd5aa31fe2853692e67d26363e357a21 not found: ID does not exist" Aug 02 10:34:23.286573 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:23.286548 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89"] Aug 02 10:34:23.291015 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:23.290991 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-80d516-75844945b-wgf89"] Aug 02 10:34:23.956696 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:23.956657 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88b65a69-a229-4007-bc38-3856d1f1bb17" path="/var/lib/kubelet/pods/88b65a69-a229-4007-bc38-3856d1f1bb17/volumes" Aug 02 10:34:23.957107 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:23.957063 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2797a8e-bde3-4770-9d75-aad1128ae788" path="/var/lib/kubelet/pods/f2797a8e-bde3-4770-9d75-aad1128ae788/volumes" Aug 02 10:34:32.668168 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.668131 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf"] Aug 02 10:34:32.668579 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.668566 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88b65a69-a229-4007-bc38-3856d1f1bb17" containerName="revoke-keys" Aug 02 10:34:32.668627 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.668580 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="88b65a69-a229-4007-bc38-3856d1f1bb17" containerName="revoke-keys" Aug 02 10:34:32.668627 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.668598 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2797a8e-bde3-4770-9d75-aad1128ae788" containerName="payload-processing" Aug 02 10:34:32.668627 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.668604 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2797a8e-bde3-4770-9d75-aad1128ae788" containerName="payload-processing" Aug 02 10:34:32.668718 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.668675 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="88b65a69-a229-4007-bc38-3856d1f1bb17" containerName="revoke-keys" Aug 02 10:34:32.668718 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.668685 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2797a8e-bde3-4770-9d75-aad1128ae788" containerName="payload-processing" Aug 02 10:34:32.671798 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.671768 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf" Aug 02 10:34:32.674293 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.674254 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 02 10:34:32.674441 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.674384 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7lxd\"" Aug 02 10:34:32.679448 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.679410 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf"] Aug 02 10:34:32.790295 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.790256 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db41d566-5f9c-4b53-b32a-b94b61d38b48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf\" (UID: \"db41d566-5f9c-4b53-b32a-b94b61d38b48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf" Aug 02 10:34:32.891290 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.891243 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db41d566-5f9c-4b53-b32a-b94b61d38b48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf\" (UID: \"db41d566-5f9c-4b53-b32a-b94b61d38b48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf" Aug 02 10:34:32.891989 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.891967 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db41d566-5f9c-4b53-b32a-b94b61d38b48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf\" (UID: \"db41d566-5f9c-4b53-b32a-b94b61d38b48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf" Aug 02 10:34:32.983798 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:32.983687 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf" Aug 02 10:34:33.336122 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:33.336095 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf"] Aug 02 10:34:33.338198 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:34:33.338168 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb41d566_5f9c_4b53_b32a_b94b61d38b48.slice/crio-2d935acd2699a28e50028895431a9834b6729e46069fdaba0eae24a4d14001a9 WatchSource:0}: Error finding container 2d935acd2699a28e50028895431a9834b6729e46069fdaba0eae24a4d14001a9: Status 404 returned error can't find the container with id 2d935acd2699a28e50028895431a9834b6729e46069fdaba0eae24a4d14001a9 Aug 02 10:34:34.335869 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:34.335831 2575 generic.go:356] "Generic (PLEG): container finished" podID="db41d566-5f9c-4b53-b32a-b94b61d38b48" containerID="fc5e52ade795f620ef3b1f63280f0a865711a3647098db45195ea98fbdf34295" exitCode=0 Aug 02 10:34:34.336299 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:34.335946 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf" event={"ID":"db41d566-5f9c-4b53-b32a-b94b61d38b48","Type":"ContainerDied","Data":"fc5e52ade795f620ef3b1f63280f0a865711a3647098db45195ea98fbdf34295"} Aug 02 10:34:34.336299 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:34.336023 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf" event={"ID":"db41d566-5f9c-4b53-b32a-b94b61d38b48","Type":"ContainerStarted","Data":"2d935acd2699a28e50028895431a9834b6729e46069fdaba0eae24a4d14001a9"} Aug 02 10:34:35.481952 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:35.481921 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf" Aug 02 10:34:35.617016 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:35.616918 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db41d566-5f9c-4b53-b32a-b94b61d38b48-maas-api-service-ca\") pod \"db41d566-5f9c-4b53-b32a-b94b61d38b48\" (UID: \"db41d566-5f9c-4b53-b32a-b94b61d38b48\") " Aug 02 10:34:35.617308 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:35.617283 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db41d566-5f9c-4b53-b32a-b94b61d38b48-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "db41d566-5f9c-4b53-b32a-b94b61d38b48" (UID: "db41d566-5f9c-4b53-b32a-b94b61d38b48"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:34:35.718123 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:35.718067 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db41d566-5f9c-4b53-b32a-b94b61d38b48-maas-api-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:34:36.349864 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:36.349834 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf" Aug 02 10:34:36.350054 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:36.349839 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf" event={"ID":"db41d566-5f9c-4b53-b32a-b94b61d38b48","Type":"ContainerDied","Data":"2d935acd2699a28e50028895431a9834b6729e46069fdaba0eae24a4d14001a9"} Aug 02 10:34:36.350054 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:36.349957 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d935acd2699a28e50028895431a9834b6729e46069fdaba0eae24a4d14001a9" Aug 02 10:34:48.319287 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:48.319237 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf"] Aug 02 10:34:48.321719 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:48.321694 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5c4717-nbmhf"] Aug 02 10:34:49.956972 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:34:49.956937 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db41d566-5f9c-4b53-b32a-b94b61d38b48" path="/var/lib/kubelet/pods/db41d566-5f9c-4b53-b32a-b94b61d38b48/volumes" Aug 02 10:35:36.580695 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:36.580592 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq"] Aug 02 10:35:36.581249 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:36.580884 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerName="istio-proxy" containerID="cri-o://110ee29c8c5957bfc3f603696679613c97e7ba804bc8403a944e163443fb20f7" gracePeriod=30 Aug 02 10:35:36.978669 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:36.978577 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp"] Aug 02 10:35:36.979058 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:36.979044 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db41d566-5f9c-4b53-b32a-b94b61d38b48" containerName="revoke-keys" Aug 02 10:35:36.979107 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:36.979059 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="db41d566-5f9c-4b53-b32a-b94b61d38b48" containerName="revoke-keys" Aug 02 10:35:36.979144 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:36.979131 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="db41d566-5f9c-4b53-b32a-b94b61d38b48" containerName="revoke-keys" Aug 02 10:35:36.982402 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:36.982383 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp" Aug 02 10:35:36.984879 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:36.984856 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 02 10:35:36.985009 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:36.984924 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7lxd\"" Aug 02 10:35:36.989489 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:36.989465 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp"] Aug 02 10:35:37.023667 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:37.023630 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa15c36-ceb2-450c-b127-2d4955bf0836-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp\" (UID: \"eaa15c36-ceb2-450c-b127-2d4955bf0836\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp" Aug 02 10:35:37.124434 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:37.124402 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa15c36-ceb2-450c-b127-2d4955bf0836-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp\" (UID: \"eaa15c36-ceb2-450c-b127-2d4955bf0836\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp" Aug 02 10:35:37.125084 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:37.125062 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa15c36-ceb2-450c-b127-2d4955bf0836-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp\" (UID: \"eaa15c36-ceb2-450c-b127-2d4955bf0836\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp" Aug 02 10:35:37.296215 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:37.296175 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp" Aug 02 10:35:37.448912 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:37.448886 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp"] Aug 02 10:35:37.451943 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:35:37.451906 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa15c36_ceb2_450c_b127_2d4955bf0836.slice/crio-5fa7cb9b0d940bae25a53aee69a07dac70fb4aaf35625a26b8c5010e26775694 WatchSource:0}: Error finding container 5fa7cb9b0d940bae25a53aee69a07dac70fb4aaf35625a26b8c5010e26775694: Status 404 returned error can't find the container with id 5fa7cb9b0d940bae25a53aee69a07dac70fb4aaf35625a26b8c5010e26775694 Aug 02 10:35:37.718300 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:37.718264 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp" event={"ID":"eaa15c36-ceb2-450c-b127-2d4955bf0836","Type":"ContainerStarted","Data":"5fa7cb9b0d940bae25a53aee69a07dac70fb4aaf35625a26b8c5010e26775694"} Aug 02 10:35:37.756240 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:37.756214 2575 patch_prober.go:28] interesting pod/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 02 10:35:37.756379 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:37.756269 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 02 10:35:38.726590 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:38.726551 2575 generic.go:356] "Generic (PLEG): container finished" podID="eaa15c36-ceb2-450c-b127-2d4955bf0836" containerID="4e8ddcd861c91cad04f3f40082c2c58c309b0b94a2d7d61ef4372d8a4b79faf9" exitCode=0 Aug 02 10:35:38.727047 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:38.726610 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp" event={"ID":"eaa15c36-ceb2-450c-b127-2d4955bf0836","Type":"ContainerDied","Data":"4e8ddcd861c91cad04f3f40082c2c58c309b0b94a2d7d61ef4372d8a4b79faf9"} Aug 02 10:35:39.889135 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:39.889107 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp" Aug 02 10:35:39.950734 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:39.950700 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa15c36-ceb2-450c-b127-2d4955bf0836-maas-api-service-ca\") pod \"eaa15c36-ceb2-450c-b127-2d4955bf0836\" (UID: \"eaa15c36-ceb2-450c-b127-2d4955bf0836\") " Aug 02 10:35:39.951044 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:39.951022 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaa15c36-ceb2-450c-b127-2d4955bf0836-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eaa15c36-ceb2-450c-b127-2d4955bf0836" (UID: "eaa15c36-ceb2-450c-b127-2d4955bf0836"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:35:40.052705 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:40.052671 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa15c36-ceb2-450c-b127-2d4955bf0836-maas-api-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:40.739886 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:40.739850 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp" Aug 02 10:35:40.739886 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:40.739861 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp" event={"ID":"eaa15c36-ceb2-450c-b127-2d4955bf0836","Type":"ContainerDied","Data":"5fa7cb9b0d940bae25a53aee69a07dac70fb4aaf35625a26b8c5010e26775694"} Aug 02 10:35:40.740108 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:40.739909 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fa7cb9b0d940bae25a53aee69a07dac70fb4aaf35625a26b8c5010e26775694" Aug 02 10:35:41.748175 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.748145 2575 generic.go:356] "Generic (PLEG): container finished" podID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerID="110ee29c8c5957bfc3f603696679613c97e7ba804bc8403a944e163443fb20f7" exitCode=0 Aug 02 10:35:41.748587 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.748221 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" event={"ID":"7b7b62a2-9c6c-423a-825f-fb44dbfe582f","Type":"ContainerDied","Data":"110ee29c8c5957bfc3f603696679613c97e7ba804bc8403a944e163443fb20f7"} Aug 02 10:35:41.748587 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.748298 2575 scope.go:117] "RemoveContainer" containerID="b8d8041afca34d257e4ffb21c82adcd2178c963902a5b025bb459dd9d22dcec1" Aug 02 10:35:41.849978 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.849915 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:35:41.871845 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.871806 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-credential-socket\") pod \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " Aug 02 10:35:41.871845 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.871846 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-workload-certs\") pod \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " Aug 02 10:35:41.872179 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.871871 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-envoy\") pod \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " Aug 02 10:35:41.872179 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.871938 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istiod-ca-cert\") pod \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " Aug 02 10:35:41.872179 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.871965 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-workload-socket\") pod \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " Aug 02 10:35:41.872179 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.871991 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-data\") pod \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " Aug 02 10:35:41.872179 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.872038 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncvqw\" (UniqueName: \"kubernetes.io/projected/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-kube-api-access-ncvqw\") pod \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " Aug 02 10:35:41.872179 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.872118 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-podinfo\") pod \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " Aug 02 10:35:41.873247 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.872194 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7b7b62a2-9c6c-423a-825f-fb44dbfe582f" (UID: "7b7b62a2-9c6c-423a-825f-fb44dbfe582f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:35:41.873247 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.872212 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7b7b62a2-9c6c-423a-825f-fb44dbfe582f" (UID: "7b7b62a2-9c6c-423a-825f-fb44dbfe582f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:35:41.873247 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.872414 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-data" (OuterVolumeSpecName: "istio-data") pod "7b7b62a2-9c6c-423a-825f-fb44dbfe582f" (UID: "7b7b62a2-9c6c-423a-825f-fb44dbfe582f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:35:41.873247 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.872528 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-token\") pod \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\" (UID: \"7b7b62a2-9c6c-423a-825f-fb44dbfe582f\") " Aug 02 10:35:41.873247 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.872653 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7b7b62a2-9c6c-423a-825f-fb44dbfe582f" (UID: "7b7b62a2-9c6c-423a-825f-fb44dbfe582f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:35:41.873247 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.872896 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7b7b62a2-9c6c-423a-825f-fb44dbfe582f" (UID: "7b7b62a2-9c6c-423a-825f-fb44dbfe582f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:35:41.873247 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.873087 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-credential-socket\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:41.873247 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.873106 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-workload-certs\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:41.873247 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.873118 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istiod-ca-cert\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:41.873247 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.873129 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-workload-socket\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:41.873247 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.873141 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-data\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:41.876649 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.875988 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7b7b62a2-9c6c-423a-825f-fb44dbfe582f" (UID: "7b7b62a2-9c6c-423a-825f-fb44dbfe582f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 02 10:35:41.876649 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.876101 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-token" (OuterVolumeSpecName: "istio-token") pod "7b7b62a2-9c6c-423a-825f-fb44dbfe582f" (UID: "7b7b62a2-9c6c-423a-825f-fb44dbfe582f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:35:41.876885 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.876752 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7b7b62a2-9c6c-423a-825f-fb44dbfe582f" (UID: "7b7b62a2-9c6c-423a-825f-fb44dbfe582f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:35:41.876885 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.876867 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-kube-api-access-ncvqw" (OuterVolumeSpecName: "kube-api-access-ncvqw") pod "7b7b62a2-9c6c-423a-825f-fb44dbfe582f" (UID: "7b7b62a2-9c6c-423a-825f-fb44dbfe582f"). InnerVolumeSpecName "kube-api-access-ncvqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:35:41.973927 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.973898 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-envoy\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:41.973927 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.973925 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncvqw\" (UniqueName: \"kubernetes.io/projected/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-kube-api-access-ncvqw\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:41.974110 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.973937 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-podinfo\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:41.974110 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:41.973946 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b7b62a2-9c6c-423a-825f-fb44dbfe582f-istio-token\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:42.756033 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:42.756001 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" Aug 02 10:35:42.756479 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:42.756035 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq" event={"ID":"7b7b62a2-9c6c-423a-825f-fb44dbfe582f","Type":"ContainerDied","Data":"bd76017be53facb38a3e45fd73c0a167f8af415cee1bf38ed91e7d14e03c67cd"} Aug 02 10:35:42.756479 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:42.756120 2575 scope.go:117] "RemoveContainer" containerID="110ee29c8c5957bfc3f603696679613c97e7ba804bc8403a944e163443fb20f7" Aug 02 10:35:42.774504 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:42.774473 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq"] Aug 02 10:35:42.777933 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:42.777909 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-5c4717-openshift-default-55d4ddbdd8-ljktq"] Aug 02 10:35:43.957809 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:43.957762 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" path="/var/lib/kubelet/pods/7b7b62a2-9c6c-423a-825f-fb44dbfe582f/volumes" Aug 02 10:35:47.458619 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.458585 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6"] Aug 02 10:35:47.459128 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.458811 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" podUID="3658e31e-ed80-41b3-a799-f6bb99509236" containerName="payload-processing" containerID="cri-o://7106def157161a552af9ebdd80168b3b24ed690e6629d27c3925170fd6b3d33e" gracePeriod=30 Aug 02 10:35:47.470088 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.470061 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r"] Aug 02 10:35:47.470611 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.470388 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" podUID="8700078e-a32e-4c88-994b-585b3e24934a" containerName="payload-pre-processing" containerID="cri-o://7362f78c9edd915f61629ae49a1b67a17019df2f4475915321010a17d3cfb1c5" gracePeriod=30 Aug 02 10:35:47.631850 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.631765 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp"] Aug 02 10:35:47.635188 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.635027 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c167c0-5mhmp"] Aug 02 10:35:47.728334 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.728310 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" Aug 02 10:35:47.762400 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.762376 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" Aug 02 10:35:47.793593 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.793556 2575 generic.go:356] "Generic (PLEG): container finished" podID="3658e31e-ed80-41b3-a799-f6bb99509236" containerID="7106def157161a552af9ebdd80168b3b24ed690e6629d27c3925170fd6b3d33e" exitCode=0 Aug 02 10:35:47.793805 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.793597 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" Aug 02 10:35:47.793805 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.793646 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" event={"ID":"3658e31e-ed80-41b3-a799-f6bb99509236","Type":"ContainerDied","Data":"7106def157161a552af9ebdd80168b3b24ed690e6629d27c3925170fd6b3d33e"} Aug 02 10:35:47.793805 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.793696 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6" event={"ID":"3658e31e-ed80-41b3-a799-f6bb99509236","Type":"ContainerDied","Data":"da73bc9de6c23ebb8f983e609abdef847659cf016b2e978e8eea1be1e6056ebf"} Aug 02 10:35:47.793805 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.793728 2575 scope.go:117] "RemoveContainer" containerID="7106def157161a552af9ebdd80168b3b24ed690e6629d27c3925170fd6b3d33e" Aug 02 10:35:47.795531 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.795478 2575 generic.go:356] "Generic (PLEG): container finished" podID="8700078e-a32e-4c88-994b-585b3e24934a" containerID="7362f78c9edd915f61629ae49a1b67a17019df2f4475915321010a17d3cfb1c5" exitCode=0 Aug 02 10:35:47.795663 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.795535 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" Aug 02 10:35:47.798149 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.795535 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" event={"ID":"8700078e-a32e-4c88-994b-585b3e24934a","Type":"ContainerDied","Data":"7362f78c9edd915f61629ae49a1b67a17019df2f4475915321010a17d3cfb1c5"} Aug 02 10:35:47.798149 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.796090 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r" event={"ID":"8700078e-a32e-4c88-994b-585b3e24934a","Type":"ContainerDied","Data":"043d14c20fc1a4c44cbdc4a8ddef1568c4ed7e7d10a3f63f91b116b1f650f2f6"} Aug 02 10:35:47.805913 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.805891 2575 scope.go:117] "RemoveContainer" containerID="7106def157161a552af9ebdd80168b3b24ed690e6629d27c3925170fd6b3d33e" Aug 02 10:35:47.806214 ip-10-0-142-118 kubenswrapper[2575]: E0802 10:35:47.806193 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7106def157161a552af9ebdd80168b3b24ed690e6629d27c3925170fd6b3d33e\": container with ID starting with 7106def157161a552af9ebdd80168b3b24ed690e6629d27c3925170fd6b3d33e not found: ID does not exist" containerID="7106def157161a552af9ebdd80168b3b24ed690e6629d27c3925170fd6b3d33e" Aug 02 10:35:47.806304 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.806225 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7106def157161a552af9ebdd80168b3b24ed690e6629d27c3925170fd6b3d33e"} err="failed to get container status \"7106def157161a552af9ebdd80168b3b24ed690e6629d27c3925170fd6b3d33e\": rpc error: code = NotFound desc = could not find container \"7106def157161a552af9ebdd80168b3b24ed690e6629d27c3925170fd6b3d33e\": container with ID starting with 7106def157161a552af9ebdd80168b3b24ed690e6629d27c3925170fd6b3d33e not found: ID does not exist" Aug 02 10:35:47.806304 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.806245 2575 scope.go:117] "RemoveContainer" containerID="7362f78c9edd915f61629ae49a1b67a17019df2f4475915321010a17d3cfb1c5" Aug 02 10:35:47.816813 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.816795 2575 scope.go:117] "RemoveContainer" containerID="7362f78c9edd915f61629ae49a1b67a17019df2f4475915321010a17d3cfb1c5" Aug 02 10:35:47.817059 ip-10-0-142-118 kubenswrapper[2575]: E0802 10:35:47.817040 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7362f78c9edd915f61629ae49a1b67a17019df2f4475915321010a17d3cfb1c5\": container with ID starting with 7362f78c9edd915f61629ae49a1b67a17019df2f4475915321010a17d3cfb1c5 not found: ID does not exist" containerID="7362f78c9edd915f61629ae49a1b67a17019df2f4475915321010a17d3cfb1c5" Aug 02 10:35:47.817125 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.817063 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7362f78c9edd915f61629ae49a1b67a17019df2f4475915321010a17d3cfb1c5"} err="failed to get container status \"7362f78c9edd915f61629ae49a1b67a17019df2f4475915321010a17d3cfb1c5\": rpc error: code = NotFound desc = could not find container \"7362f78c9edd915f61629ae49a1b67a17019df2f4475915321010a17d3cfb1c5\": container with ID starting with 7362f78c9edd915f61629ae49a1b67a17019df2f4475915321010a17d3cfb1c5 not found: ID does not exist" Aug 02 10:35:47.829605 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.829577 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxggj\" (UniqueName: \"kubernetes.io/projected/3658e31e-ed80-41b3-a799-f6bb99509236-kube-api-access-qxggj\") pod \"3658e31e-ed80-41b3-a799-f6bb99509236\" (UID: \"3658e31e-ed80-41b3-a799-f6bb99509236\") " Aug 02 10:35:47.829709 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.829645 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twr82\" (UniqueName: \"kubernetes.io/projected/8700078e-a32e-4c88-994b-585b3e24934a-kube-api-access-twr82\") pod \"8700078e-a32e-4c88-994b-585b3e24934a\" (UID: \"8700078e-a32e-4c88-994b-585b3e24934a\") " Aug 02 10:35:47.829709 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.829680 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8700078e-a32e-4c88-994b-585b3e24934a-plugins-config-volume\") pod \"8700078e-a32e-4c88-994b-585b3e24934a\" (UID: \"8700078e-a32e-4c88-994b-585b3e24934a\") " Aug 02 10:35:47.829861 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.829712 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3658e31e-ed80-41b3-a799-f6bb99509236-plugins-config-volume\") pod \"3658e31e-ed80-41b3-a799-f6bb99509236\" (UID: \"3658e31e-ed80-41b3-a799-f6bb99509236\") " Aug 02 10:35:47.830139 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.830100 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3658e31e-ed80-41b3-a799-f6bb99509236-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3658e31e-ed80-41b3-a799-f6bb99509236" (UID: "3658e31e-ed80-41b3-a799-f6bb99509236"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:35:47.830668 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.830632 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8700078e-a32e-4c88-994b-585b3e24934a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8700078e-a32e-4c88-994b-585b3e24934a" (UID: "8700078e-a32e-4c88-994b-585b3e24934a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:35:47.832239 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.832218 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8700078e-a32e-4c88-994b-585b3e24934a-kube-api-access-twr82" (OuterVolumeSpecName: "kube-api-access-twr82") pod "8700078e-a32e-4c88-994b-585b3e24934a" (UID: "8700078e-a32e-4c88-994b-585b3e24934a"). InnerVolumeSpecName "kube-api-access-twr82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:35:47.832348 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.832335 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3658e31e-ed80-41b3-a799-f6bb99509236-kube-api-access-qxggj" (OuterVolumeSpecName: "kube-api-access-qxggj") pod "3658e31e-ed80-41b3-a799-f6bb99509236" (UID: "3658e31e-ed80-41b3-a799-f6bb99509236"). InnerVolumeSpecName "kube-api-access-qxggj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:35:47.931275 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.931230 2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3658e31e-ed80-41b3-a799-f6bb99509236-plugins-config-volume\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:47.931275 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.931272 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxggj\" (UniqueName: \"kubernetes.io/projected/3658e31e-ed80-41b3-a799-f6bb99509236-kube-api-access-qxggj\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:47.931526 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.931287 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twr82\" (UniqueName: \"kubernetes.io/projected/8700078e-a32e-4c88-994b-585b3e24934a-kube-api-access-twr82\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:47.931526 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.931301 2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8700078e-a32e-4c88-994b-585b3e24934a-plugins-config-volume\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:47.957214 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:47.957182 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaa15c36-ceb2-450c-b127-2d4955bf0836" path="/var/lib/kubelet/pods/eaa15c36-ceb2-450c-b127-2d4955bf0836/volumes" Aug 02 10:35:48.110834 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:48.110791 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6"] Aug 02 10:35:48.114668 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:48.114639 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c167c0-57bbdbfd56-dnrs6"] Aug 02 10:35:48.124561 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:48.124533 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r"] Aug 02 10:35:48.127982 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:48.127956 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c167c0-778b585996-wsc4r"] Aug 02 10:35:49.956847 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:49.956805 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3658e31e-ed80-41b3-a799-f6bb99509236" path="/var/lib/kubelet/pods/3658e31e-ed80-41b3-a799-f6bb99509236/volumes" Aug 02 10:35:49.957389 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:49.957367 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8700078e-a32e-4c88-994b-585b3e24934a" path="/var/lib/kubelet/pods/8700078e-a32e-4c88-994b-585b3e24934a/volumes" Aug 02 10:35:54.766896 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.766854 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs"] Aug 02 10:35:54.767406 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.767250 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerName="istio-proxy" Aug 02 10:35:54.767406 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.767261 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerName="istio-proxy" Aug 02 10:35:54.767406 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.767273 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerName="istio-proxy" Aug 02 10:35:54.767406 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.767279 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerName="istio-proxy" Aug 02 10:35:54.767406 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.767284 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3658e31e-ed80-41b3-a799-f6bb99509236" containerName="payload-processing" Aug 02 10:35:54.767406 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.767291 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3658e31e-ed80-41b3-a799-f6bb99509236" containerName="payload-processing" Aug 02 10:35:54.767406 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.767300 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8700078e-a32e-4c88-994b-585b3e24934a" containerName="payload-pre-processing" Aug 02 10:35:54.767406 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.767305 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8700078e-a32e-4c88-994b-585b3e24934a" containerName="payload-pre-processing" Aug 02 10:35:54.767406 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.767324 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaa15c36-ceb2-450c-b127-2d4955bf0836" containerName="revoke-keys" Aug 02 10:35:54.767406 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.767329 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaa15c36-ceb2-450c-b127-2d4955bf0836" containerName="revoke-keys" Aug 02 10:35:54.767406 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.767390 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3658e31e-ed80-41b3-a799-f6bb99509236" containerName="payload-processing" Aug 02 10:35:54.767406 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.767398 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerName="istio-proxy" Aug 02 10:35:54.767406 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.767405 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8700078e-a32e-4c88-994b-585b3e24934a" containerName="payload-pre-processing" Aug 02 10:35:54.767406 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.767411 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaa15c36-ceb2-450c-b127-2d4955bf0836" containerName="revoke-keys" Aug 02 10:35:54.772148 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.772124 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs" Aug 02 10:35:54.774847 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.774814 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7lxd\"" Aug 02 10:35:54.774847 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.774830 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 02 10:35:54.777516 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.777490 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs"] Aug 02 10:35:54.899415 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:54.899373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc7e3e8-6b71-416c-afb9-5e4074b42124-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs\" (UID: \"0bc7e3e8-6b71-416c-afb9-5e4074b42124\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs" Aug 02 10:35:55.000769 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:55.000729 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc7e3e8-6b71-416c-afb9-5e4074b42124-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs\" (UID: \"0bc7e3e8-6b71-416c-afb9-5e4074b42124\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs" Aug 02 10:35:55.001411 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:55.001391 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc7e3e8-6b71-416c-afb9-5e4074b42124-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs\" (UID: \"0bc7e3e8-6b71-416c-afb9-5e4074b42124\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs" Aug 02 10:35:55.084386 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:55.084356 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs" Aug 02 10:35:55.226083 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:55.226056 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs"] Aug 02 10:35:55.228553 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:35:55.228522 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc7e3e8_6b71_416c_afb9_5e4074b42124.slice/crio-5bc9498f2ef02e15179bd6815447ff2d862991d5fd5c7b3b7bcbe92e5ac818f3 WatchSource:0}: Error finding container 5bc9498f2ef02e15179bd6815447ff2d862991d5fd5c7b3b7bcbe92e5ac818f3: Status 404 returned error can't find the container with id 5bc9498f2ef02e15179bd6815447ff2d862991d5fd5c7b3b7bcbe92e5ac818f3 Aug 02 10:35:55.848940 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:55.848902 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs" event={"ID":"0bc7e3e8-6b71-416c-afb9-5e4074b42124","Type":"ContainerStarted","Data":"7e43ad6a65d3fdd7b4cc524598aa4956acc16c09935c2d5a69c662c04f40525d"} Aug 02 10:35:55.849332 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:55.848957 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs" event={"ID":"0bc7e3e8-6b71-416c-afb9-5e4074b42124","Type":"ContainerStarted","Data":"5bc9498f2ef02e15179bd6815447ff2d862991d5fd5c7b3b7bcbe92e5ac818f3"} Aug 02 10:35:55.869388 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:55.869339 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs" podStartSLOduration=1.869323327 podStartE2EDuration="1.869323327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:35:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:35:55.866576026 +0000 UTC m=+3792.427731373" watchObservedRunningTime="2026-08-02 10:35:55.869323327 +0000 UTC m=+3792.430478700" Aug 02 10:35:56.856322 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:56.856286 2575 generic.go:356] "Generic (PLEG): container finished" podID="0bc7e3e8-6b71-416c-afb9-5e4074b42124" containerID="7e43ad6a65d3fdd7b4cc524598aa4956acc16c09935c2d5a69c662c04f40525d" exitCode=0 Aug 02 10:35:56.856725 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:56.856371 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs" event={"ID":"0bc7e3e8-6b71-416c-afb9-5e4074b42124","Type":"ContainerDied","Data":"7e43ad6a65d3fdd7b4cc524598aa4956acc16c09935c2d5a69c662c04f40525d"} Aug 02 10:35:57.998945 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:57.998914 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs" Aug 02 10:35:58.131999 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:58.131908 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc7e3e8-6b71-416c-afb9-5e4074b42124-maas-api-service-ca\") pod \"0bc7e3e8-6b71-416c-afb9-5e4074b42124\" (UID: \"0bc7e3e8-6b71-416c-afb9-5e4074b42124\") " Aug 02 10:35:58.132248 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:58.132227 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bc7e3e8-6b71-416c-afb9-5e4074b42124-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0bc7e3e8-6b71-416c-afb9-5e4074b42124" (UID: "0bc7e3e8-6b71-416c-afb9-5e4074b42124"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:35:58.233565 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:58.233531 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc7e3e8-6b71-416c-afb9-5e4074b42124-maas-api-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:35:58.868519 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:58.868484 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs" event={"ID":"0bc7e3e8-6b71-416c-afb9-5e4074b42124","Type":"ContainerDied","Data":"5bc9498f2ef02e15179bd6815447ff2d862991d5fd5c7b3b7bcbe92e5ac818f3"} Aug 02 10:35:58.868519 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:58.868510 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs" Aug 02 10:35:58.868737 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:35:58.868534 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bc9498f2ef02e15179bd6815447ff2d862991d5fd5c7b3b7bcbe92e5ac818f3" Aug 02 10:36:05.388696 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:05.388651 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs"] Aug 02 10:36:05.391349 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:05.391325 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e9225c-zs2xs"] Aug 02 10:36:05.956178 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:05.956140 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc7e3e8-6b71-416c-afb9-5e4074b42124" path="/var/lib/kubelet/pods/0bc7e3e8-6b71-416c-afb9-5e4074b42124/volumes" Aug 02 10:36:12.437588 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.437552 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw"] Aug 02 10:36:12.438165 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.438143 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc7e3e8-6b71-416c-afb9-5e4074b42124" containerName="revoke-keys" Aug 02 10:36:12.438253 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.438169 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc7e3e8-6b71-416c-afb9-5e4074b42124" containerName="revoke-keys" Aug 02 10:36:12.438320 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.438308 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc7e3e8-6b71-416c-afb9-5e4074b42124" containerName="revoke-keys" Aug 02 10:36:12.438375 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.438329 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b7b62a2-9c6c-423a-825f-fb44dbfe582f" containerName="istio-proxy" Aug 02 10:36:12.441812 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.441791 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw" Aug 02 10:36:12.444397 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.444369 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7lxd\"" Aug 02 10:36:12.444516 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.444398 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 02 10:36:12.449316 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.449080 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw"] Aug 02 10:36:12.578261 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.578223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ad951c-4c83-4909-964f-9a9420cad985-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw\" (UID: \"28ad951c-4c83-4909-964f-9a9420cad985\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw" Aug 02 10:36:12.679141 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.679104 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ad951c-4c83-4909-964f-9a9420cad985-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw\" (UID: \"28ad951c-4c83-4909-964f-9a9420cad985\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw" Aug 02 10:36:12.679724 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.679703 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ad951c-4c83-4909-964f-9a9420cad985-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw\" (UID: \"28ad951c-4c83-4909-964f-9a9420cad985\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw" Aug 02 10:36:12.757743 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.757651 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw" Aug 02 10:36:12.901530 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.901504 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw"] Aug 02 10:36:12.903206 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:36:12.903177 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ad951c_4c83_4909_964f_9a9420cad985.slice/crio-9216e49620738e11437ec5e20e0a9ce96c796554f753515ffd1b2d55375a8732 WatchSource:0}: Error finding container 9216e49620738e11437ec5e20e0a9ce96c796554f753515ffd1b2d55375a8732: Status 404 returned error can't find the container with id 9216e49620738e11437ec5e20e0a9ce96c796554f753515ffd1b2d55375a8732 Aug 02 10:36:12.956543 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:12.956511 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw" event={"ID":"28ad951c-4c83-4909-964f-9a9420cad985","Type":"ContainerStarted","Data":"9216e49620738e11437ec5e20e0a9ce96c796554f753515ffd1b2d55375a8732"} Aug 02 10:36:13.963458 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:13.963362 2575 generic.go:356] "Generic (PLEG): container finished" podID="28ad951c-4c83-4909-964f-9a9420cad985" containerID="3d4cb16de2d09dccde774f8ca55be02d5fe0ec1024035ddac2ff8173f3ca8328" exitCode=0 Aug 02 10:36:13.963458 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:13.963412 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw" event={"ID":"28ad951c-4c83-4909-964f-9a9420cad985","Type":"ContainerDied","Data":"3d4cb16de2d09dccde774f8ca55be02d5fe0ec1024035ddac2ff8173f3ca8328"} Aug 02 10:36:15.117510 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:15.117484 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw" Aug 02 10:36:15.198017 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:15.197982 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ad951c-4c83-4909-964f-9a9420cad985-maas-api-service-ca\") pod \"28ad951c-4c83-4909-964f-9a9420cad985\" (UID: \"28ad951c-4c83-4909-964f-9a9420cad985\") " Aug 02 10:36:15.198357 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:15.198334 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28ad951c-4c83-4909-964f-9a9420cad985-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "28ad951c-4c83-4909-964f-9a9420cad985" (UID: "28ad951c-4c83-4909-964f-9a9420cad985"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:36:15.298840 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:15.298766 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ad951c-4c83-4909-964f-9a9420cad985-maas-api-service-ca\") on node \"ip-10-0-142-118.ec2.internal\" DevicePath \"\"" Aug 02 10:36:15.976266 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:15.976241 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw" Aug 02 10:36:15.976397 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:15.976238 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw" event={"ID":"28ad951c-4c83-4909-964f-9a9420cad985","Type":"ContainerDied","Data":"9216e49620738e11437ec5e20e0a9ce96c796554f753515ffd1b2d55375a8732"} Aug 02 10:36:15.976397 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:15.976359 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9216e49620738e11437ec5e20e0a9ce96c796554f753515ffd1b2d55375a8732" Aug 02 10:36:23.085155 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:23.085114 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw"] Aug 02 10:36:23.089806 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:23.089753 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c6483-plfhw"] Aug 02 10:36:23.956211 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:23.956176 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28ad951c-4c83-4909-964f-9a9420cad985" path="/var/lib/kubelet/pods/28ad951c-4c83-4909-964f-9a9420cad985/volumes" Aug 02 10:36:36.093605 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:36.093576 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-57jwh_8f5dced0-4de3-46ea-a994-ec5ef53620e1/manager/0.log" Aug 02 10:36:36.213499 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:36.213454 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-z7hxh_b814331a-0f2b-40f8-b711-119d61b3e9c2/manager/0.log" Aug 02 10:36:36.332907 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:36.332874 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74bc9776f5-tddkm_b60d6ae5-dce6-42cb-89c3-0a11a811b77b/manager/0.log" Aug 02 10:36:36.445749 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:36.445668 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7kz4n_d5adcbcf-aaa5-4f96-b239-334e9e0f3553/server/0.log" Aug 02 10:36:36.565957 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:36.565927 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-g7xjz_378db9e4-56a1-4ac3-be87-370d6b9fda89/manager/0.log" Aug 02 10:36:36.936365 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:36.936338 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5694fb54d4-xfwht_57e67437-16bb-4d6b-a4ed-ef930e72751c/copy-manifests/0.log" Aug 02 10:36:36.943759 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:36.943736 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5694fb54d4-xfwht_57e67437-16bb-4d6b-a4ed-ef930e72751c/manager/0.log" Aug 02 10:36:38.313451 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:38.313419 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-8dfz2_e1de6967-02d4-4ff1-98c5-c65f58987570/manager/0.log" Aug 02 10:36:38.668083 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:38.668002 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-49m4d_a4c12eba-d002-44a4-87de-5d0b5dcb5b96/manager/0.log" Aug 02 10:36:38.908864 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:38.908835 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-hz52p_65b2f0b7-962b-45ec-b28b-a1463754234f/manager/0.log" Aug 02 10:36:39.265368 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:39.265336 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk_cc3134d2-6889-4696-8de8-7d8122473f7e/istio-proxy/0.log" Aug 02 10:36:39.620391 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:39.620365 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7569d6b956-v7w2z_c1c81e0e-dced-4292-a925-e41f4499c571/kube-auth-proxy/0.log" Aug 02 10:36:39.742053 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:39.742018 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jsv5k_3e718494-145f-4a96-94a8-ee30e6dde29b/istio-proxy/1.log" Aug 02 10:36:40.107966 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:40.107940 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68bf45c684-8lbrw_a2ee01dc-14aa-4625-8584-22a4d7c70dae/router/0.log" Aug 02 10:36:40.574254 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:40.574230 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qwl95_d3a2e70e-2402-4b60-9fc5-dc915777d2fe/main/0.log" Aug 02 10:36:40.687674 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:40.687650 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-d8v27_613126ea-bd5e-4888-80c1-3f6c859c433b/main/0.log" Aug 02 10:36:41.035519 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:41.035439 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-lh5zw_5948fb4f-fbd5-4572-853e-65faa3ea6c3c/main/0.log" Aug 02 10:36:46.560501 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.560466 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4kwt9/must-gather-dbwhm"] Aug 02 10:36:46.560953 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.560928 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28ad951c-4c83-4909-964f-9a9420cad985" containerName="revoke-keys" Aug 02 10:36:46.560953 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.560943 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="28ad951c-4c83-4909-964f-9a9420cad985" containerName="revoke-keys" Aug 02 10:36:46.561042 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.561024 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="28ad951c-4c83-4909-964f-9a9420cad985" containerName="revoke-keys" Aug 02 10:36:46.565760 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.565741 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4kwt9/must-gather-dbwhm" Aug 02 10:36:46.570033 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.570015 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4kwt9\"/\"kube-root-ca.crt\"" Aug 02 10:36:46.570177 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.570068 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4kwt9\"/\"default-dockercfg-97nlp\"" Aug 02 10:36:46.570637 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.570622 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4kwt9\"/\"openshift-service-ca.crt\"" Aug 02 10:36:46.577094 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.577070 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4kwt9/must-gather-dbwhm"] Aug 02 10:36:46.692070 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.692037 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e406fdc2-36aa-4c4d-aa46-d3786cca1362-must-gather-output\") pod \"must-gather-dbwhm\" (UID: \"e406fdc2-36aa-4c4d-aa46-d3786cca1362\") " pod="openshift-must-gather-4kwt9/must-gather-dbwhm" Aug 02 10:36:46.692268 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.692170 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpjpx\" (UniqueName: \"kubernetes.io/projected/e406fdc2-36aa-4c4d-aa46-d3786cca1362-kube-api-access-hpjpx\") pod \"must-gather-dbwhm\" (UID: \"e406fdc2-36aa-4c4d-aa46-d3786cca1362\") " pod="openshift-must-gather-4kwt9/must-gather-dbwhm" Aug 02 10:36:46.793157 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.793116 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e406fdc2-36aa-4c4d-aa46-d3786cca1362-must-gather-output\") pod \"must-gather-dbwhm\" (UID: \"e406fdc2-36aa-4c4d-aa46-d3786cca1362\") " pod="openshift-must-gather-4kwt9/must-gather-dbwhm" Aug 02 10:36:46.793372 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.793215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpjpx\" (UniqueName: \"kubernetes.io/projected/e406fdc2-36aa-4c4d-aa46-d3786cca1362-kube-api-access-hpjpx\") pod \"must-gather-dbwhm\" (UID: \"e406fdc2-36aa-4c4d-aa46-d3786cca1362\") " pod="openshift-must-gather-4kwt9/must-gather-dbwhm" Aug 02 10:36:46.793550 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.793524 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e406fdc2-36aa-4c4d-aa46-d3786cca1362-must-gather-output\") pod \"must-gather-dbwhm\" (UID: \"e406fdc2-36aa-4c4d-aa46-d3786cca1362\") " pod="openshift-must-gather-4kwt9/must-gather-dbwhm" Aug 02 10:36:46.802368 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.802334 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpjpx\" (UniqueName: \"kubernetes.io/projected/e406fdc2-36aa-4c4d-aa46-d3786cca1362-kube-api-access-hpjpx\") pod \"must-gather-dbwhm\" (UID: \"e406fdc2-36aa-4c4d-aa46-d3786cca1362\") " pod="openshift-must-gather-4kwt9/must-gather-dbwhm" Aug 02 10:36:46.875668 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:46.875579 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4kwt9/must-gather-dbwhm" Aug 02 10:36:47.016313 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:47.016283 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4kwt9/must-gather-dbwhm"] Aug 02 10:36:47.018051 ip-10-0-142-118 kubenswrapper[2575]: W0802 10:36:47.018024 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode406fdc2_36aa_4c4d_aa46_d3786cca1362.slice/crio-cb2857ef6dd11aa8808c9c05ae5b7c20a36e276fb53a5a8dc41365f143014d57 WatchSource:0}: Error finding container cb2857ef6dd11aa8808c9c05ae5b7c20a36e276fb53a5a8dc41365f143014d57: Status 404 returned error can't find the container with id cb2857ef6dd11aa8808c9c05ae5b7c20a36e276fb53a5a8dc41365f143014d57 Aug 02 10:36:47.020292 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:47.020276 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 02 10:36:47.171239 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:47.171146 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4kwt9/must-gather-dbwhm" event={"ID":"e406fdc2-36aa-4c4d-aa46-d3786cca1362","Type":"ContainerStarted","Data":"cb2857ef6dd11aa8808c9c05ae5b7c20a36e276fb53a5a8dc41365f143014d57"} Aug 02 10:36:48.181690 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:48.181590 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4kwt9/must-gather-dbwhm" event={"ID":"e406fdc2-36aa-4c4d-aa46-d3786cca1362","Type":"ContainerStarted","Data":"9d4935a2096d1e8ae981d933fb2e04706a2fe122b8c8087cc3e615e48ee427f2"} Aug 02 10:36:48.181690 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:48.181642 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4kwt9/must-gather-dbwhm" event={"ID":"e406fdc2-36aa-4c4d-aa46-d3786cca1362","Type":"ContainerStarted","Data":"acdd9b0e77880b2cc4f4b6917125d5eee1a96682be6acaa4623afddb7067468d"} Aug 02 10:36:48.200447 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:48.200389 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4kwt9/must-gather-dbwhm" podStartSLOduration=1.332258588 podStartE2EDuration="2.20037155s" totalImagesPullingTime="868.112962ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:36:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:36:48.197530016 +0000 UTC m=+3844.758685337" watchObservedRunningTime="2026-08-02 10:36:48.20037155 +0000 UTC m=+3844.761526921" Aug 02 10:36:49.509740 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:49.509704 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cfz4x_5ead495a-945d-4c39-954e-98e47d4976cf/global-pull-secret-syncer/0.log" Aug 02 10:36:49.704609 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:49.704573 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lfv22_bfa1c5f7-d982-410d-8f84-aa2cf646c6cd/konnectivity-agent/0.log" Aug 02 10:36:49.823736 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:49.823686 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-118.ec2.internal_b0db2a1efae079538404aaf0b49eb4e1/haproxy/0.log" Aug 02 10:36:55.110140 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:55.110065 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-8dfz2_e1de6967-02d4-4ff1-98c5-c65f58987570/manager/0.log" Aug 02 10:36:55.338268 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:55.338228 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-49m4d_a4c12eba-d002-44a4-87de-5d0b5dcb5b96/manager/0.log" Aug 02 10:36:55.465061 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:55.464977 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-hz52p_65b2f0b7-962b-45ec-b28b-a1463754234f/manager/0.log" Aug 02 10:36:57.246715 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:57.246631 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-bs6pm_b992edc6-b2fd-4c99-abae-418014dc3ee2/cluster-monitoring-operator/0.log" Aug 02 10:36:57.581375 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:57.581345 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9z5vs_9158ab6e-d442-446d-930c-2539387d774f/node-exporter/0.log" Aug 02 10:36:57.609314 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:57.609285 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9z5vs_9158ab6e-d442-446d-930c-2539387d774f/kube-rbac-proxy/0.log" Aug 02 10:36:57.636327 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:57.636298 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9z5vs_9158ab6e-d442-446d-930c-2539387d774f/init-textfile/0.log" Aug 02 10:36:59.386320 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.386291 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-7x6tp_bb3befea-d006-4ddb-a3b0-6ac4b6689fff/networking-console-plugin/0.log" Aug 02 10:36:59.803092 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.803053 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9"] Aug 02 10:36:59.810598 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.810561 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.816540 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.816501 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9"] Aug 02 10:36:59.835560 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.833868 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-podres\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.835560 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.833928 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-sys\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.835560 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.833956 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-lib-modules\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.835560 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.834010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzhxs\" (UniqueName: \"kubernetes.io/projected/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-kube-api-access-jzhxs\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.835560 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.834090 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-proc\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.935365 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.935317 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-sys\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.935693 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.935663 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-sys\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.935846 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.935695 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-lib-modules\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.935846 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.935790 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzhxs\" (UniqueName: \"kubernetes.io/projected/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-kube-api-access-jzhxs\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.935935 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.935870 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-lib-modules\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.935935 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.935881 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-proc\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.936006 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.935942 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-proc\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.936006 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.935960 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-podres\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.936106 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.936090 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-podres\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:36:59.945232 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:36:59.945174 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzhxs\" (UniqueName: \"kubernetes.io/projected/2f24d7a6-f9b4-45a1-88c9-40452a3986c5-kube-api-access-jzhxs\") pod \"perf-node-gather-daemonset-k74b9\" (UID: \"2f24d7a6-f9b4-45a1-88c9-40452a3986c5\") " pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:37:00.064620 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:00.064545 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/2.log" Aug 02 10:37:00.071617 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:00.071578 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-7rm2v_33c29a7d-6149-4136-ac38-82c7f44fb4e1/console-operator/3.log" Aug 02 10:37:00.125506 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:00.125451 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:37:00.318934 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:00.318844 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9"] Aug 02 10:37:00.653897 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:00.653799 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-647d6f769c-4bb67_2743b604-841a-46da-a3da-a0ddc7317a58/console/0.log" Aug 02 10:37:00.695578 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:00.695544 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-bhjh2_308d2130-6ee1-4575-8134-a154eca3edac/download-server/0.log" Aug 02 10:37:01.304300 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:01.304269 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" event={"ID":"2f24d7a6-f9b4-45a1-88c9-40452a3986c5","Type":"ContainerStarted","Data":"8ded1edecfa88e317f5e3a09c1174275c726eab849c132464d9cc070945c1c24"} Aug 02 10:37:01.304487 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:01.304325 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" event={"ID":"2f24d7a6-f9b4-45a1-88c9-40452a3986c5","Type":"ContainerStarted","Data":"f7435528e7b9f235b549f0889bd1fc2196408d003c42fab050d30a994475ea10"} Aug 02 10:37:01.304547 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:01.304493 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:37:01.313221 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:01.313198 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-mkpqg_87c64fe1-ab49-4ec4-84a5-07698b9f1070/volume-data-source-validator/0.log" Aug 02 10:37:01.322948 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:01.322898 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" podStartSLOduration=2.322881087 podStartE2EDuration="2.322881087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:36:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:37:01.320873344 +0000 UTC m=+3857.882028665" watchObservedRunningTime="2026-08-02 10:37:01.322881087 +0000 UTC m=+3857.884036453" Aug 02 10:37:02.460364 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:02.460334 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7wlgl_ed13e3aa-46af-43a9-8f01-3d84befb4b9a/dns/0.log" Aug 02 10:37:02.485009 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:02.484974 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7wlgl_ed13e3aa-46af-43a9-8f01-3d84befb4b9a/kube-rbac-proxy/0.log" Aug 02 10:37:02.573559 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:02.573528 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2rnlq_0a3a2b26-2590-4283-bc30-bff9b47feeb6/dns-node-resolver/0.log" Aug 02 10:37:03.208955 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:03.208894 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8cg55_a559e669-33cb-46af-b05a-24b0a9cd6b12/node-ca/0.log" Aug 02 10:37:04.243841 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:04.243806 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk_cc3134d2-6889-4696-8de8-7d8122473f7e/istio-proxy/0.log" Aug 02 10:37:04.618295 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:04.618262 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7569d6b956-v7w2z_c1c81e0e-dced-4292-a925-e41f4499c571/kube-auth-proxy/0.log" Aug 02 10:37:04.654650 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:04.654620 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jsv5k_3e718494-145f-4a96-94a8-ee30e6dde29b/istio-proxy/0.log" Aug 02 10:37:04.664251 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:04.664222 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jsv5k_3e718494-145f-4a96-94a8-ee30e6dde29b/istio-proxy/1.log" Aug 02 10:37:04.785905 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:04.785877 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68bf45c684-8lbrw_a2ee01dc-14aa-4625-8584-22a4d7c70dae/router/0.log" Aug 02 10:37:05.648697 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:05.648665 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jgcm2_981e1336-3fb3-4b90-87a1-94f963b6099b/serve-healthcheck-canary/0.log" Aug 02 10:37:06.192358 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:06.192272 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-rlxjx_0d2b40e4-a705-4d10-b565-a220c1d687c1/insights-operator/0.log" Aug 02 10:37:06.195172 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:06.195146 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-rlxjx_0d2b40e4-a705-4d10-b565-a220c1d687c1/insights-operator/1.log" Aug 02 10:37:06.300294 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:06.300262 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8zfrl_35bc561b-930b-4ed9-b2e8-55c13e48f507/kube-rbac-proxy/0.log" Aug 02 10:37:06.347731 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:06.347701 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8zfrl_35bc561b-930b-4ed9-b2e8-55c13e48f507/exporter/0.log" Aug 02 10:37:06.370392 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:06.370356 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8zfrl_35bc561b-930b-4ed9-b2e8-55c13e48f507/extractor/0.log" Aug 02 10:37:07.325545 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:07.325518 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4kwt9/perf-node-gather-daemonset-k74b9" Aug 02 10:37:08.766700 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:08.766672 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-57jwh_8f5dced0-4de3-46ea-a994-ec5ef53620e1/manager/0.log" Aug 02 10:37:09.118332 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:09.118293 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-z7hxh_b814331a-0f2b-40f8-b711-119d61b3e9c2/manager/0.log" Aug 02 10:37:09.352798 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:09.352574 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74bc9776f5-tddkm_b60d6ae5-dce6-42cb-89c3-0a11a811b77b/manager/0.log" Aug 02 10:37:09.376172 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:09.376145 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7kz4n_d5adcbcf-aaa5-4f96-b239-334e9e0f3553/server/0.log" Aug 02 10:37:09.469167 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:09.469122 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-g7xjz_378db9e4-56a1-4ac3-be87-370d6b9fda89/manager/0.log" Aug 02 10:37:09.759914 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:09.759883 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5694fb54d4-xfwht_57e67437-16bb-4d6b-a4ed-ef930e72751c/manager/0.log" Aug 02 10:37:09.785929 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:09.785902 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5694fb54d4-xfwht_57e67437-16bb-4d6b-a4ed-ef930e72751c/copy-manifests/0.log" Aug 02 10:37:10.572681 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:10.572645 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk_cc3134d2-6889-4696-8de8-7d8122473f7e/istio-proxy/0.log" Aug 02 10:37:10.903692 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:10.903612 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7569d6b956-v7w2z_c1c81e0e-dced-4292-a925-e41f4499c571/kube-auth-proxy/0.log" Aug 02 10:37:10.920848 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:10.920823 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jsv5k_3e718494-145f-4a96-94a8-ee30e6dde29b/istio-proxy/0.log" Aug 02 10:37:10.929662 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:10.929629 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jsv5k_3e718494-145f-4a96-94a8-ee30e6dde29b/istio-proxy/1.log" Aug 02 10:37:11.001874 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:11.001839 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68bf45c684-8lbrw_a2ee01dc-14aa-4625-8584-22a4d7c70dae/router/0.log" Aug 02 10:37:11.051460 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:11.051408 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-d6nhq_7f70c96a-dfae-4d42-ba6c-ecce707814c2/openshift-lws-operator/0.log" Aug 02 10:37:12.434640 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:12.434602 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-46zwk_cc3134d2-6889-4696-8de8-7d8122473f7e/istio-proxy/0.log" Aug 02 10:37:12.771374 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:12.771301 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7569d6b956-v7w2z_c1c81e0e-dced-4292-a925-e41f4499c571/kube-auth-proxy/0.log" Aug 02 10:37:12.790503 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:12.790456 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jsv5k_3e718494-145f-4a96-94a8-ee30e6dde29b/istio-proxy/0.log" Aug 02 10:37:12.799796 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:12.799759 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jsv5k_3e718494-145f-4a96-94a8-ee30e6dde29b/istio-proxy/1.log" Aug 02 10:37:12.899740 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:12.899709 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68bf45c684-8lbrw_a2ee01dc-14aa-4625-8584-22a4d7c70dae/router/0.log" Aug 02 10:37:16.243155 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:16.243116 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-z4qw4_fa55447b-4fc2-449e-bb96-ee0242bbef1e/migrator/0.log" Aug 02 10:37:16.264310 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:16.264284 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-z4qw4_fa55447b-4fc2-449e-bb96-ee0242bbef1e/graceful-termination/0.log" Aug 02 10:37:16.614095 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:16.614062 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-l248c_64209794-a5d5-4a29-82ef-bc6d8eecec0c/kube-storage-version-migrator-operator/1.log" Aug 02 10:37:16.615019 ip-10-0-142-118 kubenswrapper[2575]: I0802 10:37:16.614989 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-l248c_64209794-a5d5-4a29-82ef-bc6d8eecec0c/kube-storage-version-migrator-operator/0.log"