Jun 15 08:18:27.910964 ip-10-0-136-100 systemd[1]: Starting Kubernetes Kubelet... Jun 15 08:18:28.293206 ip-10-0-136-100 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 08:18:28.293206 ip-10-0-136-100 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 08:18:28.293206 ip-10-0-136-100 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 08:18:28.293206 ip-10-0-136-100 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 08:18:28.293206 ip-10-0-136-100 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 08:18:28.294488 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.294414 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 08:18:28.298684 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298669 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 08:18:28.298684 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298683 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298687 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298690 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298706 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298708 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298711 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298714 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298716 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298721 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298725 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298728 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298730 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298733 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298736 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298738 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298741 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298744 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298756 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298759 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 08:18:28.298760 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298762 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298764 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298767 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298770 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298773 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298775 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298778 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298781 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298783 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298785 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298788 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298790 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298793 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298795 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298797 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298801 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298804 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298807 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298810 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298813 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 08:18:28.299201 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298815 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298818 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298820 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298823 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298831 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298833 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298836 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298838 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298840 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298844 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298847 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298856 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298860 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298863 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298866 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298869 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298872 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298874 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298877 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298880 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 08:18:28.299733 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298882 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298884 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298887 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298889 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298893 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298895 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298897 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298900 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298902 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298905 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298907 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298909 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298912 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298914 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298917 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298919 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298922 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298924 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298926 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298929 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 08:18:28.300207 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298931 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298934 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298936 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298938 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298946 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298949 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298953 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298956 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298958 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298961 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298963 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298965 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298968 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298970 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298973 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298975 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298977 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298980 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 08:18:28.300677 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.298982 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 08:18:28.301271 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301257 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 08:18:28.301271 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301270 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301274 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301277 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301287 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301290 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301295 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301298 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301302 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301306 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301309 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301312 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301314 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301317 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301320 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301322 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301325 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301328 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301331 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301334 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 15 08:18:28.301326 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301337 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301339 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301342 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301344 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301347 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301349 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301352 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301354 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301357 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301359 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301361 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301364 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301366 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301369 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301371 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301374 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301376 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301379 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301389 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 08:18:28.301813 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301394 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301397 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301401 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301404 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301406 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301409 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301411 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301413 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301416 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301418 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301421 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301423 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301427 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301429 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301431 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301435 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301438 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301440 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301443 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301445 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 08:18:28.302277 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301448 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301450 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301453 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301455 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301458 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301460 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301463 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301465 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301468 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301470 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301473 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301475 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301478 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301480 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301483 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301485 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301487 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301490 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301492 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301495 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 08:18:28.302786 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301497 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301500 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301502 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301504 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301507 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301510 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301513 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301516 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301518 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301521 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301524 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301526 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301529 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301531 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301534 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301537 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301539 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301542 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301544 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301547 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 08:18:28.303287 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301912 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301916 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301919 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301922 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301925 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301927 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301930 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301933 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301936 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301939 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301941 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301944 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301946 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301948 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301951 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301953 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301956 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301958 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301961 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301964 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 08:18:28.303960 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301967 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301970 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301972 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301975 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301977 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301980 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301982 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301986 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301989 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301993 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301996 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.301999 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302001 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302004 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302007 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302011 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302013 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302016 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302019 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 08:18:28.304640 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302021 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302023 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302026 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302028 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302031 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302033 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302035 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302038 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302041 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302043 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302045 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302048 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302053 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302056 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302058 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302061 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302063 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302065 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302068 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302070 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 08:18:28.305133 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302073 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302075 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302077 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302080 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302083 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302085 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302087 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302090 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302092 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302095 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302097 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302099 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302102 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302105 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302107 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302110 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302112 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302114 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302117 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 08:18:28.305842 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302119 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302123 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302125 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302128 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302131 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302135 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302138 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302140 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302142 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302145 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302147 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302150 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302152 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302155 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302157 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302160 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302162 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302164 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302167 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302169 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 08:18:28.306330 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302172 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302247 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302257 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302267 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302274 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302279 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302284 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302291 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302295 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302298 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302300 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302304 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302307 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302310 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302313 2561 flags.go:64] FLAG: --cgroup-root="" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302315 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302318 2561 flags.go:64] FLAG: --client-ca-file="" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302322 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302325 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302329 2561 flags.go:64] FLAG: --cluster-domain="" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302332 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302334 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302337 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302340 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 08:18:28.306907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302344 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302346 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302349 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302352 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302355 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302357 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302360 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302363 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302365 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302369 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302372 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302374 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302377 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302380 2561 flags.go:64] FLAG: --enable-server="true" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302383 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302387 2561 flags.go:64] FLAG: --event-burst="100" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302390 2561 flags.go:64] FLAG: --event-qps="50" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302393 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302395 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302398 2561 flags.go:64] FLAG: --eviction-hard="" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302402 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302405 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302407 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302410 2561 flags.go:64] FLAG: --eviction-soft="" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302413 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 08:18:28.307518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302416 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302419 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302422 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302425 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302427 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302430 2561 flags.go:64] FLAG: --feature-gates="" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302434 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302436 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302439 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302442 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302445 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302448 2561 flags.go:64] FLAG: --help="false" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302450 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302453 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302456 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302459 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302462 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302465 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302468 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302470 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302473 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302476 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302479 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302482 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 08:18:28.308146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302484 2561 flags.go:64] FLAG: --kube-reserved="" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302487 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302490 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302492 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302495 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302497 2561 flags.go:64] FLAG: --lock-file="" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302500 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302503 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302505 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302510 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302513 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302516 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302518 2561 flags.go:64] FLAG: --logging-format="text" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302521 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302524 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302527 2561 flags.go:64] FLAG: --manifest-url="" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302529 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302533 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302536 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302539 2561 flags.go:64] FLAG: --max-pods="110" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302542 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302545 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302547 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302550 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302552 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 08:18:28.308781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302555 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302558 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302564 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302567 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302570 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302573 2561 flags.go:64] FLAG: --pod-cidr="" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302576 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302581 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302584 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302586 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302589 2561 flags.go:64] FLAG: --port="10250" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302592 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302595 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b63d9db23257aaf7" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302598 2561 flags.go:64] FLAG: --qos-reserved="" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302600 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302603 2561 flags.go:64] FLAG: --register-node="true" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302606 2561 flags.go:64] FLAG: --register-with-taints="" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302609 2561 flags.go:64] FLAG: --registry-burst="10" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302612 2561 flags.go:64] FLAG: --registry-qps="5" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302615 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302617 2561 flags.go:64] FLAG: --reserved-memory="" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302621 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302624 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302630 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302633 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 08:18:28.309401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302636 2561 flags.go:64] FLAG: --runonce="false" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302638 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302641 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302644 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302646 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302649 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302652 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302654 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302657 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302660 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302662 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302665 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302667 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302670 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302673 2561 flags.go:64] FLAG: --system-cgroups="" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302675 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302680 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302683 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302687 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302690 2561 flags.go:64] FLAG: --tls-min-version="" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302707 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302710 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302715 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302718 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302721 2561 flags.go:64] FLAG: --v="2" Jun 15 08:18:28.310026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302724 2561 flags.go:64] FLAG: --version="false" Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302728 2561 flags.go:64] FLAG: --vmodule="" Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302732 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.302735 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302842 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302846 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302849 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302852 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302855 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302857 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302860 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302863 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302866 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302868 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302871 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302874 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302878 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302881 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302883 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302886 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 08:18:28.310674 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302888 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302891 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302893 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302896 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302898 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302902 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302904 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302907 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302910 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302913 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302916 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302919 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302921 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302923 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302926 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302929 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302931 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302934 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302936 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302939 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 08:18:28.311198 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302941 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302944 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302946 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302949 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302951 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302954 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302956 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302959 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302961 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302963 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302966 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302969 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302972 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302974 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302976 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302979 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302981 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302985 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302988 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302990 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 08:18:28.311675 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302993 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302996 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.302998 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303001 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303003 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303005 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303008 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303010 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303013 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303015 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303018 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303020 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303022 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303025 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303027 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303030 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303032 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303035 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303037 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 08:18:28.312180 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303041 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303044 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303047 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303050 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303053 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303056 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303059 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303061 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303064 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303066 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303070 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303072 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303075 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303077 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303081 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303084 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303086 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303089 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303091 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 08:18:28.312637 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303093 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 08:18:28.313199 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303096 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 08:18:28.313199 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303098 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 08:18:28.313199 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303134 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 08:18:28.313199 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.303180 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 08:18:28.313199 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.305205 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 08:18:28.313199 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.312034 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 08:18:28.313199 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.312050 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 08:18:28.313199 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.312069 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 08:18:28.313199 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.312074 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 08:18:28.313199 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312126 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 08:18:28.313199 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312131 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 08:18:28.313199 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312134 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 08:18:28.313199 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312137 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 08:18:28.313199 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312141 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312145 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312148 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312151 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312154 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312156 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312159 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312161 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312164 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312167 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312170 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312172 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312175 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312177 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312180 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312182 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312185 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312188 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312190 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312193 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 08:18:28.313553 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312195 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312198 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312200 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312208 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312212 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312216 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312219 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312222 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312225 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312227 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312230 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312232 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312235 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312238 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312240 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312243 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312245 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312247 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312250 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312252 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 08:18:28.314051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312255 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312257 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312260 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312262 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312264 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312267 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312269 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312272 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312274 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312277 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312279 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312281 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312284 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312288 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312291 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312294 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312297 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312301 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312303 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312306 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 08:18:28.314537 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312309 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312311 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312313 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312316 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312318 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312321 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312323 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312326 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312328 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312331 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312333 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312336 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312338 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312340 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312343 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312345 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312348 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312350 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312353 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 08:18:28.315042 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312355 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312359 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312362 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312364 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312367 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312369 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312371 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312374 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312376 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312379 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312382 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312385 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312387 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312389 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312392 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 08:18:28.315510 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312394 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 08:18:28.315882 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.312399 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 08:18:28.315882 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312527 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 08:18:28.315882 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312532 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 08:18:28.315882 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312535 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 08:18:28.315882 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312538 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 08:18:28.315882 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312541 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 08:18:28.315882 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312543 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 08:18:28.315882 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312546 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 08:18:28.315882 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312549 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 08:18:28.315882 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312553 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 08:18:28.315882 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312556 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 08:18:28.315882 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312558 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 08:18:28.315882 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312561 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 08:18:28.315882 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312563 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312566 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312568 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312571 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312573 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312577 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312579 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312581 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312584 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312587 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312589 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312592 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312594 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312597 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312599 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312601 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312604 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312606 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312609 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312611 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 15 08:18:28.316234 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312613 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312616 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312618 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312620 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312623 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312625 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312629 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312632 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312635 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312638 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312641 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312644 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312647 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312651 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312653 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312656 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312658 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312661 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312664 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 08:18:28.316819 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312666 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312668 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312671 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312673 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312676 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312678 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312681 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312683 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312686 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312688 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312690 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312708 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312711 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312713 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312716 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312718 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312721 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312723 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312725 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312728 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 08:18:28.317276 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312730 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312733 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312735 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312738 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312740 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312742 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312745 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312747 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312750 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312752 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312755 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312757 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312760 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312762 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312765 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312767 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312770 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312772 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312775 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312777 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 08:18:28.317778 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312780 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 08:18:28.318244 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312782 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 08:18:28.318244 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312785 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 08:18:28.318244 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312787 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 08:18:28.318244 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312790 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 08:18:28.318244 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312792 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 08:18:28.318244 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312794 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 08:18:28.318244 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:28.312797 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 08:18:28.318244 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.312801 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 08:18:28.318244 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.312918 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 08:18:28.318244 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.315085 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 08:18:28.318244 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.316379 2561 server.go:1019] "Starting client certificate rotation" Jun 15 08:18:28.318244 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.316482 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 08:18:28.318244 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.316515 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 08:18:28.318890 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.318877 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 08:18:28.319955 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.319939 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 08:18:28.330116 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.330098 2561 log.go:25] "Validated CRI v1 runtime API" Jun 15 08:18:28.333816 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.333802 2561 log.go:25] "Validated CRI v1 image API" Jun 15 08:18:28.334557 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.334543 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 08:18:28.337001 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.336982 2561 fs.go:135] Filesystem UUIDs: map[278a1833-c4ad-43cc-be48-a40501b5ff9a:/dev/nvme0n1p3 49358c15-cf59-43ab-8cfb-b5df35169b77:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 15 08:18:28.337075 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.337001 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 08:18:28.342787 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.342652 2561 manager.go:216] Machine: {Timestamp:2026-06-15 08:18:28.341257881 +0000 UTC m=+0.315256467 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099582 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25423b42f8fd1b7c87a4ab3633ed86 SystemUUID:ec25423b-42f8-fd1b-7c87-a4ab3633ed86 BootID:8747bda4-d160-47da-a0f0-c8aad0fafad7 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ce:4d:d6:8d:5b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ce:4d:d6:8d:5b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:69:3a:18:c5:0b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 08:18:28.342787 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.342778 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 08:18:28.342958 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.342846 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 08:18:28.346193 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.346156 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 08:18:28.346351 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.346196 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-100.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 08:18:28.347377 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.347364 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 08:18:28.347444 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.347381 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 08:18:28.347444 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.347391 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 08:18:28.348181 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.348169 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 08:18:28.348986 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.348971 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 08:18:28.349413 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.349400 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 08:18:28.353201 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.353186 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 15 08:18:28.353485 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.353471 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 08:18:28.353556 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.353510 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 15 08:18:28.353556 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.353524 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 08:18:28.353556 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.353542 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 08:18:28.353556 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.353554 2561 kubelet.go:398] "Adding apiserver pod source" Jun 15 08:18:28.353726 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.353566 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 08:18:28.353927 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.353913 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 08:18:28.353986 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.353936 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 08:18:28.365749 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.365725 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 08:18:28.367139 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.367118 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 08:18:28.367199 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.367153 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 08:18:28.367309 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.367299 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 08:18:28.367340 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.367314 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 08:18:28.367340 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.367321 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 08:18:28.367340 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.367327 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 08:18:28.367340 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.367334 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 08:18:28.367340 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.367340 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 08:18:28.368533 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.368523 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 08:18:28.368533 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.368533 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 08:18:28.368606 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.368539 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 08:18:28.368606 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.368545 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 08:18:28.368606 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.368559 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 08:18:28.368606 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.368568 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 08:18:28.370065 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.370054 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 08:18:28.370065 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.370065 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 08:18:28.371892 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.371876 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-100.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 08:18:28.372352 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.372329 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 08:18:28.372432 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.372322 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 08:18:28.373391 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.373378 2561 server.go:1268] "Started kubelet" Jun 15 08:18:28.373465 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.373438 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 08:18:28.373845 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.373587 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 08:18:28.374009 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.373961 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 08:18:28.374337 ip-10-0-136-100 systemd[1]: Started Kubernetes Kubelet. Jun 15 08:18:28.375614 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.375601 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 15 08:18:28.380988 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.380968 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 08:18:28.383459 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.383436 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 08:18:28.387147 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.387128 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 08:18:28.387147 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.387145 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 08:18:28.387269 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.387205 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:28.387810 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.387792 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 08:18:28.387810 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.387796 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 08:18:28.387968 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.387821 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 08:18:28.387968 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.387944 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 15 08:18:28.387968 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.387968 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 15 08:18:28.388171 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.388157 2561 factory.go:55] Registering systemd factory Jun 15 08:18:28.388238 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.388174 2561 factory.go:223] Registration of the systemd container factory successfully Jun 15 08:18:28.388395 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.388376 2561 factory.go:153] Registering CRI-O factory Jun 15 08:18:28.388449 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.388397 2561 factory.go:223] Registration of the crio container factory successfully Jun 15 08:18:28.388449 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.388435 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 08:18:28.388549 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.388451 2561 factory.go:103] Registering Raw factory Jun 15 08:18:28.388549 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.388461 2561 manager.go:1196] Started watching for new ooms in manager Jun 15 08:18:28.388815 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.387324 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-100.ec2.internal.18b933472bdccff3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-100.ec2.internal,UID:ip-10-0-136-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-100.ec2.internal,},FirstTimestamp:2026-06-15 08:18:28.373327859 +0000 UTC m=+0.347326445,LastTimestamp:2026-06-15 08:18:28.373327859 +0000 UTC m=+0.347326445,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-100.ec2.internal,}" Jun 15 08:18:28.388922 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.388907 2561 manager.go:349] Starting recovery of all containers Jun 15 08:18:28.400441 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.399182 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 15 08:18:28.400441 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.399218 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 15 08:18:28.400946 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.400932 2561 manager.go:354] Recovery completed Jun 15 08:18:28.401892 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.401875 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fwjv7" Jun 15 08:18:28.404981 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.404969 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 08:18:28.406668 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.406654 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasSufficientMemory" Jun 15 08:18:28.406740 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.406681 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 08:18:28.406740 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.406706 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasSufficientPID" Jun 15 08:18:28.407206 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.407194 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 08:18:28.407258 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.407207 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 08:18:28.407258 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.407221 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 15 08:18:28.407258 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.407231 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 08:18:28.407934 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.407919 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasSufficientMemory" Jun 15 08:18:28.407996 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.407947 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 08:18:28.407996 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.407960 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasSufficientPID" Jun 15 08:18:28.409482 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.409414 2561 policy_none.go:49] "None policy: Start" Jun 15 08:18:28.409482 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.409430 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 08:18:28.409482 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.409440 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 08:18:28.410000 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.409984 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fwjv7" Jun 15 08:18:28.411346 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.411333 2561 policy_none.go:47] "Start" Jun 15 08:18:28.449836 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.449809 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.451018 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.451048 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.451068 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.451100 2561 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.452303 2561 manager.go:337] "Starting Device Plugin manager" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.452326 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.452335 2561 server.go:87] "Starting device plugin registration server" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.452825 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.452842 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.452924 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.453019 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.453026 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.453550 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.453589 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 08:18:28.463342 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.453690 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:28.552204 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.552158 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-100.ec2.internal"] Jun 15 08:18:28.552272 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.552224 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 08:18:28.553455 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.553441 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 08:18:28.553655 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.553638 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasSufficientMemory" Jun 15 08:18:28.553723 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.553673 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 08:18:28.553723 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.553710 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasSufficientPID" Jun 15 08:18:28.554182 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.554168 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasSufficientMemory" Jun 15 08:18:28.554241 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.554198 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 08:18:28.554241 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.554212 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasSufficientPID" Jun 15 08:18:28.554241 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.554229 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.556033 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.556018 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 08:18:28.556117 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.556104 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.556164 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.556131 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 08:18:28.556759 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.556744 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasSufficientMemory" Jun 15 08:18:28.556840 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.556769 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasSufficientMemory" Jun 15 08:18:28.556840 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.556779 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 08:18:28.556840 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.556786 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 08:18:28.556840 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.556797 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasSufficientPID" Jun 15 08:18:28.557021 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.556800 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasSufficientPID" Jun 15 08:18:28.558972 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.558956 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.559056 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.558986 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 08:18:28.559676 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.559657 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasSufficientMemory" Jun 15 08:18:28.559767 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.559688 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 08:18:28.559767 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.559715 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeHasSufficientPID" Jun 15 08:18:28.564122 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.564109 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.564188 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.564128 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-100.ec2.internal\": node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:28.585179 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.585163 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-100.ec2.internal\" not found" node="ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.589284 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.589267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/111deab622c10254868c38f037a73250-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal\" (UID: \"111deab622c10254868c38f037a73250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.589375 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.589290 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/111deab622c10254868c38f037a73250-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal\" (UID: \"111deab622c10254868c38f037a73250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.589375 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.589307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/961c229fb2596d0f0806043e4f238851-config\") pod \"kube-apiserver-proxy-ip-10-0-136-100.ec2.internal\" (UID: \"961c229fb2596d0f0806043e4f238851\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.589375 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.589323 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-100.ec2.internal\" not found" node="ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.605469 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.605446 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:28.689629 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.689605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/111deab622c10254868c38f037a73250-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal\" (UID: \"111deab622c10254868c38f037a73250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.689741 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.689640 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/111deab622c10254868c38f037a73250-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal\" (UID: \"111deab622c10254868c38f037a73250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.689741 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.689649 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/111deab622c10254868c38f037a73250-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal\" (UID: \"111deab622c10254868c38f037a73250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.689741 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.689665 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/961c229fb2596d0f0806043e4f238851-config\") pod \"kube-apiserver-proxy-ip-10-0-136-100.ec2.internal\" (UID: \"961c229fb2596d0f0806043e4f238851\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.689741 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.689711 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/111deab622c10254868c38f037a73250-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal\" (UID: \"111deab622c10254868c38f037a73250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.689741 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.689720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/961c229fb2596d0f0806043e4f238851-config\") pod \"kube-apiserver-proxy-ip-10-0-136-100.ec2.internal\" (UID: \"961c229fb2596d0f0806043e4f238851\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.705570 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.705547 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:28.806597 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.806547 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:28.886999 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.886975 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.893112 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:28.893095 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-100.ec2.internal" Jun 15 08:18:28.906756 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:28.906731 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:29.007147 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:29.007121 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:29.107635 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:29.107583 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:29.207649 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:29.207628 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:29.207787 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:29.207772 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 08:18:29.307998 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:29.307967 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:29.316142 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:29.316118 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 08:18:29.316270 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:29.316253 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 08:18:29.316307 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:29.316289 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 08:18:29.408860 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:29.408797 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:29.414956 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:29.414931 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 08:13:28 +0000 UTC" deadline="2028-01-04 14:36:02.657427628 +0000 UTC" Jun 15 08:18:29.415023 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:29.414957 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13638h17m33.242473697s" Jun 15 08:18:29.461641 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:29.461610 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961c229fb2596d0f0806043e4f238851.slice/crio-c124d3428483cf551efde9f34f4c5ea47a143253cd1f30a37784c9a85cc74844 WatchSource:0}: Error finding container c124d3428483cf551efde9f34f4c5ea47a143253cd1f30a37784c9a85cc74844: Status 404 returned error can't find the container with id c124d3428483cf551efde9f34f4c5ea47a143253cd1f30a37784c9a85cc74844 Jun 15 08:18:29.462224 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:29.462204 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111deab622c10254868c38f037a73250.slice/crio-acd634618e205f9a4d3ba14e9dc22eec2bb2d2b0faca59697bfc3406fe92b5eb WatchSource:0}: Error finding container acd634618e205f9a4d3ba14e9dc22eec2bb2d2b0faca59697bfc3406fe92b5eb: Status 404 returned error can't find the container with id acd634618e205f9a4d3ba14e9dc22eec2bb2d2b0faca59697bfc3406fe92b5eb Jun 15 08:18:29.467632 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:29.467617 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 08:18:29.509176 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:29.509142 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:29.609621 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:29.609593 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:29.710131 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:29.710110 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-100.ec2.internal\" not found" Jun 15 08:18:29.735336 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:29.735317 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 08:18:29.763055 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:29.763034 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 08:18:29.787929 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:29.787909 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-100.ec2.internal" Jun 15 08:18:29.796532 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:29.796516 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 08:18:29.797423 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:29.797411 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal" Jun 15 08:18:29.811793 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:29.811774 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 08:18:30.343045 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.343015 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 08:18:30.354982 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.354958 2561 apiserver.go:52] "Watching apiserver" Jun 15 08:18:30.364298 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.364279 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 08:18:30.365367 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.365339 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal","openshift-multus/multus-9tjq9","openshift-network-diagnostics/network-check-target-5r5rp","kube-system/kube-apiserver-proxy-ip-10-0-136-100.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf","openshift-cluster-node-tuning-operator/tuned-pf69m","openshift-multus/multus-additional-cni-plugins-5xhq5","openshift-multus/network-metrics-daemon-2jjfp","openshift-network-operator/iptables-alerter-t9m58","openshift-ovn-kubernetes/ovnkube-node-znqdf","kube-system/global-pull-secret-syncer-4kzkb","kube-system/konnectivity-agent-jwlm6","openshift-dns/node-resolver-mqbqb","openshift-image-registry/node-ca-h6rmt"] Jun 15 08:18:30.367815 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.367797 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.370060 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.370039 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mqbqb" Jun 15 08:18:30.371035 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.370625 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 08:18:30.371035 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.370870 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 08:18:30.371035 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.370880 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 08:18:30.371035 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.370905 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pgkj7\"" Jun 15 08:18:30.371035 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.370937 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 08:18:30.371753 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.371521 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 08:18:30.371753 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.371553 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 08:18:30.372471 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.372174 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f729b\"" Jun 15 08:18:30.372471 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.372199 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:30.372471 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:30.372314 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:30.372471 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.372374 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 08:18:30.374198 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.374103 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 08:18:30.376969 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.376950 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h6rmt" Jun 15 08:18:30.379474 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.379230 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.381419 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.381404 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.382526 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.382380 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 08:18:30.382762 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.382743 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 08:18:30.382854 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.382771 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 08:18:30.383011 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.382995 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 08:18:30.383092 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.383037 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 08:18:30.383245 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.383161 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l6cwt\"" Jun 15 08:18:30.383245 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.383210 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 08:18:30.383395 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.383379 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-brnwx\"" Jun 15 08:18:30.384170 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.384152 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 08:18:30.384254 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.384216 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r22r6\"" Jun 15 08:18:30.384921 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.384451 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 08:18:30.384921 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.384680 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t9m58" Jun 15 08:18:30.387047 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.387029 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zxvxt\"" Jun 15 08:18:30.387117 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.387076 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 08:18:30.387117 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.387101 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 08:18:30.387252 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.387239 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.387320 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.387306 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 08:18:30.387425 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.387413 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 08:18:30.389274 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.389258 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.391626 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.391609 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:30.391743 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:30.391668 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:30.391935 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.391920 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 08:18:30.392237 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.392223 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zp6dt\"" Jun 15 08:18:30.392415 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.392396 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 08:18:30.392490 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.392437 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 08:18:30.392490 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.392396 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 08:18:30.392801 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.392783 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 08:18:30.392922 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.392785 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 08:18:30.393018 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.392937 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-74nrm\"" Jun 15 08:18:30.393936 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.393919 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:30.394018 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:30.393986 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:30.396288 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.396271 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jwlm6" Jun 15 08:18:30.398266 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398248 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-multus-daemon-config\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.398354 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398278 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-etc-selinux\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.398354 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398301 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-var-lib-openvswitch\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.398354 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398326 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-run-ovn\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.398354 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crtjj\" (UniqueName: \"kubernetes.io/projected/4b02eb3e-079d-49a6-9a82-d5b195cde884-kube-api-access-crtjj\") pod \"node-resolver-mqbqb\" (UID: \"4b02eb3e-079d-49a6-9a82-d5b195cde884\") " pod="openshift-dns/node-resolver-mqbqb" Jun 15 08:18:30.398554 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398373 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-systemd\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.398554 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-run\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.398554 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398416 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqcq9\" (UniqueName: \"kubernetes.io/projected/386bccce-8950-49b9-8212-5d020ad05c81-kube-api-access-zqcq9\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.398554 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-run-systemd\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.398554 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cfa5f832-2b14-434b-823f-85bad4208214-ovnkube-config\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.398554 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398515 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-kubernetes\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.398554 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-host\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.398898 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-multus-socket-dir-parent\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.398898 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398592 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-multus-conf-dir\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.398898 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398604 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wf6pr\"" Jun 15 08:18:30.398898 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398624 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-etc-openvswitch\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.398898 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.398898 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5rvx\" (UniqueName: \"kubernetes.io/projected/68ad390e-25da-451c-a6d7-98c534317157-kube-api-access-l5rvx\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.399173 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.398986 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 08:18:30.399173 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399043 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 08:18:30.399271 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399199 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-modprobe-d\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.399271 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399226 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-device-dir\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.399271 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399249 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-sys\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.399460 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399270 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-os-release\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.399460 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399296 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-run-k8s-cni-cncf-io\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.399460 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399320 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-node-log\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.399460 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxlp2\" (UniqueName: \"kubernetes.io/projected/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-kube-api-access-rxlp2\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.399460 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399367 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-var-lib-cni-multus\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.399460 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399407 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cfa5f832-2b14-434b-823f-85bad4208214-ovn-node-metrics-cert\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.399460 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cfa5f832-2b14-434b-823f-85bad4208214-ovnkube-script-lib\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.399809 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b02eb3e-079d-49a6-9a82-d5b195cde884-tmp-dir\") pod \"node-resolver-mqbqb\" (UID: \"4b02eb3e-079d-49a6-9a82-d5b195cde884\") " pod="openshift-dns/node-resolver-mqbqb" Jun 15 08:18:30.399809 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399512 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eadd1131-282b-4043-9010-55772e805b18-host\") pod \"node-ca-h6rmt\" (UID: \"eadd1131-282b-4043-9010-55772e805b18\") " pod="openshift-image-registry/node-ca-h6rmt" Jun 15 08:18:30.399809 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399536 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-multus-cni-dir\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.399809 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399558 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-hostroot\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.399809 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399582 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7k9x\" (UniqueName: \"kubernetes.io/projected/eadd1131-282b-4043-9010-55772e805b18-kube-api-access-f7k9x\") pod \"node-ca-h6rmt\" (UID: \"eadd1131-282b-4043-9010-55772e805b18\") " pod="openshift-image-registry/node-ca-h6rmt" Jun 15 08:18:30.399809 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399605 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef5ef007-936a-4fbd-88eb-1501ce3d7784-host-slash\") pod \"iptables-alerter-t9m58\" (UID: \"ef5ef007-936a-4fbd-88eb-1501ce3d7784\") " pod="openshift-network-operator/iptables-alerter-t9m58" Jun 15 08:18:30.399809 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399628 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnhmc\" (UniqueName: \"kubernetes.io/projected/ef5ef007-936a-4fbd-88eb-1501ce3d7784-kube-api-access-cnhmc\") pod \"iptables-alerter-t9m58\" (UID: \"ef5ef007-936a-4fbd-88eb-1501ce3d7784\") " pod="openshift-network-operator/iptables-alerter-t9m58" Jun 15 08:18:30.399809 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399651 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-system-cni-dir\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.399809 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399677 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.399809 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399720 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-var-lib-cni-bin\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.399809 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-etc-kubernetes\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.399809 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399797 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-run-ovn-kubernetes\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399822 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-sys-fs\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399839 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-var-lib-kubelet\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399882 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-run-netns\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399896 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-run-multus-certs\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-run-netns\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399935 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cfa5f832-2b14-434b-823f-85bad4208214-env-overrides\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399955 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/386bccce-8950-49b9-8212-5d020ad05c81-etc-tuned\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-cnibin\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.399983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400003 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-var-lib-kubelet\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-kubelet\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400052 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-socket-dir\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400068 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b02eb3e-079d-49a6-9a82-d5b195cde884-hosts-file\") pod \"node-resolver-mqbqb\" (UID: \"4b02eb3e-079d-49a6-9a82-d5b195cde884\") " pod="openshift-dns/node-resolver-mqbqb" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400088 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9lcn\" (UniqueName: \"kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn\") pod \"network-check-target-5r5rp\" (UID: \"da17723e-7133-4840-9c86-e3cbb8698c18\") " pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400102 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-sysctl-d\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.400200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400135 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-cnibin\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400165 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmnhr\" (UniqueName: \"kubernetes.io/projected/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-kube-api-access-dmnhr\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-systemd-units\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400240 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-registration-dir\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400266 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-lib-modules\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400287 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/386bccce-8950-49b9-8212-5d020ad05c81-tmp\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-slash\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400338 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-run-openvswitch\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-log-socket\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-sysconfig\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400407 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-cni-binary-copy\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400454 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-os-release\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-cni-binary-copy\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400507 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-cni-bin\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400529 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-cni-netd\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400570 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl59g\" (UniqueName: \"kubernetes.io/projected/cfa5f832-2b14-434b-823f-85bad4208214-kube-api-access-rl59g\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.400875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400610 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eadd1131-282b-4043-9010-55772e805b18-serviceca\") pod \"node-ca-h6rmt\" (UID: \"eadd1131-282b-4043-9010-55772e805b18\") " pod="openshift-image-registry/node-ca-h6rmt" Jun 15 08:18:30.401603 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400635 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-sysctl-conf\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.401603 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400666 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.401603 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400709 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef5ef007-936a-4fbd-88eb-1501ce3d7784-iptables-alerter-script\") pod \"iptables-alerter-t9m58\" (UID: \"ef5ef007-936a-4fbd-88eb-1501ce3d7784\") " pod="openshift-network-operator/iptables-alerter-t9m58" Jun 15 08:18:30.401603 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.400733 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-system-cni-dir\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.404930 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.404912 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 08:18:30.445649 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.445626 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pnqn6" Jun 15 08:18:30.455473 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.455423 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-100.ec2.internal" event={"ID":"961c229fb2596d0f0806043e4f238851","Type":"ContainerStarted","Data":"c124d3428483cf551efde9f34f4c5ea47a143253cd1f30a37784c9a85cc74844"} Jun 15 08:18:30.456639 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.456618 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal" event={"ID":"111deab622c10254868c38f037a73250","Type":"ContainerStarted","Data":"acd634618e205f9a4d3ba14e9dc22eec2bb2d2b0faca59697bfc3406fe92b5eb"} Jun 15 08:18:30.462600 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.462580 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pnqn6" Jun 15 08:18:30.488834 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.488815 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 08:18:30.501931 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.501907 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmnhr\" (UniqueName: \"kubernetes.io/projected/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-kube-api-access-dmnhr\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.502030 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.501945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-systemd-units\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.502030 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.501968 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-registration-dir\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.502030 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.501994 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-lib-modules\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.502194 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502139 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-lib-modules\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.502194 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502187 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-systemd-units\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.502278 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502199 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/386bccce-8950-49b9-8212-5d020ad05c81-tmp\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.502278 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502233 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-registration-dir\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.502278 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502263 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-slash\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.502278 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-slash\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.502389 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502287 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-run-openvswitch\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.502389 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-log-socket\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.502389 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502318 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:30.502389 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502334 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-sysconfig\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.502389 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502349 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-cni-binary-copy\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.502389 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502363 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-os-release\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.502389 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502377 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-cni-binary-copy\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.502613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502391 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-cni-bin\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.502613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502406 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-cni-netd\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.502613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502420 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl59g\" (UniqueName: \"kubernetes.io/projected/cfa5f832-2b14-434b-823f-85bad4208214-kube-api-access-rl59g\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.502613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502438 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrgch\" (UniqueName: \"kubernetes.io/projected/389f130c-a632-48ff-918c-c25c25daab40-kube-api-access-hrgch\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:30.502613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eadd1131-282b-4043-9010-55772e805b18-serviceca\") pod \"node-ca-h6rmt\" (UID: \"eadd1131-282b-4043-9010-55772e805b18\") " pod="openshift-image-registry/node-ca-h6rmt" Jun 15 08:18:30.502613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502464 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 08:18:30.502613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-sysctl-conf\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.502613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.502613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502535 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef5ef007-936a-4fbd-88eb-1501ce3d7784-iptables-alerter-script\") pod \"iptables-alerter-t9m58\" (UID: \"ef5ef007-936a-4fbd-88eb-1501ce3d7784\") " pod="openshift-network-operator/iptables-alerter-t9m58" Jun 15 08:18:30.502613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502551 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-system-cni-dir\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.502613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-multus-daemon-config\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.502613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502579 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-etc-selinux\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.502613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-var-lib-openvswitch\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.502613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502609 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-run-ovn\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.503293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502640 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crtjj\" (UniqueName: \"kubernetes.io/projected/4b02eb3e-079d-49a6-9a82-d5b195cde884-kube-api-access-crtjj\") pod \"node-resolver-mqbqb\" (UID: \"4b02eb3e-079d-49a6-9a82-d5b195cde884\") " pod="openshift-dns/node-resolver-mqbqb" Jun 15 08:18:30.503293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-systemd\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.503293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502678 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-run\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.503293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502711 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqcq9\" (UniqueName: \"kubernetes.io/projected/386bccce-8950-49b9-8212-5d020ad05c81-kube-api-access-zqcq9\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.503293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-run-systemd\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.503293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502787 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-run-ovn\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.503293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502785 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cfa5f832-2b14-434b-823f-85bad4208214-ovnkube-config\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.503293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502801 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.503293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502819 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-systemd\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.503293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502868 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-sysctl-conf\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.503293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502953 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-run-openvswitch\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.503293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503006 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-log-socket\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.503293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503063 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-sysconfig\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.503293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503222 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-run\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503498 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cfa5f832-2b14-434b-823f-85bad4208214-ovnkube-config\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503505 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef5ef007-936a-4fbd-88eb-1501ce3d7784-iptables-alerter-script\") pod \"iptables-alerter-t9m58\" (UID: \"ef5ef007-936a-4fbd-88eb-1501ce3d7784\") " pod="openshift-network-operator/iptables-alerter-t9m58" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503511 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eadd1131-282b-4043-9010-55772e805b18-serviceca\") pod \"node-ca-h6rmt\" (UID: \"eadd1131-282b-4043-9010-55772e805b18\") " pod="openshift-image-registry/node-ca-h6rmt" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503525 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-kubelet-config\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503498 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-multus-daemon-config\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-kubernetes\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503587 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-host\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503602 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-run-systemd\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.502760 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-system-cni-dir\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-multus-socket-dir-parent\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503640 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-etc-selinux\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503645 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-multus-conf-dir\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503665 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-multus-socket-dir-parent\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503674 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-multus-conf-dir\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503676 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-cni-binary-copy\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503713 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-etc-openvswitch\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503659 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-cni-binary-copy\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.503962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503737 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-kubernetes\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503767 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-var-lib-openvswitch\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503770 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-host\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-dbus\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503801 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-os-release\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45807f4c-3dcb-40ff-9897-e46c5d48fd15-agent-certs\") pod \"konnectivity-agent-jwlm6\" (UID: \"45807f4c-3dcb-40ff-9897-e46c5d48fd15\") " pod="kube-system/konnectivity-agent-jwlm6" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503835 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-etc-openvswitch\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503839 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-cni-bin\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503869 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503866 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-cni-netd\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503896 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5rvx\" (UniqueName: \"kubernetes.io/projected/68ad390e-25da-451c-a6d7-98c534317157-kube-api-access-l5rvx\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503926 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.503961 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-modprobe-d\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504004 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45807f4c-3dcb-40ff-9897-e46c5d48fd15-konnectivity-ca\") pod \"konnectivity-agent-jwlm6\" (UID: \"45807f4c-3dcb-40ff-9897-e46c5d48fd15\") " pod="kube-system/konnectivity-agent-jwlm6" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504035 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-device-dir\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504057 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-sys\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504066 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-modprobe-d\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.504747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504079 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-os-release\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504105 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-run-k8s-cni-cncf-io\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504109 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-device-dir\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504130 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504149 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-run-k8s-cni-cncf-io\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504152 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-sys\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504164 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-os-release\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-node-log\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504198 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-node-log\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504237 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxlp2\" (UniqueName: \"kubernetes.io/projected/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-kube-api-access-rxlp2\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-var-lib-cni-multus\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504298 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cfa5f832-2b14-434b-823f-85bad4208214-ovn-node-metrics-cert\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cfa5f832-2b14-434b-823f-85bad4208214-ovnkube-script-lib\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504345 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b02eb3e-079d-49a6-9a82-d5b195cde884-tmp-dir\") pod \"node-resolver-mqbqb\" (UID: \"4b02eb3e-079d-49a6-9a82-d5b195cde884\") " pod="openshift-dns/node-resolver-mqbqb" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eadd1131-282b-4043-9010-55772e805b18-host\") pod \"node-ca-h6rmt\" (UID: \"eadd1131-282b-4043-9010-55772e805b18\") " pod="openshift-image-registry/node-ca-h6rmt" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504367 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-var-lib-cni-multus\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504426 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eadd1131-282b-4043-9010-55772e805b18-host\") pod \"node-ca-h6rmt\" (UID: \"eadd1131-282b-4043-9010-55772e805b18\") " pod="openshift-image-registry/node-ca-h6rmt" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-multus-cni-dir\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.505648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504480 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-hostroot\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7k9x\" (UniqueName: \"kubernetes.io/projected/eadd1131-282b-4043-9010-55772e805b18-kube-api-access-f7k9x\") pod \"node-ca-h6rmt\" (UID: \"eadd1131-282b-4043-9010-55772e805b18\") " pod="openshift-image-registry/node-ca-h6rmt" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504524 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef5ef007-936a-4fbd-88eb-1501ce3d7784-host-slash\") pod \"iptables-alerter-t9m58\" (UID: \"ef5ef007-936a-4fbd-88eb-1501ce3d7784\") " pod="openshift-network-operator/iptables-alerter-t9m58" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504545 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnhmc\" (UniqueName: \"kubernetes.io/projected/ef5ef007-936a-4fbd-88eb-1501ce3d7784-kube-api-access-cnhmc\") pod \"iptables-alerter-t9m58\" (UID: \"ef5ef007-936a-4fbd-88eb-1501ce3d7784\") " pod="openshift-network-operator/iptables-alerter-t9m58" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504577 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-system-cni-dir\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-var-lib-cni-bin\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504643 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b02eb3e-079d-49a6-9a82-d5b195cde884-tmp-dir\") pod \"node-resolver-mqbqb\" (UID: \"4b02eb3e-079d-49a6-9a82-d5b195cde884\") " pod="openshift-dns/node-resolver-mqbqb" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504650 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-etc-kubernetes\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504674 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-run-ovn-kubernetes\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504713 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-multus-cni-dir\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-sys-fs\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504726 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef5ef007-936a-4fbd-88eb-1501ce3d7784-host-slash\") pod \"iptables-alerter-t9m58\" (UID: \"ef5ef007-936a-4fbd-88eb-1501ce3d7784\") " pod="openshift-network-operator/iptables-alerter-t9m58" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504769 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-etc-kubernetes\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504774 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-hostroot\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504790 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-run-ovn-kubernetes\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504844 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-system-cni-dir\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.506243 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504876 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cfa5f832-2b14-434b-823f-85bad4208214-ovnkube-script-lib\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504885 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-var-lib-cni-bin\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-var-lib-kubelet\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504938 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-sys-fs\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-run-netns\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504973 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-run-multus-certs\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504988 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-var-lib-kubelet\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.504997 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-run-netns\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505000 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-run-netns\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505022 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cfa5f832-2b14-434b-823f-85bad4208214-env-overrides\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505050 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/386bccce-8950-49b9-8212-5d020ad05c81-etc-tuned\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505037 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-run-netns\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-cnibin\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505185 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505193 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-run-multus-certs\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505209 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-var-lib-kubelet\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505218 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.506872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505238 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-kubelet\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505251 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-cnibin\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505289 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-socket-dir\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505305 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfa5f832-2b14-434b-823f-85bad4208214-host-kubelet\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505330 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b02eb3e-079d-49a6-9a82-d5b195cde884-hosts-file\") pod \"node-resolver-mqbqb\" (UID: \"4b02eb3e-079d-49a6-9a82-d5b195cde884\") " pod="openshift-dns/node-resolver-mqbqb" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9lcn\" (UniqueName: \"kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn\") pod \"network-check-target-5r5rp\" (UID: \"da17723e-7133-4840-9c86-e3cbb8698c18\") " pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505381 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-sysctl-d\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505405 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505411 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68ad390e-25da-451c-a6d7-98c534317157-socket-dir\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505430 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cfa5f832-2b14-434b-823f-85bad4208214-env-overrides\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-cnibin\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505513 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/386bccce-8950-49b9-8212-5d020ad05c81-etc-sysctl-d\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505290 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-host-var-lib-kubelet\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505540 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-cnibin\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505591 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b02eb3e-079d-49a6-9a82-d5b195cde884-hosts-file\") pod \"node-resolver-mqbqb\" (UID: \"4b02eb3e-079d-49a6-9a82-d5b195cde884\") " pod="openshift-dns/node-resolver-mqbqb" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505606 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.505778 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.507343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.506886 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cfa5f832-2b14-434b-823f-85bad4208214-ovn-node-metrics-cert\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.507933 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.507270 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/386bccce-8950-49b9-8212-5d020ad05c81-etc-tuned\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.507933 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.507805 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/386bccce-8950-49b9-8212-5d020ad05c81-tmp\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.514615 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:30.514590 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 08:18:30.514768 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:30.514620 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 08:18:30.514768 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:30.514634 2561 projected.go:196] Error preparing data for projected volume kube-api-access-x9lcn for pod openshift-network-diagnostics/network-check-target-5r5rp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:30.514768 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:30.514725 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn podName:da17723e-7133-4840-9c86-e3cbb8698c18 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:31.014681345 +0000 UTC m=+2.988679922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x9lcn" (UniqueName: "kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn") pod "network-check-target-5r5rp" (UID: "da17723e-7133-4840-9c86-e3cbb8698c18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:30.515424 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.515396 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crtjj\" (UniqueName: \"kubernetes.io/projected/4b02eb3e-079d-49a6-9a82-d5b195cde884-kube-api-access-crtjj\") pod \"node-resolver-mqbqb\" (UID: \"4b02eb3e-079d-49a6-9a82-d5b195cde884\") " pod="openshift-dns/node-resolver-mqbqb" Jun 15 08:18:30.516360 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.516303 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl59g\" (UniqueName: \"kubernetes.io/projected/cfa5f832-2b14-434b-823f-85bad4208214-kube-api-access-rl59g\") pod \"ovnkube-node-znqdf\" (UID: \"cfa5f832-2b14-434b-823f-85bad4208214\") " pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.516782 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.516727 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmnhr\" (UniqueName: \"kubernetes.io/projected/7a01daa3-6810-470f-a0d1-7801e1ee4aa5-kube-api-access-dmnhr\") pod \"multus-9tjq9\" (UID: \"7a01daa3-6810-470f-a0d1-7801e1ee4aa5\") " pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.517481 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.517407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnhmc\" (UniqueName: \"kubernetes.io/projected/ef5ef007-936a-4fbd-88eb-1501ce3d7784-kube-api-access-cnhmc\") pod \"iptables-alerter-t9m58\" (UID: \"ef5ef007-936a-4fbd-88eb-1501ce3d7784\") " pod="openshift-network-operator/iptables-alerter-t9m58" Jun 15 08:18:30.518129 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.518074 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5rvx\" (UniqueName: \"kubernetes.io/projected/68ad390e-25da-451c-a6d7-98c534317157-kube-api-access-l5rvx\") pod \"aws-ebs-csi-driver-node-dl5zf\" (UID: \"68ad390e-25da-451c-a6d7-98c534317157\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.518789 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.518766 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7k9x\" (UniqueName: \"kubernetes.io/projected/eadd1131-282b-4043-9010-55772e805b18-kube-api-access-f7k9x\") pod \"node-ca-h6rmt\" (UID: \"eadd1131-282b-4043-9010-55772e805b18\") " pod="openshift-image-registry/node-ca-h6rmt" Jun 15 08:18:30.519275 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.519254 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxlp2\" (UniqueName: \"kubernetes.io/projected/3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38-kube-api-access-rxlp2\") pod \"multus-additional-cni-plugins-5xhq5\" (UID: \"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38\") " pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.520588 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.520570 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqcq9\" (UniqueName: \"kubernetes.io/projected/386bccce-8950-49b9-8212-5d020ad05c81-kube-api-access-zqcq9\") pod \"tuned-pf69m\" (UID: \"386bccce-8950-49b9-8212-5d020ad05c81\") " pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.606649 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.606579 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:30.606649 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.606621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrgch\" (UniqueName: \"kubernetes.io/projected/389f130c-a632-48ff-918c-c25c25daab40-kube-api-access-hrgch\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:30.606848 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.606655 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-kubelet-config\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:30.606848 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.606683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-dbus\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:30.606848 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.606726 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45807f4c-3dcb-40ff-9897-e46c5d48fd15-agent-certs\") pod \"konnectivity-agent-jwlm6\" (UID: \"45807f4c-3dcb-40ff-9897-e46c5d48fd15\") " pod="kube-system/konnectivity-agent-jwlm6" Jun 15 08:18:30.606848 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.606753 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45807f4c-3dcb-40ff-9897-e46c5d48fd15-konnectivity-ca\") pod \"konnectivity-agent-jwlm6\" (UID: \"45807f4c-3dcb-40ff-9897-e46c5d48fd15\") " pod="kube-system/konnectivity-agent-jwlm6" Jun 15 08:18:30.606848 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.606779 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:30.607093 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:30.606927 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:30.607093 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:30.607012 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs podName:389f130c-a632-48ff-918c-c25c25daab40 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:31.106994171 +0000 UTC m=+3.080992768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs") pod "network-metrics-daemon-2jjfp" (UID: "389f130c-a632-48ff-918c-c25c25daab40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:30.607226 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:30.607211 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:30.607275 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:30.607255 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret podName:a8e06716-3cd4-48af-95ba-b8ef131b8cbd nodeName:}" failed. No retries permitted until 2026-06-15 08:18:31.107243032 +0000 UTC m=+3.081241619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret") pod "global-pull-secret-syncer-4kzkb" (UID: "a8e06716-3cd4-48af-95ba-b8ef131b8cbd") : object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:30.607471 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.607451 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-kubelet-config\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:30.607591 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.607568 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-dbus\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:30.608643 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.608612 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45807f4c-3dcb-40ff-9897-e46c5d48fd15-konnectivity-ca\") pod \"konnectivity-agent-jwlm6\" (UID: \"45807f4c-3dcb-40ff-9897-e46c5d48fd15\") " pod="kube-system/konnectivity-agent-jwlm6" Jun 15 08:18:30.610283 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.610261 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45807f4c-3dcb-40ff-9897-e46c5d48fd15-agent-certs\") pod \"konnectivity-agent-jwlm6\" (UID: \"45807f4c-3dcb-40ff-9897-e46c5d48fd15\") " pod="kube-system/konnectivity-agent-jwlm6" Jun 15 08:18:30.618360 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.617968 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrgch\" (UniqueName: \"kubernetes.io/projected/389f130c-a632-48ff-918c-c25c25daab40-kube-api-access-hrgch\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:30.680260 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.680228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:30.686660 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.686638 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mqbqb" Jun 15 08:18:30.691582 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:30.691556 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa5f832_2b14_434b_823f_85bad4208214.slice/crio-4abf04c63dda00de4915e65d5f89c00855e6c93987d580d5d89ba8446ce796b0 WatchSource:0}: Error finding container 4abf04c63dda00de4915e65d5f89c00855e6c93987d580d5d89ba8446ce796b0: Status 404 returned error can't find the container with id 4abf04c63dda00de4915e65d5f89c00855e6c93987d580d5d89ba8446ce796b0 Jun 15 08:18:30.693371 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.693349 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h6rmt" Jun 15 08:18:30.697115 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:30.697089 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b02eb3e_079d_49a6_9a82_d5b195cde884.slice/crio-7294bf3a8a14f20e9500401a48cdde3edeabbe80eabb09ef50a8b40309e89b40 WatchSource:0}: Error finding container 7294bf3a8a14f20e9500401a48cdde3edeabbe80eabb09ef50a8b40309e89b40: Status 404 returned error can't find the container with id 7294bf3a8a14f20e9500401a48cdde3edeabbe80eabb09ef50a8b40309e89b40 Jun 15 08:18:30.700732 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.700681 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" Jun 15 08:18:30.709583 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.709562 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pf69m" Jun 15 08:18:30.710893 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:30.710870 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ad390e_25da_451c_a6d7_98c534317157.slice/crio-cca9a25a775ac615f86125c27c0c730b652785792fa28b466f1577f5e8eeb565 WatchSource:0}: Error finding container cca9a25a775ac615f86125c27c0c730b652785792fa28b466f1577f5e8eeb565: Status 404 returned error can't find the container with id cca9a25a775ac615f86125c27c0c730b652785792fa28b466f1577f5e8eeb565 Jun 15 08:18:30.716548 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.716370 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t9m58" Jun 15 08:18:30.719494 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:30.719377 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386bccce_8950_49b9_8212_5d020ad05c81.slice/crio-e4454a9f973fddefe2d200c26f952f1e8aedef951a0a912413aa223f4190c605 WatchSource:0}: Error finding container e4454a9f973fddefe2d200c26f952f1e8aedef951a0a912413aa223f4190c605: Status 404 returned error can't find the container with id e4454a9f973fddefe2d200c26f952f1e8aedef951a0a912413aa223f4190c605 Jun 15 08:18:30.724088 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.724068 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5xhq5" Jun 15 08:18:30.724961 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:30.724942 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5ef007_936a_4fbd_88eb_1501ce3d7784.slice/crio-683c2d5f13a34d94f909ce04ccd2f46df68c576df9bbe645b7bad14d81029a07 WatchSource:0}: Error finding container 683c2d5f13a34d94f909ce04ccd2f46df68c576df9bbe645b7bad14d81029a07: Status 404 returned error can't find the container with id 683c2d5f13a34d94f909ce04ccd2f46df68c576df9bbe645b7bad14d81029a07 Jun 15 08:18:30.731869 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.731848 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9tjq9" Jun 15 08:18:30.736568 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:30.736549 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jwlm6" Jun 15 08:18:31.110561 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:31.110528 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:31.110759 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:31.110595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9lcn\" (UniqueName: \"kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn\") pod \"network-check-target-5r5rp\" (UID: \"da17723e-7133-4840-9c86-e3cbb8698c18\") " pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:31.110759 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:31.110624 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:31.110759 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:31.110679 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:31.110759 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:31.110720 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:31.110957 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:31.110763 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs podName:389f130c-a632-48ff-918c-c25c25daab40 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:32.11074289 +0000 UTC m=+4.084741477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs") pod "network-metrics-daemon-2jjfp" (UID: "389f130c-a632-48ff-918c-c25c25daab40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:31.110957 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:31.110783 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 08:18:31.110957 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:31.110804 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 08:18:31.110957 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:31.110817 2561 projected.go:196] Error preparing data for projected volume kube-api-access-x9lcn for pod openshift-network-diagnostics/network-check-target-5r5rp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:31.110957 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:31.110787 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret podName:a8e06716-3cd4-48af-95ba-b8ef131b8cbd nodeName:}" failed. No retries permitted until 2026-06-15 08:18:32.110776338 +0000 UTC m=+4.084774913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret") pod "global-pull-secret-syncer-4kzkb" (UID: "a8e06716-3cd4-48af-95ba-b8ef131b8cbd") : object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:31.110957 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:31.110884 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn podName:da17723e-7133-4840-9c86-e3cbb8698c18 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:32.110866612 +0000 UTC m=+4.084865201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9lcn" (UniqueName: "kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn") pod "network-check-target-5r5rp" (UID: "da17723e-7133-4840-9c86-e3cbb8698c18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:31.462950 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:31.462914 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" event={"ID":"68ad390e-25da-451c-a6d7-98c534317157","Type":"ContainerStarted","Data":"cca9a25a775ac615f86125c27c0c730b652785792fa28b466f1577f5e8eeb565"} Jun 15 08:18:31.464314 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:31.464284 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h6rmt" event={"ID":"eadd1131-282b-4043-9010-55772e805b18","Type":"ContainerStarted","Data":"87aa2b35283a002d9bf623d4eeaa484b218b496e2181df7bf5620971f7357104"} Jun 15 08:18:31.465271 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:31.465237 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 08:13:30 +0000 UTC" deadline="2028-01-24 19:57:54.797944081 +0000 UTC" Jun 15 08:18:31.465271 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:31.465271 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14123h39m23.332678188s" Jun 15 08:18:31.465595 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:31.465544 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mqbqb" event={"ID":"4b02eb3e-079d-49a6-9a82-d5b195cde884","Type":"ContainerStarted","Data":"7294bf3a8a14f20e9500401a48cdde3edeabbe80eabb09ef50a8b40309e89b40"} Jun 15 08:18:31.467148 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:31.467109 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" event={"ID":"cfa5f832-2b14-434b-823f-85bad4208214","Type":"ContainerStarted","Data":"4abf04c63dda00de4915e65d5f89c00855e6c93987d580d5d89ba8446ce796b0"} Jun 15 08:18:31.468484 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:31.468447 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t9m58" event={"ID":"ef5ef007-936a-4fbd-88eb-1501ce3d7784","Type":"ContainerStarted","Data":"683c2d5f13a34d94f909ce04ccd2f46df68c576df9bbe645b7bad14d81029a07"} Jun 15 08:18:31.469903 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:31.469885 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pf69m" event={"ID":"386bccce-8950-49b9-8212-5d020ad05c81","Type":"ContainerStarted","Data":"e4454a9f973fddefe2d200c26f952f1e8aedef951a0a912413aa223f4190c605"} Jun 15 08:18:31.851643 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:31.851576 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 08:18:31.918807 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:31.918777 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4aa1e2_2c7b_4d44_8322_07a4acf3fc38.slice/crio-c35e266f0f27a99cc2b26bcc125c363365fc3375c481c87d3812db377e696e83 WatchSource:0}: Error finding container c35e266f0f27a99cc2b26bcc125c363365fc3375c481c87d3812db377e696e83: Status 404 returned error can't find the container with id c35e266f0f27a99cc2b26bcc125c363365fc3375c481c87d3812db377e696e83 Jun 15 08:18:31.922362 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:18:31.921968 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a01daa3_6810_470f_a0d1_7801e1ee4aa5.slice/crio-1b920e77d823b208123d36908c7a05d324b9aed42eadf65ade2c018709e3653e WatchSource:0}: Error finding container 1b920e77d823b208123d36908c7a05d324b9aed42eadf65ade2c018709e3653e: Status 404 returned error can't find the container with id 1b920e77d823b208123d36908c7a05d324b9aed42eadf65ade2c018709e3653e Jun 15 08:18:32.118744 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:32.117227 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:32.118744 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:32.117458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9lcn\" (UniqueName: \"kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn\") pod \"network-check-target-5r5rp\" (UID: \"da17723e-7133-4840-9c86-e3cbb8698c18\") " pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:32.118744 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:32.117462 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:32.118744 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:32.117486 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:32.118744 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:32.117533 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs podName:389f130c-a632-48ff-918c-c25c25daab40 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:34.117514317 +0000 UTC m=+6.091512902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs") pod "network-metrics-daemon-2jjfp" (UID: "389f130c-a632-48ff-918c-c25c25daab40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:32.118744 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:32.117562 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:32.118744 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:32.117603 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret podName:a8e06716-3cd4-48af-95ba-b8ef131b8cbd nodeName:}" failed. No retries permitted until 2026-06-15 08:18:34.117592446 +0000 UTC m=+6.091591018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret") pod "global-pull-secret-syncer-4kzkb" (UID: "a8e06716-3cd4-48af-95ba-b8ef131b8cbd") : object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:32.118744 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:32.117655 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 08:18:32.118744 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:32.117670 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 08:18:32.118744 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:32.117679 2561 projected.go:196] Error preparing data for projected volume kube-api-access-x9lcn for pod openshift-network-diagnostics/network-check-target-5r5rp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:32.118744 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:32.117724 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn podName:da17723e-7133-4840-9c86-e3cbb8698c18 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:34.117712639 +0000 UTC m=+6.091711216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9lcn" (UniqueName: "kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn") pod "network-check-target-5r5rp" (UID: "da17723e-7133-4840-9c86-e3cbb8698c18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:32.452778 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:32.452260 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:32.452778 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:32.452260 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:32.452778 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:32.452402 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:32.452778 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:32.452400 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:32.452778 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:32.452604 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:32.452778 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:32.452754 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:32.465789 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:32.465756 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 08:13:30 +0000 UTC" deadline="2028-03-12 03:25:13.459423918 +0000 UTC" Jun 15 08:18:32.465789 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:32.465788 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15259h6m40.993640375s" Jun 15 08:18:32.479560 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:32.479530 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xhq5" event={"ID":"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38","Type":"ContainerStarted","Data":"c35e266f0f27a99cc2b26bcc125c363365fc3375c481c87d3812db377e696e83"} Jun 15 08:18:32.481534 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:32.481509 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9tjq9" event={"ID":"7a01daa3-6810-470f-a0d1-7801e1ee4aa5","Type":"ContainerStarted","Data":"1b920e77d823b208123d36908c7a05d324b9aed42eadf65ade2c018709e3653e"} Jun 15 08:18:32.484064 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:32.484037 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jwlm6" event={"ID":"45807f4c-3dcb-40ff-9897-e46c5d48fd15","Type":"ContainerStarted","Data":"db4ec843c0a98193d258c51efbe0e6d1c79655d3e1a03548876076f0d2e30bc0"} Jun 15 08:18:32.487648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:32.487115 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-100.ec2.internal" event={"ID":"961c229fb2596d0f0806043e4f238851","Type":"ContainerStarted","Data":"4aade98da69de98007c0cf675323b140d7a4e14e190c327b666cf4f209cca9a1"} Jun 15 08:18:32.505528 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:32.505477 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-100.ec2.internal" podStartSLOduration=3.505459611 podStartE2EDuration="3.505459611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:32.505355503 +0000 UTC m=+4.479354098" watchObservedRunningTime="2026-06-15 08:18:32.505459611 +0000 UTC m=+4.479458208" Jun 15 08:18:33.500099 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:33.499744 2561 generic.go:356] "Generic (PLEG): container finished" podID="111deab622c10254868c38f037a73250" containerID="5f442437a2c4f6582449ab3c9ad2e8eae427bdc78de944344fca12a3674d541b" exitCode=0 Jun 15 08:18:33.500099 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:33.499848 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal" event={"ID":"111deab622c10254868c38f037a73250","Type":"ContainerDied","Data":"5f442437a2c4f6582449ab3c9ad2e8eae427bdc78de944344fca12a3674d541b"} Jun 15 08:18:34.139513 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:34.139474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:34.139681 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:34.139533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9lcn\" (UniqueName: \"kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn\") pod \"network-check-target-5r5rp\" (UID: \"da17723e-7133-4840-9c86-e3cbb8698c18\") " pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:34.139681 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:34.139564 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:34.139681 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:34.139674 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:34.139860 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:34.139677 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:34.139860 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:34.139711 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 08:18:34.139860 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:34.139751 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 08:18:34.139860 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:34.139763 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret podName:a8e06716-3cd4-48af-95ba-b8ef131b8cbd nodeName:}" failed. No retries permitted until 2026-06-15 08:18:38.139744141 +0000 UTC m=+10.113742733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret") pod "global-pull-secret-syncer-4kzkb" (UID: "a8e06716-3cd4-48af-95ba-b8ef131b8cbd") : object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:34.139860 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:34.139765 2561 projected.go:196] Error preparing data for projected volume kube-api-access-x9lcn for pod openshift-network-diagnostics/network-check-target-5r5rp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:34.139860 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:34.139784 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs podName:389f130c-a632-48ff-918c-c25c25daab40 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:38.139773924 +0000 UTC m=+10.113772502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs") pod "network-metrics-daemon-2jjfp" (UID: "389f130c-a632-48ff-918c-c25c25daab40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:34.139860 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:34.139817 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn podName:da17723e-7133-4840-9c86-e3cbb8698c18 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:38.139799787 +0000 UTC m=+10.113798376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9lcn" (UniqueName: "kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn") pod "network-check-target-5r5rp" (UID: "da17723e-7133-4840-9c86-e3cbb8698c18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:34.451668 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:34.451642 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:34.451862 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:34.451643 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:34.451862 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:34.451788 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:34.451977 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:34.451903 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:34.451977 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:34.451964 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:34.452084 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:34.452031 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:36.454975 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:36.454944 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:36.454975 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:36.454971 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:36.454975 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:36.454980 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:36.455476 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:36.455089 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:36.455476 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:36.455198 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:36.455476 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:36.455275 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:38.172648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:38.172606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:38.173113 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:38.172682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9lcn\" (UniqueName: \"kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn\") pod \"network-check-target-5r5rp\" (UID: \"da17723e-7133-4840-9c86-e3cbb8698c18\") " pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:38.173113 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:38.172734 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:38.173113 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:38.172848 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:38.173113 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:38.172848 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:38.173113 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:38.172873 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 08:18:38.173113 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:38.172898 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 08:18:38.173113 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:38.172912 2561 projected.go:196] Error preparing data for projected volume kube-api-access-x9lcn for pod openshift-network-diagnostics/network-check-target-5r5rp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:38.173113 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:38.172917 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret podName:a8e06716-3cd4-48af-95ba-b8ef131b8cbd nodeName:}" failed. No retries permitted until 2026-06-15 08:18:46.172900522 +0000 UTC m=+18.146899112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret") pod "global-pull-secret-syncer-4kzkb" (UID: "a8e06716-3cd4-48af-95ba-b8ef131b8cbd") : object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:38.173113 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:38.172937 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs podName:389f130c-a632-48ff-918c-c25c25daab40 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:46.172926829 +0000 UTC m=+18.146925407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs") pod "network-metrics-daemon-2jjfp" (UID: "389f130c-a632-48ff-918c-c25c25daab40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:38.173113 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:38.172976 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn podName:da17723e-7133-4840-9c86-e3cbb8698c18 nodeName:}" failed. No retries permitted until 2026-06-15 08:18:46.172959083 +0000 UTC m=+18.146957657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9lcn" (UniqueName: "kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn") pod "network-check-target-5r5rp" (UID: "da17723e-7133-4840-9c86-e3cbb8698c18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:38.454899 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:38.454862 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:38.455078 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:38.454870 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:38.455078 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:38.454986 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:38.455078 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:38.454981 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:38.455221 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:38.455090 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:38.455221 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:38.455172 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:40.454586 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:40.454555 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:40.455058 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:40.454674 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:40.455058 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:40.454767 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:40.455058 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:40.454895 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:40.455058 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:40.454944 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:40.455058 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:40.455021 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:41.517884 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:41.517848 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jwlm6" event={"ID":"45807f4c-3dcb-40ff-9897-e46c5d48fd15","Type":"ContainerStarted","Data":"5bdbbcf60102eb5270c3903e65eab62cf4d5aae3a1934b64d70f7e5d41fb0fe1"} Jun 15 08:18:41.521354 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:41.520772 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal" event={"ID":"111deab622c10254868c38f037a73250","Type":"ContainerStarted","Data":"c1b21913035913180d19578d2e19927357370b04a045f4d62bea184321bcd536"} Jun 15 08:18:41.523866 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:41.523465 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h6rmt" event={"ID":"eadd1131-282b-4043-9010-55772e805b18","Type":"ContainerStarted","Data":"0c959a6bd2db20449b11591c5364513ac2a9c578392021fdd3a5b29be112baec"} Jun 15 08:18:41.526041 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:41.525613 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xhq5" event={"ID":"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38","Type":"ContainerStarted","Data":"f22dd73fa6a1eea683735a56261b3dde7fa47708870f03ace86e1a14f4396b3d"} Jun 15 08:18:41.528947 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:41.528492 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pf69m" event={"ID":"386bccce-8950-49b9-8212-5d020ad05c81","Type":"ContainerStarted","Data":"1892f3f1f40a2e7f519d42acf9892ec9a4253ed2e329aa6f0934f3cff5299239"} Jun 15 08:18:41.530970 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:41.530907 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" event={"ID":"68ad390e-25da-451c-a6d7-98c534317157","Type":"ContainerStarted","Data":"1be67f9f04f3a34c04b295ecddf2150b7cebaae113826711e8728f881e07a209"} Jun 15 08:18:41.533856 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:41.533834 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mqbqb" event={"ID":"4b02eb3e-079d-49a6-9a82-d5b195cde884","Type":"ContainerStarted","Data":"3bfa1f65f5731978e151c1276f056220ca923dff1ecfa8f62ec2c20542de9b4f"} Jun 15 08:18:41.552780 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:41.552731 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jwlm6" podStartSLOduration=4.318268986 podStartE2EDuration="13.552712594s" totalImagesPullingTime="9.234443608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:41.536215186 +0000 UTC m=+13.510213801" watchObservedRunningTime="2026-06-15 08:18:41.552712594 +0000 UTC m=+13.526711191" Jun 15 08:18:41.567105 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:41.567068 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-100.ec2.internal" podStartSLOduration=12.567056387000001 podStartE2EDuration="12.567056387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:41.552033236 +0000 UTC m=+13.526031831" watchObservedRunningTime="2026-06-15 08:18:41.567056387 +0000 UTC m=+13.541054982" Jun 15 08:18:41.582756 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:41.582715 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mqbqb" podStartSLOduration=3.12505707 podStartE2EDuration="13.582683047s" totalImagesPullingTime="10.457625977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:41.567329777 +0000 UTC m=+13.541328372" watchObservedRunningTime="2026-06-15 08:18:41.582683047 +0000 UTC m=+13.556681643" Jun 15 08:18:41.605476 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:41.605432 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h6rmt" podStartSLOduration=3.15075564 podStartE2EDuration="13.605417772s" totalImagesPullingTime="10.454662132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:41.582816118 +0000 UTC m=+13.556814715" watchObservedRunningTime="2026-06-15 08:18:41.605417772 +0000 UTC m=+13.579416368" Jun 15 08:18:41.625632 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:41.625589 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pf69m" podStartSLOduration=3.15501203 podStartE2EDuration="13.625576111s" totalImagesPullingTime="10.470564081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:41.625485941 +0000 UTC m=+13.599484549" watchObservedRunningTime="2026-06-15 08:18:41.625576111 +0000 UTC m=+13.599574705" Jun 15 08:18:42.455396 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:42.455367 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:42.455556 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:42.455486 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:42.456058 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:42.455801 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:42.456058 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:42.455899 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:42.456058 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:42.455952 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:42.456058 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:42.456029 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:42.537802 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:42.537769 2561 generic.go:356] "Generic (PLEG): container finished" podID="3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38" containerID="f22dd73fa6a1eea683735a56261b3dde7fa47708870f03ace86e1a14f4396b3d" exitCode=0 Jun 15 08:18:42.538798 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:42.538766 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xhq5" event={"ID":"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38","Type":"ContainerDied","Data":"f22dd73fa6a1eea683735a56261b3dde7fa47708870f03ace86e1a14f4396b3d"} Jun 15 08:18:43.541242 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:43.541205 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t9m58" event={"ID":"ef5ef007-936a-4fbd-88eb-1501ce3d7784","Type":"ContainerStarted","Data":"9244956e85a73552903eefe3667b00e853e866a9f4aba863d973eaf865821b1b"} Jun 15 08:18:43.556305 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:43.556247 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t9m58" podStartSLOduration=5.124824756 podStartE2EDuration="15.556228149s" totalImagesPullingTime="10.431403393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:43.555898343 +0000 UTC m=+15.529896939" watchObservedRunningTime="2026-06-15 08:18:43.556228149 +0000 UTC m=+15.530226741" Jun 15 08:18:44.091434 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:44.090848 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jwlm6" Jun 15 08:18:44.091613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:44.091469 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jwlm6" Jun 15 08:18:44.451779 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:44.451750 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:44.451931 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:44.451749 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:44.451931 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:44.451881 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:44.452060 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:44.451760 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:44.452060 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:44.451965 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:44.452146 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:44.452061 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:44.543715 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:44.543671 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jwlm6" Jun 15 08:18:44.544346 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:44.544322 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jwlm6" Jun 15 08:18:46.237385 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:46.237349 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9lcn\" (UniqueName: \"kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn\") pod \"network-check-target-5r5rp\" (UID: \"da17723e-7133-4840-9c86-e3cbb8698c18\") " pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:46.237879 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:46.237395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:46.237879 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:46.237430 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:46.237879 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:46.237528 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:46.237879 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:46.237536 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 08:18:46.237879 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:46.237562 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 08:18:46.237879 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:46.237562 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:46.237879 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:46.237575 2561 projected.go:196] Error preparing data for projected volume kube-api-access-x9lcn for pod openshift-network-diagnostics/network-check-target-5r5rp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:46.237879 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:46.237593 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs podName:389f130c-a632-48ff-918c-c25c25daab40 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:02.237577398 +0000 UTC m=+34.211575993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs") pod "network-metrics-daemon-2jjfp" (UID: "389f130c-a632-48ff-918c-c25c25daab40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:18:46.237879 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:46.237616 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret podName:a8e06716-3cd4-48af-95ba-b8ef131b8cbd nodeName:}" failed. No retries permitted until 2026-06-15 08:19:02.237600163 +0000 UTC m=+34.211598747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret") pod "global-pull-secret-syncer-4kzkb" (UID: "a8e06716-3cd4-48af-95ba-b8ef131b8cbd") : object "kube-system"/"original-pull-secret" not registered Jun 15 08:18:46.237879 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:46.237635 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn podName:da17723e-7133-4840-9c86-e3cbb8698c18 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:02.237628521 +0000 UTC m=+34.211627094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9lcn" (UniqueName: "kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn") pod "network-check-target-5r5rp" (UID: "da17723e-7133-4840-9c86-e3cbb8698c18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:18:46.451756 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:46.451719 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:46.452036 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:46.451763 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:46.452036 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:46.451718 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:46.452036 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:46.451868 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:46.452036 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:46.451978 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:46.452196 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:46.452069 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:48.454212 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:48.454178 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:48.454826 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:48.454297 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:48.454826 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:48.454647 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:48.454826 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:48.454755 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:48.454826 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:48.454809 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:48.454984 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:48.454875 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:50.451423 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:50.451396 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:50.451981 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:50.451398 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:50.451981 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:50.451523 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:50.451981 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:50.451405 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:50.451981 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:50.451612 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:50.451981 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:50.451717 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:52.452495 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:52.452280 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:52.452956 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:52.452281 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:52.452956 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:52.452593 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:52.452956 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:52.452683 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:52.452956 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:52.452281 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:52.452956 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:52.452840 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:52.751344 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:52.751318 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 08:18:53.465732 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.465422 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T08:18:52.751339152Z","UUID":"d9b30659-bbbb-46af-be85-d070fe3b8cce","Handler":null,"Name":"","Endpoint":""} Jun 15 08:18:53.467014 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.466993 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 08:18:53.467132 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.467034 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 08:18:53.564041 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.564009 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:18:53.564397 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.564371 2561 generic.go:356] "Generic (PLEG): container finished" podID="cfa5f832-2b14-434b-823f-85bad4208214" containerID="bd343f64c75db651ee20fc7f9df3567e5c7328b761986c5abeb6f816110f72d2" exitCode=1 Jun 15 08:18:53.564495 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.564451 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" event={"ID":"cfa5f832-2b14-434b-823f-85bad4208214","Type":"ContainerStarted","Data":"aa013b97e5ba6d2af164593bcee632903aafe7360c5fe8744832331e4abd87c6"} Jun 15 08:18:53.564627 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.564612 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" event={"ID":"cfa5f832-2b14-434b-823f-85bad4208214","Type":"ContainerStarted","Data":"765069369c7fa36ea5c6a295db7f50956e80f5600967273289d301da7784e286"} Jun 15 08:18:53.564680 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.564667 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" event={"ID":"cfa5f832-2b14-434b-823f-85bad4208214","Type":"ContainerStarted","Data":"369867acf23aa0ca4b06731c007433747429a027937d546cf014c341418f2e5e"} Jun 15 08:18:53.564760 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.564732 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" event={"ID":"cfa5f832-2b14-434b-823f-85bad4208214","Type":"ContainerStarted","Data":"27b3c631cc4f5a682bbb945138dd571240bd0de776a339bdc3d4b8724d620783"} Jun 15 08:18:53.564803 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.564783 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" event={"ID":"cfa5f832-2b14-434b-823f-85bad4208214","Type":"ContainerDied","Data":"bd343f64c75db651ee20fc7f9df3567e5c7328b761986c5abeb6f816110f72d2"} Jun 15 08:18:53.564849 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.564831 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" event={"ID":"cfa5f832-2b14-434b-823f-85bad4208214","Type":"ContainerStarted","Data":"7817f37fb606aaffbac647493c75609e5d4d2f1def193fb36c883888d8d6f4a8"} Jun 15 08:18:53.566075 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.566047 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9tjq9" event={"ID":"7a01daa3-6810-470f-a0d1-7801e1ee4aa5","Type":"ContainerStarted","Data":"68e0e43bab6bad666c20ffa23187beb61b3e77ca4e8da896832bf5415e317918"} Jun 15 08:18:53.568066 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.568044 2561 generic.go:356] "Generic (PLEG): container finished" podID="3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38" containerID="8c0c1d0715cca9b63ad2231a74f3af5498f828dde56d4875cbdcf645d1f8cbf2" exitCode=0 Jun 15 08:18:53.568170 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.568114 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xhq5" event={"ID":"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38","Type":"ContainerDied","Data":"8c0c1d0715cca9b63ad2231a74f3af5498f828dde56d4875cbdcf645d1f8cbf2"} Jun 15 08:18:53.570297 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.570277 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" event={"ID":"68ad390e-25da-451c-a6d7-98c534317157","Type":"ContainerStarted","Data":"416a1948190beccb3c00f66ed4f2f9d60a495cd706d085820b3e165a6c7204e3"} Jun 15 08:18:53.587938 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:53.587893 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9tjq9" podStartSLOduration=4.918390403 podStartE2EDuration="25.587877193s" totalImagesPullingTime="20.66948679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:53.587833399 +0000 UTC m=+25.561832024" watchObservedRunningTime="2026-06-15 08:18:53.587877193 +0000 UTC m=+25.561875789" Jun 15 08:18:54.454971 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:54.454945 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:54.455132 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:54.454946 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:54.455132 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:54.454949 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:54.455229 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:54.455145 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:54.455229 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:54.455170 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:54.455229 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:54.455033 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:54.575190 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:54.575154 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" event={"ID":"68ad390e-25da-451c-a6d7-98c534317157","Type":"ContainerStarted","Data":"fdf69299463d813a95aff6bd48a2600a08ba448d4f633b632c15a6f3b2f1b0d1"} Jun 15 08:18:54.594163 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:54.594121 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dl5zf" podStartSLOduration=3.771549792 podStartE2EDuration="26.594107845s" totalImagesPullingTime="22.822558053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:54.594049136 +0000 UTC m=+26.568047750" watchObservedRunningTime="2026-06-15 08:18:54.594107845 +0000 UTC m=+26.568106456" Jun 15 08:18:55.579381 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:55.579348 2561 generic.go:356] "Generic (PLEG): container finished" podID="3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38" containerID="feb7685bc8bb4f3b867453edfadbffda9bac9a38d24218b1c6e272bb02b0a272" exitCode=0 Jun 15 08:18:55.579787 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:55.579428 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xhq5" event={"ID":"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38","Type":"ContainerDied","Data":"feb7685bc8bb4f3b867453edfadbffda9bac9a38d24218b1c6e272bb02b0a272"} Jun 15 08:18:55.585274 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:55.585258 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:18:55.585712 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:55.585678 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" event={"ID":"cfa5f832-2b14-434b-823f-85bad4208214","Type":"ContainerStarted","Data":"362c387d9fc21c7d0be8d352dfaba9f5d8bed0ad18b9ccb65e0c968e8c46333b"} Jun 15 08:18:56.454998 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:56.454976 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:56.455088 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:56.455071 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:56.455134 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:56.455080 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:56.455134 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:56.455095 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:56.455212 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:56.455166 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:56.455259 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:56.455216 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:56.589587 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:56.589557 2561 generic.go:356] "Generic (PLEG): container finished" podID="3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38" containerID="2cad6d02e465e1adee10f4a94836f5d28ba53156d9b6b58c4615bdc6e49e9cb4" exitCode=0 Jun 15 08:18:56.589908 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:56.589606 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xhq5" event={"ID":"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38","Type":"ContainerDied","Data":"2cad6d02e465e1adee10f4a94836f5d28ba53156d9b6b58c4615bdc6e49e9cb4"} Jun 15 08:18:57.596981 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:57.596955 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:18:57.597490 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:57.597371 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" event={"ID":"cfa5f832-2b14-434b-823f-85bad4208214","Type":"ContainerStarted","Data":"0aa5fc1aa064df30a7a514419e6abe62066abadb86a5f61ed04dcb0930ee916a"} Jun 15 08:18:57.597831 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:57.597815 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:57.598013 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:57.597994 2561 scope.go:117] "RemoveContainer" containerID="bd343f64c75db651ee20fc7f9df3567e5c7328b761986c5abeb6f816110f72d2" Jun 15 08:18:57.617902 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:57.617880 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:58.455373 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:58.455341 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:58.455533 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:58.455341 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:58.455533 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:58.455443 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:58.455649 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:58.455539 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:58.455649 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:58.455345 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:58.455649 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:58.455635 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:18:58.602158 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:58.602131 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:18:58.602561 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:58.602431 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" event={"ID":"cfa5f832-2b14-434b-823f-85bad4208214","Type":"ContainerStarted","Data":"aea71050696e5918c4837a3bb27836fcdc23ffee26e1be931c99c53ba5ffd68a"} Jun 15 08:18:58.602724 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:58.602689 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:58.602793 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:58.602778 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:58.617950 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:58.617928 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:18:58.636518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:58.636473 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" podStartSLOduration=8.733508784 podStartE2EDuration="30.636456301s" totalImagesPullingTime="21.902947517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:18:58.634635622 +0000 UTC m=+30.608634270" watchObservedRunningTime="2026-06-15 08:18:58.636456301 +0000 UTC m=+30.610454897" Jun 15 08:18:59.736185 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:59.736157 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5r5rp"] Jun 15 08:18:59.736716 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:59.736309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:18:59.736716 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:59.736408 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:18:59.737125 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:59.737104 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4kzkb"] Jun 15 08:18:59.737212 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:59.737200 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:18:59.737323 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:59.737297 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:18:59.737726 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:59.737682 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2jjfp"] Jun 15 08:18:59.737851 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:18:59.737803 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:18:59.737924 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:18:59.737903 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:19:01.451971 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:01.451938 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:19:01.452443 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:01.451986 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:19:01.452443 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:01.452054 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:19:01.452443 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:01.452117 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:19:01.452443 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:01.452217 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:19:01.452443 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:01.452296 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:19:02.262270 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:02.262237 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9lcn\" (UniqueName: \"kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn\") pod \"network-check-target-5r5rp\" (UID: \"da17723e-7133-4840-9c86-e3cbb8698c18\") " pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:19:02.262550 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:02.262289 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:19:02.262550 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:02.262330 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:19:02.262550 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:02.262417 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 08:19:02.262550 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:02.262426 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:19:02.262550 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:02.262442 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 08:19:02.262550 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:02.262451 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 08:19:02.262550 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:02.262455 2561 projected.go:196] Error preparing data for projected volume kube-api-access-x9lcn for pod openshift-network-diagnostics/network-check-target-5r5rp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:19:02.262550 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:02.262493 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs podName:389f130c-a632-48ff-918c-c25c25daab40 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:34.262472575 +0000 UTC m=+66.236471171 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs") pod "network-metrics-daemon-2jjfp" (UID: "389f130c-a632-48ff-918c-c25c25daab40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 08:19:02.262550 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:02.262548 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret podName:a8e06716-3cd4-48af-95ba-b8ef131b8cbd nodeName:}" failed. No retries permitted until 2026-06-15 08:19:34.262530519 +0000 UTC m=+66.236529097 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret") pod "global-pull-secret-syncer-4kzkb" (UID: "a8e06716-3cd4-48af-95ba-b8ef131b8cbd") : object "kube-system"/"original-pull-secret" not registered Jun 15 08:19:02.262887 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:02.262566 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn podName:da17723e-7133-4840-9c86-e3cbb8698c18 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:34.262557221 +0000 UTC m=+66.236555799 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9lcn" (UniqueName: "kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn") pod "network-check-target-5r5rp" (UID: "da17723e-7133-4840-9c86-e3cbb8698c18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 08:19:03.452010 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:03.451871 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:19:03.452341 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:03.451927 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:19:03.452341 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:03.451927 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:19:03.452341 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:03.452198 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:19:03.452341 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:03.452221 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4kzkb" podUID="a8e06716-3cd4-48af-95ba-b8ef131b8cbd" Jun 15 08:19:03.452341 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:03.452073 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5r5rp" podUID="da17723e-7133-4840-9c86-e3cbb8698c18" Jun 15 08:19:03.618237 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:03.618207 2561 generic.go:356] "Generic (PLEG): container finished" podID="3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38" containerID="418dffef3521485b1a2f8f1d3be72f04a4d9254c9e4751dfe490e28504bd0608" exitCode=0 Jun 15 08:19:03.618368 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:03.618248 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xhq5" event={"ID":"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38","Type":"ContainerDied","Data":"418dffef3521485b1a2f8f1d3be72f04a4d9254c9e4751dfe490e28504bd0608"} Jun 15 08:19:04.622969 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:04.622939 2561 generic.go:356] "Generic (PLEG): container finished" podID="3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38" containerID="372e1e098b08153c13f98e2b4bd6d3fcb592e9153d3642b14668d1e607e603ed" exitCode=0 Jun 15 08:19:04.623407 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:04.622994 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xhq5" event={"ID":"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38","Type":"ContainerDied","Data":"372e1e098b08153c13f98e2b4bd6d3fcb592e9153d3642b14668d1e607e603ed"} Jun 15 08:19:05.376262 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.376187 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-100.ec2.internal" event="NodeReady" Jun 15 08:19:05.376403 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.376315 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 08:19:05.410406 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.410375 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64b944dc54-z9hdf"] Jun 15 08:19:05.431999 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.431971 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g586f"] Jun 15 08:19:05.432131 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.432100 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.434388 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.434366 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pm97c\"" Jun 15 08:19:05.434522 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.434373 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 15 08:19:05.434609 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.434597 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 15 08:19:05.434906 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.434891 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 15 08:19:05.445880 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.445860 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b944dc54-z9hdf"] Jun 15 08:19:05.445972 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.445889 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7r556"] Jun 15 08:19:05.445972 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.445966 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g586f" Jun 15 08:19:05.449910 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.449871 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 08:19:05.449910 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.449906 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 08:19:05.450064 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.449928 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r86n2\"" Jun 15 08:19:05.450342 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.450321 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 15 08:19:05.463968 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.463949 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g586f"] Jun 15 08:19:05.464084 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.464009 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7r556"] Jun 15 08:19:05.464084 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.464064 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:19:05.464084 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.464074 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:19:05.464204 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.464080 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:19:05.464204 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.464064 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7r556" Jun 15 08:19:05.466677 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.466655 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 08:19:05.466954 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.466936 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 08:19:05.467042 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.466943 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 08:19:05.467042 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.466991 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qw9r9\"" Jun 15 08:19:05.467042 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.466999 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 08:19:05.467042 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.466992 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 08:19:05.467211 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.467026 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2x8r9\"" Jun 15 08:19:05.467313 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.467274 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 08:19:05.467313 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.467303 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 08:19:05.467447 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.467434 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-646t6\"" Jun 15 08:19:05.486916 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.486892 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c132e12-5da5-424b-a957-50952de70322-image-registry-private-configuration\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.487005 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.486938 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wml6\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-kube-api-access-2wml6\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.487005 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.486967 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b021cbb3-0e41-4dbf-96d2-5e0302c69db6-cert\") pod \"ingress-canary-7r556\" (UID: \"b021cbb3-0e41-4dbf-96d2-5e0302c69db6\") " pod="openshift-ingress-canary/ingress-canary-7r556" Jun 15 08:19:05.487091 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.487045 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c132e12-5da5-424b-a957-50952de70322-ca-trust-extracted\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.487091 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.487070 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c132e12-5da5-424b-a957-50952de70322-registry-certificates\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.487172 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.487091 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:05.487172 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.487107 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8dlk\" (UniqueName: \"kubernetes.io/projected/b021cbb3-0e41-4dbf-96d2-5e0302c69db6-kube-api-access-d8dlk\") pod \"ingress-canary-7r556\" (UID: \"b021cbb3-0e41-4dbf-96d2-5e0302c69db6\") " pod="openshift-ingress-canary/ingress-canary-7r556" Jun 15 08:19:05.487172 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.487124 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-config-volume\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:05.487172 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.487146 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqbqk\" (UniqueName: \"kubernetes.io/projected/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-kube-api-access-jqbqk\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:05.487301 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.487200 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c132e12-5da5-424b-a957-50952de70322-installation-pull-secrets\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.487301 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.487218 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-bound-sa-token\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.487301 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.487267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-tmp-dir\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:05.487301 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.487291 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.487433 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.487309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c132e12-5da5-424b-a957-50952de70322-trusted-ca\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.587912 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.587888 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c132e12-5da5-424b-a957-50952de70322-ca-trust-extracted\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.588059 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.587916 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c132e12-5da5-424b-a957-50952de70322-registry-certificates\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.588059 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.587939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:05.588059 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.587961 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8dlk\" (UniqueName: \"kubernetes.io/projected/b021cbb3-0e41-4dbf-96d2-5e0302c69db6-kube-api-access-d8dlk\") pod \"ingress-canary-7r556\" (UID: \"b021cbb3-0e41-4dbf-96d2-5e0302c69db6\") " pod="openshift-ingress-canary/ingress-canary-7r556" Jun 15 08:19:05.588059 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:05.588047 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:19:05.588266 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.588064 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-config-volume\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:05.588266 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:05.588094 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls podName:dfd67d73-cda0-4c6e-bbd3-7127f2bcef94 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:06.088079718 +0000 UTC m=+38.062078316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls") pod "dns-default-g586f" (UID: "dfd67d73-cda0-4c6e-bbd3-7127f2bcef94") : secret "dns-default-metrics-tls" not found Jun 15 08:19:05.588266 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.588120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqbqk\" (UniqueName: \"kubernetes.io/projected/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-kube-api-access-jqbqk\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:05.588266 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.588156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c132e12-5da5-424b-a957-50952de70322-installation-pull-secrets\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.588266 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.588197 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-bound-sa-token\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.588491 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.588347 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c132e12-5da5-424b-a957-50952de70322-ca-trust-extracted\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.588491 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.588394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-tmp-dir\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:05.588491 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.588428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.588491 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.588455 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c132e12-5da5-424b-a957-50952de70322-trusted-ca\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.588676 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.588500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c132e12-5da5-424b-a957-50952de70322-image-registry-private-configuration\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.588676 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.588528 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wml6\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-kube-api-access-2wml6\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.588676 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.588560 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b021cbb3-0e41-4dbf-96d2-5e0302c69db6-cert\") pod \"ingress-canary-7r556\" (UID: \"b021cbb3-0e41-4dbf-96d2-5e0302c69db6\") " pod="openshift-ingress-canary/ingress-canary-7r556" Jun 15 08:19:05.588676 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:05.588565 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 08:19:05.588676 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.588605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c132e12-5da5-424b-a957-50952de70322-registry-certificates\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.588676 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:05.588616 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b944dc54-z9hdf: secret "image-registry-tls" not found Jun 15 08:19:05.588676 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.588639 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-config-volume\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:05.588676 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:05.588672 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls podName:2c132e12-5da5-424b-a957-50952de70322 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:06.088655287 +0000 UTC m=+38.062653875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls") pod "image-registry-64b944dc54-z9hdf" (UID: "2c132e12-5da5-424b-a957-50952de70322") : secret "image-registry-tls" not found Jun 15 08:19:05.589032 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.588757 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-tmp-dir\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:05.589353 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.589334 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c132e12-5da5-424b-a957-50952de70322-trusted-ca\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.592401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.592373 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c132e12-5da5-424b-a957-50952de70322-installation-pull-secrets\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.592481 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.592416 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b021cbb3-0e41-4dbf-96d2-5e0302c69db6-cert\") pod \"ingress-canary-7r556\" (UID: \"b021cbb3-0e41-4dbf-96d2-5e0302c69db6\") " pod="openshift-ingress-canary/ingress-canary-7r556" Jun 15 08:19:05.592481 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.592449 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c132e12-5da5-424b-a957-50952de70322-image-registry-private-configuration\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.596975 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.596953 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqbqk\" (UniqueName: \"kubernetes.io/projected/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-kube-api-access-jqbqk\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:05.597081 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.596975 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8dlk\" (UniqueName: \"kubernetes.io/projected/b021cbb3-0e41-4dbf-96d2-5e0302c69db6-kube-api-access-d8dlk\") pod \"ingress-canary-7r556\" (UID: \"b021cbb3-0e41-4dbf-96d2-5e0302c69db6\") " pod="openshift-ingress-canary/ingress-canary-7r556" Jun 15 08:19:05.597081 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.597035 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-bound-sa-token\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.597423 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.597402 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wml6\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-kube-api-access-2wml6\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:05.628866 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.628802 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xhq5" event={"ID":"3c4aa1e2-2c7b-4d44-8322-07a4acf3fc38","Type":"ContainerStarted","Data":"81eda2af89fa5644bfa88751c2626e61a7a5c0bc8497690e779dcb4ab8d9d92d"} Jun 15 08:19:05.653981 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.653939 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5xhq5" podStartSLOduration=9.478858068 podStartE2EDuration="37.653910682s" totalImagesPullingTime="28.175052614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:19:05.652638686 +0000 UTC m=+37.626637301" watchObservedRunningTime="2026-06-15 08:19:05.653910682 +0000 UTC m=+37.627909277" Jun 15 08:19:05.789726 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:05.789681 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7r556" Jun 15 08:19:06.006397 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:06.006229 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7r556"] Jun 15 08:19:06.009616 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:19:06.009589 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb021cbb3_0e41_4dbf_96d2_5e0302c69db6.slice/crio-656d54b7d464785b5dc8f12e0293a31abbbbfc3f08c9dbed3062916cadbff6e8 WatchSource:0}: Error finding container 656d54b7d464785b5dc8f12e0293a31abbbbfc3f08c9dbed3062916cadbff6e8: Status 404 returned error can't find the container with id 656d54b7d464785b5dc8f12e0293a31abbbbfc3f08c9dbed3062916cadbff6e8 Jun 15 08:19:06.092066 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:06.092033 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:06.092226 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:06.092102 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:06.092226 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:06.092186 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 08:19:06.092226 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:06.092203 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:19:06.092226 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:06.092204 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b944dc54-z9hdf: secret "image-registry-tls" not found Jun 15 08:19:06.092350 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:06.092260 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls podName:dfd67d73-cda0-4c6e-bbd3-7127f2bcef94 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:07.092247414 +0000 UTC m=+39.066245987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls") pod "dns-default-g586f" (UID: "dfd67d73-cda0-4c6e-bbd3-7127f2bcef94") : secret "dns-default-metrics-tls" not found Jun 15 08:19:06.092350 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:06.092272 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls podName:2c132e12-5da5-424b-a957-50952de70322 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:07.092267072 +0000 UTC m=+39.066265645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls") pod "image-registry-64b944dc54-z9hdf" (UID: "2c132e12-5da5-424b-a957-50952de70322") : secret "image-registry-tls" not found Jun 15 08:19:06.633094 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:06.633056 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7r556" event={"ID":"b021cbb3-0e41-4dbf-96d2-5e0302c69db6","Type":"ContainerStarted","Data":"656d54b7d464785b5dc8f12e0293a31abbbbfc3f08c9dbed3062916cadbff6e8"} Jun 15 08:19:07.098604 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:07.098568 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:07.098815 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:07.098633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:07.098815 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:07.098742 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:19:07.098815 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:07.098747 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 08:19:07.098815 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:07.098771 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b944dc54-z9hdf: secret "image-registry-tls" not found Jun 15 08:19:07.098815 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:07.098802 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls podName:dfd67d73-cda0-4c6e-bbd3-7127f2bcef94 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:09.098787518 +0000 UTC m=+41.072786095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls") pod "dns-default-g586f" (UID: "dfd67d73-cda0-4c6e-bbd3-7127f2bcef94") : secret "dns-default-metrics-tls" not found Jun 15 08:19:07.098998 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:07.098824 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls podName:2c132e12-5da5-424b-a957-50952de70322 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:09.098808045 +0000 UTC m=+41.072806639 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls") pod "image-registry-64b944dc54-z9hdf" (UID: "2c132e12-5da5-424b-a957-50952de70322") : secret "image-registry-tls" not found Jun 15 08:19:08.638798 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:08.638763 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7r556" event={"ID":"b021cbb3-0e41-4dbf-96d2-5e0302c69db6","Type":"ContainerStarted","Data":"78aac2b7afed9f7d787701a7ab688fa8511a41f074891f4cd6b392225116dcd5"} Jun 15 08:19:08.654479 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:08.654433 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7r556" podStartSLOduration=1.495383909 podStartE2EDuration="3.654418749s" totalImagesPullingTime="2.15903484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:19:08.653988395 +0000 UTC m=+40.627986990" watchObservedRunningTime="2026-06-15 08:19:08.654418749 +0000 UTC m=+40.628417343" Jun 15 08:19:09.111148 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:09.111111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:09.111337 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:09.111208 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:09.111337 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:09.111240 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 08:19:09.111337 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:09.111257 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b944dc54-z9hdf: secret "image-registry-tls" not found Jun 15 08:19:09.111337 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:09.111305 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls podName:2c132e12-5da5-424b-a957-50952de70322 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:13.111292526 +0000 UTC m=+45.085291120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls") pod "image-registry-64b944dc54-z9hdf" (UID: "2c132e12-5da5-424b-a957-50952de70322") : secret "image-registry-tls" not found Jun 15 08:19:09.111337 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:09.111308 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:19:09.111518 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:09.111356 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls podName:dfd67d73-cda0-4c6e-bbd3-7127f2bcef94 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:13.111341924 +0000 UTC m=+45.085340519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls") pod "dns-default-g586f" (UID: "dfd67d73-cda0-4c6e-bbd3-7127f2bcef94") : secret "dns-default-metrics-tls" not found Jun 15 08:19:13.134792 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:13.134760 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:13.135129 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:13.134823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:13.135129 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:13.134906 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:19:13.135129 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:13.134917 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 08:19:13.135129 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:13.134935 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b944dc54-z9hdf: secret "image-registry-tls" not found Jun 15 08:19:13.135129 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:13.134955 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls podName:dfd67d73-cda0-4c6e-bbd3-7127f2bcef94 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:21.13494315 +0000 UTC m=+53.108941723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls") pod "dns-default-g586f" (UID: "dfd67d73-cda0-4c6e-bbd3-7127f2bcef94") : secret "dns-default-metrics-tls" not found Jun 15 08:19:13.135129 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:13.134981 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls podName:2c132e12-5da5-424b-a957-50952de70322 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:21.134968727 +0000 UTC m=+53.108967302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls") pod "image-registry-64b944dc54-z9hdf" (UID: "2c132e12-5da5-424b-a957-50952de70322") : secret "image-registry-tls" not found Jun 15 08:19:21.191083 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:21.190897 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:21.191670 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:21.191117 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:21.191670 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:21.191033 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 08:19:21.191670 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:21.191157 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b944dc54-z9hdf: secret "image-registry-tls" not found Jun 15 08:19:21.191670 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:21.191209 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:19:21.191670 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:21.191223 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls podName:2c132e12-5da5-424b-a957-50952de70322 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:37.191201749 +0000 UTC m=+69.165200340 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls") pod "image-registry-64b944dc54-z9hdf" (UID: "2c132e12-5da5-424b-a957-50952de70322") : secret "image-registry-tls" not found Jun 15 08:19:21.191670 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:21.191248 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls podName:dfd67d73-cda0-4c6e-bbd3-7127f2bcef94 nodeName:}" failed. No retries permitted until 2026-06-15 08:19:37.191236585 +0000 UTC m=+69.165235187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls") pod "dns-default-g586f" (UID: "dfd67d73-cda0-4c6e-bbd3-7127f2bcef94") : secret "dns-default-metrics-tls" not found Jun 15 08:19:30.616969 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:30.616942 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-znqdf" Jun 15 08:19:34.281847 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:34.281807 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:19:34.282562 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:34.282545 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9lcn\" (UniqueName: \"kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn\") pod \"network-check-target-5r5rp\" (UID: \"da17723e-7133-4840-9c86-e3cbb8698c18\") " pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:19:34.282607 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:34.282574 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:19:34.284750 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:34.284729 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 08:19:34.284837 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:34.284767 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 08:19:34.284837 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:34.284826 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 08:19:34.292762 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:34.292736 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 08:19:34.292863 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:34.292808 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs podName:389f130c-a632-48ff-918c-c25c25daab40 nodeName:}" failed. No retries permitted until 2026-06-15 08:20:38.292787841 +0000 UTC m=+130.266786419 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs") pod "network-metrics-daemon-2jjfp" (UID: "389f130c-a632-48ff-918c-c25c25daab40") : secret "metrics-daemon-secret" not found Jun 15 08:19:34.295211 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:34.295194 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 08:19:34.296554 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:34.296536 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8e06716-3cd4-48af-95ba-b8ef131b8cbd-original-pull-secret\") pod \"global-pull-secret-syncer-4kzkb\" (UID: \"a8e06716-3cd4-48af-95ba-b8ef131b8cbd\") " pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:19:34.305309 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:34.305282 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9lcn\" (UniqueName: \"kubernetes.io/projected/da17723e-7133-4840-9c86-e3cbb8698c18-kube-api-access-x9lcn\") pod \"network-check-target-5r5rp\" (UID: \"da17723e-7133-4840-9c86-e3cbb8698c18\") " pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:19:34.575800 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:34.575726 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qw9r9\"" Jun 15 08:19:34.583565 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:34.583544 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:19:34.584757 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:34.584738 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4kzkb" Jun 15 08:19:34.761618 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:34.761589 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5r5rp"] Jun 15 08:19:34.766073 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:19:34.766042 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda17723e_7133_4840_9c86_e3cbb8698c18.slice/crio-7a3bc31a3d16003031f0633063143b4ec0131a3241ea710bd10de03d7fcb4cdf WatchSource:0}: Error finding container 7a3bc31a3d16003031f0633063143b4ec0131a3241ea710bd10de03d7fcb4cdf: Status 404 returned error can't find the container with id 7a3bc31a3d16003031f0633063143b4ec0131a3241ea710bd10de03d7fcb4cdf Jun 15 08:19:34.778017 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:34.777985 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4kzkb"] Jun 15 08:19:34.780554 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:19:34.780528 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e06716_3cd4_48af_95ba_b8ef131b8cbd.slice/crio-012e1bf5ef7493ea0f382bc52cdabb2d76338aab61a6cc9f925798151adc600e WatchSource:0}: Error finding container 012e1bf5ef7493ea0f382bc52cdabb2d76338aab61a6cc9f925798151adc600e: Status 404 returned error can't find the container with id 012e1bf5ef7493ea0f382bc52cdabb2d76338aab61a6cc9f925798151adc600e Jun 15 08:19:35.709604 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:35.709568 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4kzkb" event={"ID":"a8e06716-3cd4-48af-95ba-b8ef131b8cbd","Type":"ContainerStarted","Data":"012e1bf5ef7493ea0f382bc52cdabb2d76338aab61a6cc9f925798151adc600e"} Jun 15 08:19:35.711238 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:35.711208 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5r5rp" event={"ID":"da17723e-7133-4840-9c86-e3cbb8698c18","Type":"ContainerStarted","Data":"7a3bc31a3d16003031f0633063143b4ec0131a3241ea710bd10de03d7fcb4cdf"} Jun 15 08:19:37.206300 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:37.206268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:19:37.206668 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:37.206321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:19:37.206668 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:37.206420 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:19:37.206668 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:37.206433 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 08:19:37.206668 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:37.206444 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b944dc54-z9hdf: secret "image-registry-tls" not found Jun 15 08:19:37.206668 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:37.206481 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls podName:dfd67d73-cda0-4c6e-bbd3-7127f2bcef94 nodeName:}" failed. No retries permitted until 2026-06-15 08:20:09.206467378 +0000 UTC m=+101.180465954 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls") pod "dns-default-g586f" (UID: "dfd67d73-cda0-4c6e-bbd3-7127f2bcef94") : secret "dns-default-metrics-tls" not found Jun 15 08:19:37.206668 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:19:37.206494 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls podName:2c132e12-5da5-424b-a957-50952de70322 nodeName:}" failed. No retries permitted until 2026-06-15 08:20:09.206488798 +0000 UTC m=+101.180487372 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls") pod "image-registry-64b944dc54-z9hdf" (UID: "2c132e12-5da5-424b-a957-50952de70322") : secret "image-registry-tls" not found Jun 15 08:19:39.722543 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:39.722502 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5r5rp" event={"ID":"da17723e-7133-4840-9c86-e3cbb8698c18","Type":"ContainerStarted","Data":"c1a2e830cf036ce8896862477edd6b8a1e5dcd504a66e866b3a1de21cd4a519b"} Jun 15 08:19:39.723018 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:39.722653 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:19:39.737704 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:39.737643 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5r5rp" podStartSLOduration=67.553855098 podStartE2EDuration="1m11.737629045s" totalImagesPullingTime="4.183773947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:19:39.736856639 +0000 UTC m=+71.710855234" watchObservedRunningTime="2026-06-15 08:19:39.737629045 +0000 UTC m=+71.711627643" Jun 15 08:19:41.728501 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:41.728469 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4kzkb" event={"ID":"a8e06716-3cd4-48af-95ba-b8ef131b8cbd","Type":"ContainerStarted","Data":"917bdc5ff26ee6b7e6f21d38854b4d2bafd8a70c251ac559c9fc82c33703d4da"} Jun 15 08:19:41.743115 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:19:41.743066 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4kzkb" podStartSLOduration=67.473439926 podStartE2EDuration="1m13.743050228s" totalImagesPullingTime="6.269610302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:19:41.742368337 +0000 UTC m=+73.716366931" watchObservedRunningTime="2026-06-15 08:19:41.743050228 +0000 UTC m=+73.717048852" Jun 15 08:20:09.221482 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:20:09.221361 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:20:09.221482 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:20:09.221419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:20:09.221915 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:20:09.221501 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:20:09.221915 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:20:09.221506 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 08:20:09.221915 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:20:09.221523 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b944dc54-z9hdf: secret "image-registry-tls" not found Jun 15 08:20:09.221915 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:20:09.221555 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls podName:dfd67d73-cda0-4c6e-bbd3-7127f2bcef94 nodeName:}" failed. No retries permitted until 2026-06-15 08:21:13.221541442 +0000 UTC m=+165.195540016 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls") pod "dns-default-g586f" (UID: "dfd67d73-cda0-4c6e-bbd3-7127f2bcef94") : secret "dns-default-metrics-tls" not found Jun 15 08:20:09.221915 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:20:09.221576 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls podName:2c132e12-5da5-424b-a957-50952de70322 nodeName:}" failed. No retries permitted until 2026-06-15 08:21:13.221563335 +0000 UTC m=+165.195561908 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls") pod "image-registry-64b944dc54-z9hdf" (UID: "2c132e12-5da5-424b-a957-50952de70322") : secret "image-registry-tls" not found Jun 15 08:20:10.727413 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:20:10.727382 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5r5rp" Jun 15 08:20:38.310022 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:20:38.309969 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:20:38.310503 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:20:38.310144 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 08:20:38.310503 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:20:38.310214 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs podName:389f130c-a632-48ff-918c-c25c25daab40 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:40.310197719 +0000 UTC m=+252.284196294 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs") pod "network-metrics-daemon-2jjfp" (UID: "389f130c-a632-48ff-918c-c25c25daab40") : secret "metrics-daemon-secret" not found Jun 15 08:21:08.442124 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:21:08.442062 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" podUID="2c132e12-5da5-424b-a957-50952de70322" Jun 15 08:21:08.453587 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:21:08.453547 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g586f" podUID="dfd67d73-cda0-4c6e-bbd3-7127f2bcef94" Jun 15 08:21:08.478486 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:21:08.478452 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:21:08.931849 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:21:08.931821 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:21:08.932024 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:21:08.931824 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g586f" Jun 15 08:21:13.249629 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:21:13.249586 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:21:13.250029 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:21:13.249664 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:21:13.250029 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:21:13.249763 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 08:21:13.250029 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:21:13.249814 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 08:21:13.250029 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:21:13.249831 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls podName:dfd67d73-cda0-4c6e-bbd3-7127f2bcef94 nodeName:}" failed. No retries permitted until 2026-06-15 08:23:15.249815575 +0000 UTC m=+287.223814162 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls") pod "dns-default-g586f" (UID: "dfd67d73-cda0-4c6e-bbd3-7127f2bcef94") : secret "dns-default-metrics-tls" not found Jun 15 08:21:13.250029 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:21:13.249834 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b944dc54-z9hdf: secret "image-registry-tls" not found Jun 15 08:21:13.250029 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:21:13.249877 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls podName:2c132e12-5da5-424b-a957-50952de70322 nodeName:}" failed. No retries permitted until 2026-06-15 08:23:15.249865184 +0000 UTC m=+287.223863761 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls") pod "image-registry-64b944dc54-z9hdf" (UID: "2c132e12-5da5-424b-a957-50952de70322") : secret "image-registry-tls" not found Jun 15 08:21:23.452303 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:21:23.452215 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:22:31.410045 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.410014 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx"] Jun 15 08:22:31.411743 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.411718 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" Jun 15 08:22:31.413157 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.413044 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-bclhg"] Jun 15 08:22:31.414190 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.414167 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 15 08:22:31.414190 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.414179 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-l69hd\"" Jun 15 08:22:31.414374 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.414185 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 15 08:22:31.414374 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.414282 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 15 08:22:31.414374 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.414168 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 15 08:22:31.415059 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.415040 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z"] Jun 15 08:22:31.415164 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.415149 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" Jun 15 08:22:31.416643 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.416624 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-zw5mc"] Jun 15 08:22:31.416767 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.416731 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:22:31.417319 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.417299 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 15 08:22:31.417402 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.417302 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bz5f7\"" Jun 15 08:22:31.417402 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.417302 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 15 08:22:31.418076 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.418055 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.419220 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.419200 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 15 08:22:31.420101 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.420086 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lfg6h\"" Jun 15 08:22:31.420581 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.420557 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 08:22:31.420581 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.420576 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 08:22:31.421038 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.421024 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4z57n\"" Jun 15 08:22:31.421982 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.421965 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 15 08:22:31.422132 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.422117 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 15 08:22:31.422182 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.422117 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 08:22:31.422897 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.422875 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 15 08:22:31.422994 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.422913 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 08:22:31.426714 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.426673 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 15 08:22:31.437265 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.437249 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx"] Jun 15 08:22:31.438130 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.438112 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-zw5mc"] Jun 15 08:22:31.440266 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.440245 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z"] Jun 15 08:22:31.452324 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.452300 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-bclhg"] Jun 15 08:22:31.487189 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.487163 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qggx8\" (UniqueName: \"kubernetes.io/projected/13e56429-0be8-4d84-8f41-dac0aa356f6e-kube-api-access-qggx8\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:22:31.487189 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.487189 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/392eda8d-2202-40ef-a382-fb2afe22a5a4-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.487326 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.487207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb5hf\" (UniqueName: \"kubernetes.io/projected/392eda8d-2202-40ef-a382-fb2afe22a5a4-kube-api-access-jb5hf\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.487326 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.487234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:22:31.487326 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.487253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13e56429-0be8-4d84-8f41-dac0aa356f6e-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:22:31.487326 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.487298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc54g\" (UniqueName: \"kubernetes.io/projected/eb89df0a-8315-4e72-96d5-1f399510dd51-kube-api-access-xc54g\") pod \"service-ca-operator-7ccbfd59dc-lsrqx\" (UID: \"eb89df0a-8315-4e72-96d5-1f399510dd51\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" Jun 15 08:22:31.487449 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.487326 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-bclhg\" (UID: \"419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" Jun 15 08:22:31.487449 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.487341 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/392eda8d-2202-40ef-a382-fb2afe22a5a4-snapshots\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.487449 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.487358 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/392eda8d-2202-40ef-a382-fb2afe22a5a4-serving-cert\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.487449 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.487373 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-nginx-conf\") pod \"networking-console-plugin-867b76cb74-bclhg\" (UID: \"419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" Jun 15 08:22:31.487449 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.487388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb89df0a-8315-4e72-96d5-1f399510dd51-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-lsrqx\" (UID: \"eb89df0a-8315-4e72-96d5-1f399510dd51\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" Jun 15 08:22:31.487449 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.487410 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb89df0a-8315-4e72-96d5-1f399510dd51-config\") pod \"service-ca-operator-7ccbfd59dc-lsrqx\" (UID: \"eb89df0a-8315-4e72-96d5-1f399510dd51\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" Jun 15 08:22:31.487622 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.487478 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/392eda8d-2202-40ef-a382-fb2afe22a5a4-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.487622 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.487511 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/392eda8d-2202-40ef-a382-fb2afe22a5a4-tmp\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.510917 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.510888 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qbqq9"] Jun 15 08:22:31.512802 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.512785 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qbqq9" Jun 15 08:22:31.515413 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.515397 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 15 08:22:31.515500 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.515455 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 15 08:22:31.515500 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.515476 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zkbp5\"" Jun 15 08:22:31.528467 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.528449 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qbqq9"] Jun 15 08:22:31.588136 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588114 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb89df0a-8315-4e72-96d5-1f399510dd51-config\") pod \"service-ca-operator-7ccbfd59dc-lsrqx\" (UID: \"eb89df0a-8315-4e72-96d5-1f399510dd51\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" Jun 15 08:22:31.588231 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/392eda8d-2202-40ef-a382-fb2afe22a5a4-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.588231 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/392eda8d-2202-40ef-a382-fb2afe22a5a4-tmp\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.588231 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qggx8\" (UniqueName: \"kubernetes.io/projected/13e56429-0be8-4d84-8f41-dac0aa356f6e-kube-api-access-qggx8\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:22:31.588365 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588230 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/392eda8d-2202-40ef-a382-fb2afe22a5a4-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.588365 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb5hf\" (UniqueName: \"kubernetes.io/projected/392eda8d-2202-40ef-a382-fb2afe22a5a4-kube-api-access-jb5hf\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.588365 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588297 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:22:31.588365 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588327 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13e56429-0be8-4d84-8f41-dac0aa356f6e-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:22:31.588546 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc54g\" (UniqueName: \"kubernetes.io/projected/eb89df0a-8315-4e72-96d5-1f399510dd51-kube-api-access-xc54g\") pod \"service-ca-operator-7ccbfd59dc-lsrqx\" (UID: \"eb89df0a-8315-4e72-96d5-1f399510dd51\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" Jun 15 08:22:31.588546 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:31.588393 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 08:22:31.588546 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588409 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jkt5\" (UniqueName: \"kubernetes.io/projected/45bdbf70-bffe-4d88-8d13-d8d8ab39aced-kube-api-access-7jkt5\") pod \"volume-data-source-validator-bd4ccd799-qbqq9\" (UID: \"45bdbf70-bffe-4d88-8d13-d8d8ab39aced\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qbqq9" Jun 15 08:22:31.588546 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:31.588448 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls podName:13e56429-0be8-4d84-8f41-dac0aa356f6e nodeName:}" failed. No retries permitted until 2026-06-15 08:22:32.088431753 +0000 UTC m=+244.062430331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-b6h2z" (UID: "13e56429-0be8-4d84-8f41-dac0aa356f6e") : secret "cluster-monitoring-operator-tls" not found Jun 15 08:22:31.588546 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588470 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-bclhg\" (UID: \"419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" Jun 15 08:22:31.588546 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588502 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/392eda8d-2202-40ef-a382-fb2afe22a5a4-snapshots\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.588546 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588529 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/392eda8d-2202-40ef-a382-fb2afe22a5a4-serving-cert\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.588908 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-nginx-conf\") pod \"networking-console-plugin-867b76cb74-bclhg\" (UID: \"419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" Jun 15 08:22:31.588908 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588560 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/392eda8d-2202-40ef-a382-fb2afe22a5a4-tmp\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.588908 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb89df0a-8315-4e72-96d5-1f399510dd51-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-lsrqx\" (UID: \"eb89df0a-8315-4e72-96d5-1f399510dd51\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" Jun 15 08:22:31.588908 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:31.588770 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 08:22:31.588908 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:31.588830 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert podName:419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:32.088814453 +0000 UTC m=+244.062813031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-bclhg" (UID: "419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2") : secret "networking-console-plugin-cert" not found Jun 15 08:22:31.588908 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588826 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb89df0a-8315-4e72-96d5-1f399510dd51-config\") pod \"service-ca-operator-7ccbfd59dc-lsrqx\" (UID: \"eb89df0a-8315-4e72-96d5-1f399510dd51\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" Jun 15 08:22:31.589222 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.588950 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/392eda8d-2202-40ef-a382-fb2afe22a5a4-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.589222 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.589104 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/392eda8d-2202-40ef-a382-fb2afe22a5a4-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.589330 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.589245 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13e56429-0be8-4d84-8f41-dac0aa356f6e-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:22:31.589382 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.589367 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/392eda8d-2202-40ef-a382-fb2afe22a5a4-snapshots\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.589598 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.589441 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-nginx-conf\") pod \"networking-console-plugin-867b76cb74-bclhg\" (UID: \"419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" Jun 15 08:22:31.590904 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.590886 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb89df0a-8315-4e72-96d5-1f399510dd51-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-lsrqx\" (UID: \"eb89df0a-8315-4e72-96d5-1f399510dd51\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" Jun 15 08:22:31.591051 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.591037 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/392eda8d-2202-40ef-a382-fb2afe22a5a4-serving-cert\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.596912 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.596889 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc54g\" (UniqueName: \"kubernetes.io/projected/eb89df0a-8315-4e72-96d5-1f399510dd51-kube-api-access-xc54g\") pod \"service-ca-operator-7ccbfd59dc-lsrqx\" (UID: \"eb89df0a-8315-4e72-96d5-1f399510dd51\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" Jun 15 08:22:31.597071 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.597048 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qggx8\" (UniqueName: \"kubernetes.io/projected/13e56429-0be8-4d84-8f41-dac0aa356f6e-kube-api-access-qggx8\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:22:31.597159 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.597137 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb5hf\" (UniqueName: \"kubernetes.io/projected/392eda8d-2202-40ef-a382-fb2afe22a5a4-kube-api-access-jb5hf\") pod \"insights-operator-5bbd86d6bd-zw5mc\" (UID: \"392eda8d-2202-40ef-a382-fb2afe22a5a4\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.605112 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.605093 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-9jvjp"] Jun 15 08:22:31.610568 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.610551 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:31.612589 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.612569 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 15 08:22:31.612673 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.612630 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 15 08:22:31.612740 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.612716 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 15 08:22:31.613195 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.613176 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 15 08:22:31.613277 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.613200 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hbl4x\"" Jun 15 08:22:31.617022 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.616972 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-9jvjp"] Jun 15 08:22:31.617890 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.617866 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 15 08:22:31.689454 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.689390 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cff1c23d-f9fa-48d0-829b-e30fc73b579c-trusted-ca\") pod \"console-operator-5dbbb5d744-9jvjp\" (UID: \"cff1c23d-f9fa-48d0-829b-e30fc73b579c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:31.689454 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.689421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cff1c23d-f9fa-48d0-829b-e30fc73b579c-config\") pod \"console-operator-5dbbb5d744-9jvjp\" (UID: \"cff1c23d-f9fa-48d0-829b-e30fc73b579c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:31.689454 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.689438 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cff1c23d-f9fa-48d0-829b-e30fc73b579c-serving-cert\") pod \"console-operator-5dbbb5d744-9jvjp\" (UID: \"cff1c23d-f9fa-48d0-829b-e30fc73b579c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:31.689636 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.689467 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jkt5\" (UniqueName: \"kubernetes.io/projected/45bdbf70-bffe-4d88-8d13-d8d8ab39aced-kube-api-access-7jkt5\") pod \"volume-data-source-validator-bd4ccd799-qbqq9\" (UID: \"45bdbf70-bffe-4d88-8d13-d8d8ab39aced\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qbqq9" Jun 15 08:22:31.689636 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.689527 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fcqf\" (UniqueName: \"kubernetes.io/projected/cff1c23d-f9fa-48d0-829b-e30fc73b579c-kube-api-access-4fcqf\") pod \"console-operator-5dbbb5d744-9jvjp\" (UID: \"cff1c23d-f9fa-48d0-829b-e30fc73b579c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:31.697639 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.697614 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jkt5\" (UniqueName: \"kubernetes.io/projected/45bdbf70-bffe-4d88-8d13-d8d8ab39aced-kube-api-access-7jkt5\") pod \"volume-data-source-validator-bd4ccd799-qbqq9\" (UID: \"45bdbf70-bffe-4d88-8d13-d8d8ab39aced\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qbqq9" Jun 15 08:22:31.722479 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.722460 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" Jun 15 08:22:31.740656 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.740632 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" Jun 15 08:22:31.791937 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.790627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cff1c23d-f9fa-48d0-829b-e30fc73b579c-trusted-ca\") pod \"console-operator-5dbbb5d744-9jvjp\" (UID: \"cff1c23d-f9fa-48d0-829b-e30fc73b579c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:31.791937 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.790659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cff1c23d-f9fa-48d0-829b-e30fc73b579c-config\") pod \"console-operator-5dbbb5d744-9jvjp\" (UID: \"cff1c23d-f9fa-48d0-829b-e30fc73b579c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:31.791937 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.790678 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cff1c23d-f9fa-48d0-829b-e30fc73b579c-serving-cert\") pod \"console-operator-5dbbb5d744-9jvjp\" (UID: \"cff1c23d-f9fa-48d0-829b-e30fc73b579c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:31.791937 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.790735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fcqf\" (UniqueName: \"kubernetes.io/projected/cff1c23d-f9fa-48d0-829b-e30fc73b579c-kube-api-access-4fcqf\") pod \"console-operator-5dbbb5d744-9jvjp\" (UID: \"cff1c23d-f9fa-48d0-829b-e30fc73b579c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:31.791937 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.791868 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cff1c23d-f9fa-48d0-829b-e30fc73b579c-config\") pod \"console-operator-5dbbb5d744-9jvjp\" (UID: \"cff1c23d-f9fa-48d0-829b-e30fc73b579c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:31.792686 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.792655 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cff1c23d-f9fa-48d0-829b-e30fc73b579c-trusted-ca\") pod \"console-operator-5dbbb5d744-9jvjp\" (UID: \"cff1c23d-f9fa-48d0-829b-e30fc73b579c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:31.793801 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.793778 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cff1c23d-f9fa-48d0-829b-e30fc73b579c-serving-cert\") pod \"console-operator-5dbbb5d744-9jvjp\" (UID: \"cff1c23d-f9fa-48d0-829b-e30fc73b579c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:31.802324 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.802185 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fcqf\" (UniqueName: \"kubernetes.io/projected/cff1c23d-f9fa-48d0-829b-e30fc73b579c-kube-api-access-4fcqf\") pod \"console-operator-5dbbb5d744-9jvjp\" (UID: \"cff1c23d-f9fa-48d0-829b-e30fc73b579c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:31.821105 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.821080 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qbqq9" Jun 15 08:22:31.851870 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.851805 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx"] Jun 15 08:22:31.854898 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:22:31.854874 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb89df0a_8315_4e72_96d5_1f399510dd51.slice/crio-4f42d5df8e973287041278e7eb219a66f8f5bcd964a76ea391e787e349c25636 WatchSource:0}: Error finding container 4f42d5df8e973287041278e7eb219a66f8f5bcd964a76ea391e787e349c25636: Status 404 returned error can't find the container with id 4f42d5df8e973287041278e7eb219a66f8f5bcd964a76ea391e787e349c25636 Jun 15 08:22:31.874485 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.874419 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-zw5mc"] Jun 15 08:22:31.876305 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:22:31.876278 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392eda8d_2202_40ef_a382_fb2afe22a5a4.slice/crio-b98a80d30a9beb417a29cb614cab721c264004f177a1ce16846ea835f7ed60d1 WatchSource:0}: Error finding container b98a80d30a9beb417a29cb614cab721c264004f177a1ce16846ea835f7ed60d1: Status 404 returned error can't find the container with id b98a80d30a9beb417a29cb614cab721c264004f177a1ce16846ea835f7ed60d1 Jun 15 08:22:31.919996 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.919971 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:31.949275 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:31.949249 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qbqq9"] Jun 15 08:22:31.952837 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:22:31.952811 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45bdbf70_bffe_4d88_8d13_d8d8ab39aced.slice/crio-6aa111beeef143175f27517a64d8ef988eabe9ce903caff2887e7592eeb8ae74 WatchSource:0}: Error finding container 6aa111beeef143175f27517a64d8ef988eabe9ce903caff2887e7592eeb8ae74: Status 404 returned error can't find the container with id 6aa111beeef143175f27517a64d8ef988eabe9ce903caff2887e7592eeb8ae74 Jun 15 08:22:32.044830 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:32.044801 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-9jvjp"] Jun 15 08:22:32.047418 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:22:32.047397 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff1c23d_f9fa_48d0_829b_e30fc73b579c.slice/crio-761d98f6d8a8c656baa4df10db3ee01d6b66f8b5f7fd6e9670fb4b83e8d17bcc WatchSource:0}: Error finding container 761d98f6d8a8c656baa4df10db3ee01d6b66f8b5f7fd6e9670fb4b83e8d17bcc: Status 404 returned error can't find the container with id 761d98f6d8a8c656baa4df10db3ee01d6b66f8b5f7fd6e9670fb4b83e8d17bcc Jun 15 08:22:32.093034 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:32.093002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-bclhg\" (UID: \"419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" Jun 15 08:22:32.093181 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:32.093082 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:22:32.093181 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:32.093166 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 08:22:32.093181 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:32.093175 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 08:22:32.093322 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:32.093224 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls podName:13e56429-0be8-4d84-8f41-dac0aa356f6e nodeName:}" failed. No retries permitted until 2026-06-15 08:22:33.093211827 +0000 UTC m=+245.067210400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-b6h2z" (UID: "13e56429-0be8-4d84-8f41-dac0aa356f6e") : secret "cluster-monitoring-operator-tls" not found Jun 15 08:22:32.093322 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:32.093236 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert podName:419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:33.093230481 +0000 UTC m=+245.067229054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-bclhg" (UID: "419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2") : secret "networking-console-plugin-cert" not found Jun 15 08:22:32.128778 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:32.128746 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" event={"ID":"cff1c23d-f9fa-48d0-829b-e30fc73b579c","Type":"ContainerStarted","Data":"761d98f6d8a8c656baa4df10db3ee01d6b66f8b5f7fd6e9670fb4b83e8d17bcc"} Jun 15 08:22:32.129893 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:32.129866 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qbqq9" event={"ID":"45bdbf70-bffe-4d88-8d13-d8d8ab39aced","Type":"ContainerStarted","Data":"6aa111beeef143175f27517a64d8ef988eabe9ce903caff2887e7592eeb8ae74"} Jun 15 08:22:32.130864 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:32.130841 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" event={"ID":"eb89df0a-8315-4e72-96d5-1f399510dd51","Type":"ContainerStarted","Data":"4f42d5df8e973287041278e7eb219a66f8f5bcd964a76ea391e787e349c25636"} Jun 15 08:22:32.131745 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:32.131726 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" event={"ID":"392eda8d-2202-40ef-a382-fb2afe22a5a4","Type":"ContainerStarted","Data":"b98a80d30a9beb417a29cb614cab721c264004f177a1ce16846ea835f7ed60d1"} Jun 15 08:22:33.103006 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:33.102967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:22:33.103473 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:33.103059 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-bclhg\" (UID: \"419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" Jun 15 08:22:33.103473 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:33.103126 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 08:22:33.103473 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:33.103196 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls podName:13e56429-0be8-4d84-8f41-dac0aa356f6e nodeName:}" failed. No retries permitted until 2026-06-15 08:22:35.103177238 +0000 UTC m=+247.077175817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-b6h2z" (UID: "13e56429-0be8-4d84-8f41-dac0aa356f6e") : secret "cluster-monitoring-operator-tls" not found Jun 15 08:22:33.103473 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:33.103230 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 08:22:33.103473 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:33.103294 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert podName:419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:35.103274472 +0000 UTC m=+247.077273047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-bclhg" (UID: "419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2") : secret "networking-console-plugin-cert" not found Jun 15 08:22:34.141186 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:34.141141 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qbqq9" event={"ID":"45bdbf70-bffe-4d88-8d13-d8d8ab39aced","Type":"ContainerStarted","Data":"26196cccce1798cb5f9d6d86e5449ffcb983efebd10dfc877896146bad422a8c"} Jun 15 08:22:34.157054 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:34.156998 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qbqq9" podStartSLOduration=1.75076886 podStartE2EDuration="3.156980229s" totalImagesPullingTime="1.406211369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:22:34.155510632 +0000 UTC m=+246.129509230" watchObservedRunningTime="2026-06-15 08:22:34.156980229 +0000 UTC m=+246.130978827" Jun 15 08:22:35.123662 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:35.123624 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:22:35.123854 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:35.123724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-bclhg\" (UID: \"419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" Jun 15 08:22:35.123854 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:35.123789 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 08:22:35.123854 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:35.123837 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 08:22:35.124004 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:35.123871 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls podName:13e56429-0be8-4d84-8f41-dac0aa356f6e nodeName:}" failed. No retries permitted until 2026-06-15 08:22:39.123847479 +0000 UTC m=+251.097846060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-b6h2z" (UID: "13e56429-0be8-4d84-8f41-dac0aa356f6e") : secret "cluster-monitoring-operator-tls" not found Jun 15 08:22:35.124004 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:35.123895 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert podName:419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:39.123878647 +0000 UTC m=+251.097877244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-bclhg" (UID: "419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2") : secret "networking-console-plugin-cert" not found Jun 15 08:22:35.811286 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:35.811251 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-nqhcr"] Jun 15 08:22:35.813404 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:35.813388 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nqhcr" Jun 15 08:22:35.815561 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:35.815540 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 15 08:22:35.815761 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:35.815741 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 15 08:22:35.816332 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:35.816318 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2gwqc\"" Jun 15 08:22:35.826170 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:35.826146 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-nqhcr"] Jun 15 08:22:35.930705 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:35.930663 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzhqz\" (UniqueName: \"kubernetes.io/projected/d7388284-a705-43c9-a672-304e4931624b-kube-api-access-dzhqz\") pod \"migrator-d4bcd4867-nqhcr\" (UID: \"d7388284-a705-43c9-a672-304e4931624b\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nqhcr" Jun 15 08:22:36.031301 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.031272 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzhqz\" (UniqueName: \"kubernetes.io/projected/d7388284-a705-43c9-a672-304e4931624b-kube-api-access-dzhqz\") pod \"migrator-d4bcd4867-nqhcr\" (UID: \"d7388284-a705-43c9-a672-304e4931624b\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nqhcr" Jun 15 08:22:36.041835 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.041799 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzhqz\" (UniqueName: \"kubernetes.io/projected/d7388284-a705-43c9-a672-304e4931624b-kube-api-access-dzhqz\") pod \"migrator-d4bcd4867-nqhcr\" (UID: \"d7388284-a705-43c9-a672-304e4931624b\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nqhcr" Jun 15 08:22:36.124910 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.124843 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nqhcr" Jun 15 08:22:36.150411 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.150369 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" event={"ID":"392eda8d-2202-40ef-a382-fb2afe22a5a4","Type":"ContainerStarted","Data":"7f306857cc096ca17a0b13b5586feeb8822a74c7bbc6dfbed22b203700e191dd"} Jun 15 08:22:36.152070 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.152050 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/0.log" Jun 15 08:22:36.152183 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.152089 2561 generic.go:356] "Generic (PLEG): container finished" podID="cff1c23d-f9fa-48d0-829b-e30fc73b579c" containerID="fb63c27fe98f4cd1ba7ccee4c230ef706d9c0f13b33fc93b85e88e32b5527516" exitCode=255 Jun 15 08:22:36.152233 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.152176 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" event={"ID":"cff1c23d-f9fa-48d0-829b-e30fc73b579c","Type":"ContainerDied","Data":"fb63c27fe98f4cd1ba7ccee4c230ef706d9c0f13b33fc93b85e88e32b5527516"} Jun 15 08:22:36.152367 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.152351 2561 scope.go:117] "RemoveContainer" containerID="fb63c27fe98f4cd1ba7ccee4c230ef706d9c0f13b33fc93b85e88e32b5527516" Jun 15 08:22:36.153725 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.153624 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" event={"ID":"eb89df0a-8315-4e72-96d5-1f399510dd51","Type":"ContainerStarted","Data":"367152c123b165543e66f4d9e58a084089a509a3647f862be092e2433a1b6c33"} Jun 15 08:22:36.168411 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.168364 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" podStartSLOduration=1.771490472 podStartE2EDuration="5.16834957s" totalImagesPullingTime="3.396859098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:22:36.1671419 +0000 UTC m=+248.141140495" watchObservedRunningTime="2026-06-15 08:22:36.16834957 +0000 UTC m=+248.142348228" Jun 15 08:22:36.206089 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.206032 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" podStartSLOduration=1.7838128210000002 podStartE2EDuration="5.206012271s" totalImagesPullingTime="3.42219945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:22:36.184808797 +0000 UTC m=+248.158807394" watchObservedRunningTime="2026-06-15 08:22:36.206012271 +0000 UTC m=+248.180010867" Jun 15 08:22:36.271150 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.271112 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-nqhcr"] Jun 15 08:22:36.274708 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:22:36.274674 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7388284_a705_43c9_a672_304e4931624b.slice/crio-bf59db161d0e9da202c67ff16e80a53808ccc1e5efade3675915d01809840d39 WatchSource:0}: Error finding container bf59db161d0e9da202c67ff16e80a53808ccc1e5efade3675915d01809840d39: Status 404 returned error can't find the container with id bf59db161d0e9da202c67ff16e80a53808ccc1e5efade3675915d01809840d39 Jun 15 08:22:36.810931 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.809537 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pq9b7"] Jun 15 08:22:36.814307 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.814202 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:36.819557 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.818208 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vh8jv\"" Jun 15 08:22:36.819557 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.818467 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 08:22:36.819557 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.818625 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 08:22:36.826541 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.826517 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pq9b7"] Jun 15 08:22:36.939913 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.939879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8nb8\" (UniqueName: \"kubernetes.io/projected/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-api-access-q8nb8\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:36.940073 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.940023 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:36.940073 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.940058 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48c51f83-a382-464c-a8fb-4c3ab02c8358-data-volume\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:36.940183 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.940122 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48c51f83-a382-464c-a8fb-4c3ab02c8358-crio-socket\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:36.940183 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:36.940139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:37.040832 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.040799 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:37.040832 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.040831 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48c51f83-a382-464c-a8fb-4c3ab02c8358-data-volume\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:37.041047 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.040885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48c51f83-a382-464c-a8fb-4c3ab02c8358-crio-socket\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:37.041047 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.040901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:37.041047 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:37.040930 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 08:22:37.041047 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.040932 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nb8\" (UniqueName: \"kubernetes.io/projected/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-api-access-q8nb8\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:37.041047 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.041003 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48c51f83-a382-464c-a8fb-4c3ab02c8358-crio-socket\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:37.041047 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:37.041015 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm podName:48c51f83-a382-464c-a8fb-4c3ab02c8358 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:37.540994607 +0000 UTC m=+249.514993191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pq9b7" (UID: "48c51f83-a382-464c-a8fb-4c3ab02c8358") : configmap "kube-rbac-proxy" not found Jun 15 08:22:37.041047 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:37.041045 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 08:22:37.041400 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:37.041096 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls podName:48c51f83-a382-464c-a8fb-4c3ab02c8358 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:37.541080908 +0000 UTC m=+249.515079484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pq9b7" (UID: "48c51f83-a382-464c-a8fb-4c3ab02c8358") : secret "insights-runtime-extractor-tls" not found Jun 15 08:22:37.041400 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.041351 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48c51f83-a382-464c-a8fb-4c3ab02c8358-data-volume\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:37.052207 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.052179 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8nb8\" (UniqueName: \"kubernetes.io/projected/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-api-access-q8nb8\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:37.159624 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.159547 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:22:37.160060 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.160034 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/0.log" Jun 15 08:22:37.160197 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.160077 2561 generic.go:356] "Generic (PLEG): container finished" podID="cff1c23d-f9fa-48d0-829b-e30fc73b579c" containerID="5079977860dade1d1c36b305a787f9db5d59702b1a67ef18fb0476ec43c0b178" exitCode=255 Jun 15 08:22:37.160268 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.160169 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" event={"ID":"cff1c23d-f9fa-48d0-829b-e30fc73b579c","Type":"ContainerDied","Data":"5079977860dade1d1c36b305a787f9db5d59702b1a67ef18fb0476ec43c0b178"} Jun 15 08:22:37.160322 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.160291 2561 scope.go:117] "RemoveContainer" containerID="fb63c27fe98f4cd1ba7ccee4c230ef706d9c0f13b33fc93b85e88e32b5527516" Jun 15 08:22:37.160399 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.160380 2561 scope.go:117] "RemoveContainer" containerID="5079977860dade1d1c36b305a787f9db5d59702b1a67ef18fb0476ec43c0b178" Jun 15 08:22:37.160590 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:37.160564 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-9jvjp_openshift-console-operator(cff1c23d-f9fa-48d0-829b-e30fc73b579c)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" podUID="cff1c23d-f9fa-48d0-829b-e30fc73b579c" Jun 15 08:22:37.162028 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.162003 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nqhcr" event={"ID":"d7388284-a705-43c9-a672-304e4931624b","Type":"ContainerStarted","Data":"bf59db161d0e9da202c67ff16e80a53808ccc1e5efade3675915d01809840d39"} Jun 15 08:22:37.546653 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.546629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:37.546869 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:37.546785 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 08:22:37.546869 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:37.546822 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:37.546869 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:37.546832 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls podName:48c51f83-a382-464c-a8fb-4c3ab02c8358 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:38.546817565 +0000 UTC m=+250.520816140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pq9b7" (UID: "48c51f83-a382-464c-a8fb-4c3ab02c8358") : secret "insights-runtime-extractor-tls" not found Jun 15 08:22:37.547022 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:37.546909 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 08:22:37.547022 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:37.546949 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm podName:48c51f83-a382-464c-a8fb-4c3ab02c8358 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:38.54693793 +0000 UTC m=+250.520936503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pq9b7" (UID: "48c51f83-a382-464c-a8fb-4c3ab02c8358") : configmap "kube-rbac-proxy" not found Jun 15 08:22:38.166553 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:38.166528 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:22:38.167033 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:38.166910 2561 scope.go:117] "RemoveContainer" containerID="5079977860dade1d1c36b305a787f9db5d59702b1a67ef18fb0476ec43c0b178" Jun 15 08:22:38.167126 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:38.167102 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-9jvjp_openshift-console-operator(cff1c23d-f9fa-48d0-829b-e30fc73b579c)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" podUID="cff1c23d-f9fa-48d0-829b-e30fc73b579c" Jun 15 08:22:38.168367 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:38.168344 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nqhcr" event={"ID":"d7388284-a705-43c9-a672-304e4931624b","Type":"ContainerStarted","Data":"03181f2d4c240b2f7e40a9f393362fadbe77425492f73d34b644d463909241c4"} Jun 15 08:22:38.168470 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:38.168411 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nqhcr" event={"ID":"d7388284-a705-43c9-a672-304e4931624b","Type":"ContainerStarted","Data":"99ca4b8c7493cfd2850b4688e066bf0d4f67909c0f38291d208f8830f7d8c9c4"} Jun 15 08:22:38.199574 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:38.199527 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nqhcr" podStartSLOduration=2.051464603 podStartE2EDuration="3.199513072s" totalImagesPullingTime="1.148048469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:22:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:22:38.198882916 +0000 UTC m=+250.172881530" watchObservedRunningTime="2026-06-15 08:22:38.199513072 +0000 UTC m=+250.173511666" Jun 15 08:22:38.554790 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:38.554757 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:38.554959 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:38.554845 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:38.554959 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:38.554901 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 08:22:38.554959 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:38.554933 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 08:22:38.555100 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:38.554962 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls podName:48c51f83-a382-464c-a8fb-4c3ab02c8358 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:40.554946881 +0000 UTC m=+252.528945454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pq9b7" (UID: "48c51f83-a382-464c-a8fb-4c3ab02c8358") : secret "insights-runtime-extractor-tls" not found Jun 15 08:22:38.555100 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:38.554989 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm podName:48c51f83-a382-464c-a8fb-4c3ab02c8358 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:40.554972321 +0000 UTC m=+252.528970897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pq9b7" (UID: "48c51f83-a382-464c-a8fb-4c3ab02c8358") : configmap "kube-rbac-proxy" not found Jun 15 08:22:39.160657 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:39.160626 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-bclhg\" (UID: \"419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" Jun 15 08:22:39.160850 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:39.160766 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:22:39.160850 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:39.160805 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 08:22:39.160983 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:39.160872 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 08:22:39.160983 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:39.160878 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert podName:419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:47.160862374 +0000 UTC m=+259.134860951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-bclhg" (UID: "419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2") : secret "networking-console-plugin-cert" not found Jun 15 08:22:39.160983 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:39.160934 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls podName:13e56429-0be8-4d84-8f41-dac0aa356f6e nodeName:}" failed. No retries permitted until 2026-06-15 08:22:47.160918622 +0000 UTC m=+259.134917200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-b6h2z" (UID: "13e56429-0be8-4d84-8f41-dac0aa356f6e") : secret "cluster-monitoring-operator-tls" not found Jun 15 08:22:39.610764 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:39.610737 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mqbqb_4b02eb3e-079d-49a6-9a82-d5b195cde884/dns-node-resolver/0.log" Jun 15 08:22:40.370920 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:40.370886 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:22:40.371097 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:40.371038 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 08:22:40.371143 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:40.371101 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs podName:389f130c-a632-48ff-918c-c25c25daab40 nodeName:}" failed. No retries permitted until 2026-06-15 08:24:42.371086535 +0000 UTC m=+374.345085109 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs") pod "network-metrics-daemon-2jjfp" (UID: "389f130c-a632-48ff-918c-c25c25daab40") : secret "metrics-daemon-secret" not found Jun 15 08:22:40.571879 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:40.571844 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:40.572075 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:40.571908 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:40.572075 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:40.571954 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 08:22:40.572075 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:40.572013 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm podName:48c51f83-a382-464c-a8fb-4c3ab02c8358 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:44.571995003 +0000 UTC m=+256.545993588 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pq9b7" (UID: "48c51f83-a382-464c-a8fb-4c3ab02c8358") : configmap "kube-rbac-proxy" not found Jun 15 08:22:40.572075 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:40.572062 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 08:22:40.572232 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:40.572119 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls podName:48c51f83-a382-464c-a8fb-4c3ab02c8358 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:44.57210197 +0000 UTC m=+256.546100545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pq9b7" (UID: "48c51f83-a382-464c-a8fb-4c3ab02c8358") : secret "insights-runtime-extractor-tls" not found Jun 15 08:22:40.609468 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:40.609445 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h6rmt_eadd1131-282b-4043-9010-55772e805b18/node-ca/0.log" Jun 15 08:22:41.210643 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:41.210613 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7r556_b021cbb3-0e41-4dbf-96d2-5e0302c69db6/serve-healthcheck-canary/0.log" Jun 15 08:22:41.811919 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:41.811891 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-nqhcr_d7388284-a705-43c9-a672-304e4931624b/migrator/0.log" Jun 15 08:22:41.920994 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:41.920969 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:41.921116 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:41.921012 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:41.921292 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:41.921281 2561 scope.go:117] "RemoveContainer" containerID="5079977860dade1d1c36b305a787f9db5d59702b1a67ef18fb0476ec43c0b178" Jun 15 08:22:41.921430 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:41.921412 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-9jvjp_openshift-console-operator(cff1c23d-f9fa-48d0-829b-e30fc73b579c)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" podUID="cff1c23d-f9fa-48d0-829b-e30fc73b579c" Jun 15 08:22:42.009677 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:42.009648 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-nqhcr_d7388284-a705-43c9-a672-304e4931624b/graceful-termination/0.log" Jun 15 08:22:44.601118 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:44.601081 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:44.601492 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:44.601147 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:44.601492 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:44.601211 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 08:22:44.601492 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:44.601238 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 08:22:44.601492 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:44.601281 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm podName:48c51f83-a382-464c-a8fb-4c3ab02c8358 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:52.601262405 +0000 UTC m=+264.575260989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pq9b7" (UID: "48c51f83-a382-464c-a8fb-4c3ab02c8358") : configmap "kube-rbac-proxy" not found Jun 15 08:22:44.601492 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:44.601295 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls podName:48c51f83-a382-464c-a8fb-4c3ab02c8358 nodeName:}" failed. No retries permitted until 2026-06-15 08:22:52.601289042 +0000 UTC m=+264.575287618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pq9b7" (UID: "48c51f83-a382-464c-a8fb-4c3ab02c8358") : secret "insights-runtime-extractor-tls" not found Jun 15 08:22:47.221329 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:47.221250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-bclhg\" (UID: \"419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" Jun 15 08:22:47.221329 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:47.221328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:22:47.221788 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:47.221413 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 08:22:47.221788 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:47.221425 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 08:22:47.221788 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:47.221469 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls podName:13e56429-0be8-4d84-8f41-dac0aa356f6e nodeName:}" failed. No retries permitted until 2026-06-15 08:23:03.221455616 +0000 UTC m=+275.195454189 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-b6h2z" (UID: "13e56429-0be8-4d84-8f41-dac0aa356f6e") : secret "cluster-monitoring-operator-tls" not found Jun 15 08:22:47.221788 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:22:47.221491 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert podName:419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2 nodeName:}" failed. No retries permitted until 2026-06-15 08:23:03.221473831 +0000 UTC m=+275.195472427 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-bclhg" (UID: "419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2") : secret "networking-console-plugin-cert" not found Jun 15 08:22:52.666263 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:52.666230 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:52.666603 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:52.666292 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:52.666758 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:52.666724 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48c51f83-a382-464c-a8fb-4c3ab02c8358-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:52.668600 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:52.668575 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48c51f83-a382-464c-a8fb-4c3ab02c8358-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq9b7\" (UID: \"48c51f83-a382-464c-a8fb-4c3ab02c8358\") " pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:52.728980 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:52.728952 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pq9b7" Jun 15 08:22:52.854945 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:52.854876 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pq9b7"] Jun 15 08:22:52.857301 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:22:52.857274 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48c51f83_a382_464c_a8fb_4c3ab02c8358.slice/crio-a4f78590b65dde6c05a2abaf936307c1143cb3ab8b9ea3f7d9e9aad3e47461ee WatchSource:0}: Error finding container a4f78590b65dde6c05a2abaf936307c1143cb3ab8b9ea3f7d9e9aad3e47461ee: Status 404 returned error can't find the container with id a4f78590b65dde6c05a2abaf936307c1143cb3ab8b9ea3f7d9e9aad3e47461ee Jun 15 08:22:53.213089 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:53.213048 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pq9b7" event={"ID":"48c51f83-a382-464c-a8fb-4c3ab02c8358","Type":"ContainerStarted","Data":"a4f78590b65dde6c05a2abaf936307c1143cb3ab8b9ea3f7d9e9aad3e47461ee"} Jun 15 08:22:56.451940 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:56.451917 2561 scope.go:117] "RemoveContainer" containerID="5079977860dade1d1c36b305a787f9db5d59702b1a67ef18fb0476ec43c0b178" Jun 15 08:22:57.233492 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:57.233402 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pq9b7" event={"ID":"48c51f83-a382-464c-a8fb-4c3ab02c8358","Type":"ContainerStarted","Data":"9f840f8abe0ee900d4d533ec252329e1567079a5d963dc063921172a4cb03655"} Jun 15 08:22:57.233654 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:57.233496 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pq9b7" event={"ID":"48c51f83-a382-464c-a8fb-4c3ab02c8358","Type":"ContainerStarted","Data":"f636c4998125fad4ccf4cee1a8ea7a3d8082396c170e8985156cab8a6dd360b8"} Jun 15 08:22:57.236515 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:57.235493 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:22:57.236515 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:57.235575 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" event={"ID":"cff1c23d-f9fa-48d0-829b-e30fc73b579c","Type":"ContainerStarted","Data":"5fa4afcd6f5df27dcb2b607818ead80e9681c40e80ba523dfc571fff6561a45c"} Jun 15 08:22:57.236515 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:57.236253 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:57.242476 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:57.242453 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" Jun 15 08:22:57.257350 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:57.257308 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-9jvjp" podStartSLOduration=23.033582238 podStartE2EDuration="26.257295333s" totalImagesPullingTime="3.223713095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:22:57.256337483 +0000 UTC m=+269.230336077" watchObservedRunningTime="2026-06-15 08:22:57.257295333 +0000 UTC m=+269.231293950" Jun 15 08:22:59.243851 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:59.243821 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pq9b7" event={"ID":"48c51f83-a382-464c-a8fb-4c3ab02c8358","Type":"ContainerStarted","Data":"d55682480e8e926d9d8ce95e25916d0c8de75253e55d4f01d9035e5225a7dc6f"} Jun 15 08:22:59.260950 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:22:59.260896 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pq9b7" podStartSLOduration=17.304262581 podStartE2EDuration="23.2608778s" totalImagesPullingTime="5.956615219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:22:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:22:59.260300684 +0000 UTC m=+271.234299313" watchObservedRunningTime="2026-06-15 08:22:59.2608778 +0000 UTC m=+271.234876396" Jun 15 08:23:03.256834 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:03.256801 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-bclhg\" (UID: \"419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" Jun 15 08:23:03.257261 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:03.256885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:23:03.259267 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:03.259245 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13e56429-0be8-4d84-8f41-dac0aa356f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-b6h2z\" (UID: \"13e56429-0be8-4d84-8f41-dac0aa356f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:23:03.259341 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:03.259304 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-bclhg\" (UID: \"419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" Jun 15 08:23:03.529173 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:03.529088 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" Jun 15 08:23:03.534114 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:03.534092 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" Jun 15 08:23:03.663660 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:03.663630 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-bclhg"] Jun 15 08:23:03.665956 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:23:03.665926 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419fdc27_dbf4_4056_9ca9_f30c4d1cc9f2.slice/crio-89eb0d5f98bb475694161addc66a378a64a7912a067ab12a5f16acdcba0cecce WatchSource:0}: Error finding container 89eb0d5f98bb475694161addc66a378a64a7912a067ab12a5f16acdcba0cecce: Status 404 returned error can't find the container with id 89eb0d5f98bb475694161addc66a378a64a7912a067ab12a5f16acdcba0cecce Jun 15 08:23:03.681577 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:03.681545 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z"] Jun 15 08:23:03.683771 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:23:03.683750 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e56429_0be8_4d84_8f41_dac0aa356f6e.slice/crio-89591c2fc6a0f54ba44c73e712b99934a94196c345b09b6e2224c398ff3ea0c8 WatchSource:0}: Error finding container 89591c2fc6a0f54ba44c73e712b99934a94196c345b09b6e2224c398ff3ea0c8: Status 404 returned error can't find the container with id 89591c2fc6a0f54ba44c73e712b99934a94196c345b09b6e2224c398ff3ea0c8 Jun 15 08:23:04.259774 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:04.259738 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" event={"ID":"13e56429-0be8-4d84-8f41-dac0aa356f6e","Type":"ContainerStarted","Data":"89591c2fc6a0f54ba44c73e712b99934a94196c345b09b6e2224c398ff3ea0c8"} Jun 15 08:23:04.260925 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:04.260900 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" event={"ID":"419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2","Type":"ContainerStarted","Data":"89eb0d5f98bb475694161addc66a378a64a7912a067ab12a5f16acdcba0cecce"} Jun 15 08:23:05.265215 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:05.265182 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" event={"ID":"419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2","Type":"ContainerStarted","Data":"d8009e0af72d305d58754eaa185fc9331bad2b9cbee84b8b1a8b1318b612ba71"} Jun 15 08:23:05.282276 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:05.282224 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-bclhg" podStartSLOduration=33.01131506 podStartE2EDuration="34.282206362s" totalImagesPullingTime="1.270891302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:05.28101063 +0000 UTC m=+277.255009225" watchObservedRunningTime="2026-06-15 08:23:05.282206362 +0000 UTC m=+277.256204957" Jun 15 08:23:06.270733 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:06.270684 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" event={"ID":"13e56429-0be8-4d84-8f41-dac0aa356f6e","Type":"ContainerStarted","Data":"399c6dd16d27ca464018260bc6b7b995ec9dcd3d70ad423d8545ff53258243c0"} Jun 15 08:23:06.292057 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:06.291995 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-b6h2z" podStartSLOduration=33.130346472 podStartE2EDuration="35.291974175s" totalImagesPullingTime="2.161627703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:06.290232276 +0000 UTC m=+278.264230891" watchObservedRunningTime="2026-06-15 08:23:06.291974175 +0000 UTC m=+278.265972771" Jun 15 08:23:06.337367 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:06.337326 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-97p8c"] Jun 15 08:23:06.340707 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:06.340681 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-97p8c" Jun 15 08:23:06.342722 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:06.342688 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 15 08:23:06.342826 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:06.342799 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zx9l9\"" Jun 15 08:23:06.347727 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:06.347438 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-97p8c"] Jun 15 08:23:06.488633 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:06.488599 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4908d13e-e52a-42b7-a4bd-07e3505d268e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-97p8c\" (UID: \"4908d13e-e52a-42b7-a4bd-07e3505d268e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-97p8c" Jun 15 08:23:06.590165 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:06.590078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4908d13e-e52a-42b7-a4bd-07e3505d268e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-97p8c\" (UID: \"4908d13e-e52a-42b7-a4bd-07e3505d268e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-97p8c" Jun 15 08:23:06.590298 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:23:06.590214 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 15 08:23:06.590298 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:23:06.590274 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4908d13e-e52a-42b7-a4bd-07e3505d268e-tls-certificates podName:4908d13e-e52a-42b7-a4bd-07e3505d268e nodeName:}" failed. No retries permitted until 2026-06-15 08:23:07.090260261 +0000 UTC m=+279.064258834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/4908d13e-e52a-42b7-a4bd-07e3505d268e-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-97p8c" (UID: "4908d13e-e52a-42b7-a4bd-07e3505d268e") : secret "prometheus-operator-admission-webhook-tls" not found Jun 15 08:23:07.093216 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:07.093165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4908d13e-e52a-42b7-a4bd-07e3505d268e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-97p8c\" (UID: \"4908d13e-e52a-42b7-a4bd-07e3505d268e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-97p8c" Jun 15 08:23:07.095769 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:07.095742 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4908d13e-e52a-42b7-a4bd-07e3505d268e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-97p8c\" (UID: \"4908d13e-e52a-42b7-a4bd-07e3505d268e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-97p8c" Jun 15 08:23:07.249994 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:07.249963 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-97p8c" Jun 15 08:23:07.388159 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:07.388084 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-97p8c"] Jun 15 08:23:07.392096 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:23:07.392066 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4908d13e_e52a_42b7_a4bd_07e3505d268e.slice/crio-4336ebe2c70ef39bb0f8e35b5e7c10f0aeb9127f15779d65fadbab24f767b216 WatchSource:0}: Error finding container 4336ebe2c70ef39bb0f8e35b5e7c10f0aeb9127f15779d65fadbab24f767b216: Status 404 returned error can't find the container with id 4336ebe2c70ef39bb0f8e35b5e7c10f0aeb9127f15779d65fadbab24f767b216 Jun 15 08:23:08.279658 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:08.279620 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-97p8c" event={"ID":"4908d13e-e52a-42b7-a4bd-07e3505d268e","Type":"ContainerStarted","Data":"4336ebe2c70ef39bb0f8e35b5e7c10f0aeb9127f15779d65fadbab24f767b216"} Jun 15 08:23:09.283879 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:09.283844 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-97p8c" event={"ID":"4908d13e-e52a-42b7-a4bd-07e3505d268e","Type":"ContainerStarted","Data":"1a64843245fbb0a6bce9b6d1d20c0d1c855000e4f96ea0e2ac9a1ab98cbe455a"} Jun 15 08:23:09.284260 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:09.284030 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-97p8c" Jun 15 08:23:09.288710 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:09.288674 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-97p8c" Jun 15 08:23:09.298898 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:09.298858 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-97p8c" podStartSLOduration=1.92452682 podStartE2EDuration="3.298846752s" totalImagesPullingTime="1.374319932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:23:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:09.298215257 +0000 UTC m=+281.272213863" watchObservedRunningTime="2026-06-15 08:23:09.298846752 +0000 UTC m=+281.272845344" Jun 15 08:23:10.396740 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.396710 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj"] Jun 15 08:23:10.444936 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.444906 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj"] Jun 15 08:23:10.445090 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.445001 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:10.447421 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.447399 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 15 08:23:10.447556 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.447436 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gzmff\"" Jun 15 08:23:10.448286 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.448268 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 15 08:23:10.448359 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.448276 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 08:23:10.520141 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.520101 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a953eaea-9b77-4055-bbd8-c9391eeb65f6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-nqqhj\" (UID: \"a953eaea-9b77-4055-bbd8-c9391eeb65f6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:10.520312 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.520183 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a953eaea-9b77-4055-bbd8-c9391eeb65f6-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-nqqhj\" (UID: \"a953eaea-9b77-4055-bbd8-c9391eeb65f6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:10.520312 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.520217 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a953eaea-9b77-4055-bbd8-c9391eeb65f6-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-nqqhj\" (UID: \"a953eaea-9b77-4055-bbd8-c9391eeb65f6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:10.520312 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.520241 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kfxv\" (UniqueName: \"kubernetes.io/projected/a953eaea-9b77-4055-bbd8-c9391eeb65f6-kube-api-access-4kfxv\") pod \"prometheus-operator-864fcfc6f9-nqqhj\" (UID: \"a953eaea-9b77-4055-bbd8-c9391eeb65f6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:10.620606 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.620573 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a953eaea-9b77-4055-bbd8-c9391eeb65f6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-nqqhj\" (UID: \"a953eaea-9b77-4055-bbd8-c9391eeb65f6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:10.620743 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.620630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a953eaea-9b77-4055-bbd8-c9391eeb65f6-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-nqqhj\" (UID: \"a953eaea-9b77-4055-bbd8-c9391eeb65f6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:10.620743 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.620662 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a953eaea-9b77-4055-bbd8-c9391eeb65f6-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-nqqhj\" (UID: \"a953eaea-9b77-4055-bbd8-c9391eeb65f6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:10.620743 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.620681 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kfxv\" (UniqueName: \"kubernetes.io/projected/a953eaea-9b77-4055-bbd8-c9391eeb65f6-kube-api-access-4kfxv\") pod \"prometheus-operator-864fcfc6f9-nqqhj\" (UID: \"a953eaea-9b77-4055-bbd8-c9391eeb65f6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:10.620911 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:23:10.620799 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 15 08:23:10.620911 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:23:10.620875 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a953eaea-9b77-4055-bbd8-c9391eeb65f6-prometheus-operator-tls podName:a953eaea-9b77-4055-bbd8-c9391eeb65f6 nodeName:}" failed. No retries permitted until 2026-06-15 08:23:11.120855919 +0000 UTC m=+283.094854499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a953eaea-9b77-4055-bbd8-c9391eeb65f6-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-nqqhj" (UID: "a953eaea-9b77-4055-bbd8-c9391eeb65f6") : secret "prometheus-operator-tls" not found Jun 15 08:23:10.621411 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.621387 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a953eaea-9b77-4055-bbd8-c9391eeb65f6-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-nqqhj\" (UID: \"a953eaea-9b77-4055-bbd8-c9391eeb65f6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:10.623177 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.623153 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a953eaea-9b77-4055-bbd8-c9391eeb65f6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-nqqhj\" (UID: \"a953eaea-9b77-4055-bbd8-c9391eeb65f6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:10.630066 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:10.630042 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kfxv\" (UniqueName: \"kubernetes.io/projected/a953eaea-9b77-4055-bbd8-c9391eeb65f6-kube-api-access-4kfxv\") pod \"prometheus-operator-864fcfc6f9-nqqhj\" (UID: \"a953eaea-9b77-4055-bbd8-c9391eeb65f6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:11.124813 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.124776 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a953eaea-9b77-4055-bbd8-c9391eeb65f6-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-nqqhj\" (UID: \"a953eaea-9b77-4055-bbd8-c9391eeb65f6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:11.127340 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.127320 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a953eaea-9b77-4055-bbd8-c9391eeb65f6-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-nqqhj\" (UID: \"a953eaea-9b77-4055-bbd8-c9391eeb65f6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:11.354343 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.354314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" Jun 15 08:23:11.503499 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.503444 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj"] Jun 15 08:23:11.505895 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:23:11.505870 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda953eaea_9b77_4055_bbd8_c9391eeb65f6.slice/crio-ee88787ec9a79c1aba531c5c4f95067043adbe2585ae39a159af808c359ae4e6 WatchSource:0}: Error finding container ee88787ec9a79c1aba531c5c4f95067043adbe2585ae39a159af808c359ae4e6: Status 404 returned error can't find the container with id ee88787ec9a79c1aba531c5c4f95067043adbe2585ae39a159af808c359ae4e6 Jun 15 08:23:11.574597 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.574570 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64656ffd67-56j8b"] Jun 15 08:23:11.606558 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.606532 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64656ffd67-56j8b"] Jun 15 08:23:11.606679 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.606618 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.609890 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.609864 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 15 08:23:11.609890 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.609878 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 15 08:23:11.610071 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.609965 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 15 08:23:11.610736 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.610717 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 15 08:23:11.610818 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.610774 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 15 08:23:11.610818 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.610806 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 15 08:23:11.610938 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.610812 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8b8vt\"" Jun 15 08:23:11.610938 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.610818 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 15 08:23:11.730620 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.730591 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-oauth-serving-cert\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.730795 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.730629 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-service-ca\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.730795 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.730649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-config\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.730795 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.730665 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-serving-cert\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.730795 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.730781 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcczl\" (UniqueName: \"kubernetes.io/projected/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-kube-api-access-rcczl\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.730926 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.730809 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-oauth-config\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.831144 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.831111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-oauth-serving-cert\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.831300 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.831151 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-service-ca\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.831300 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.831172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-config\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.831300 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.831188 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-serving-cert\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.831300 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.831220 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcczl\" (UniqueName: \"kubernetes.io/projected/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-kube-api-access-rcczl\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.831300 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.831254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-oauth-config\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.831933 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.831910 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-oauth-serving-cert\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.832029 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.831917 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-config\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.832200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.832181 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-service-ca\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.833802 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.833786 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-serving-cert\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.833938 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.833924 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-oauth-config\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.839481 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.839462 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcczl\" (UniqueName: \"kubernetes.io/projected/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-kube-api-access-rcczl\") pod \"console-64656ffd67-56j8b\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.915714 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:11.915667 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:11.932559 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:23:11.932533 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" podUID="2c132e12-5da5-424b-a957-50952de70322" Jun 15 08:23:11.932559 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:23:11.932546 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g586f" podUID="dfd67d73-cda0-4c6e-bbd3-7127f2bcef94" Jun 15 08:23:12.063761 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:12.063648 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64656ffd67-56j8b"] Jun 15 08:23:12.066154 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:23:12.066123 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226a6c92_8dc2_4084_aa7a_9e2db2e3ece4.slice/crio-ca63689b294e9eb72c1c550463329d57dfb84b75584e03abf386f7f62b6d40e2 WatchSource:0}: Error finding container ca63689b294e9eb72c1c550463329d57dfb84b75584e03abf386f7f62b6d40e2: Status 404 returned error can't find the container with id ca63689b294e9eb72c1c550463329d57dfb84b75584e03abf386f7f62b6d40e2 Jun 15 08:23:12.298852 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:12.298761 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64656ffd67-56j8b" event={"ID":"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4","Type":"ContainerStarted","Data":"ca63689b294e9eb72c1c550463329d57dfb84b75584e03abf386f7f62b6d40e2"} Jun 15 08:23:12.300023 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:12.299991 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" event={"ID":"a953eaea-9b77-4055-bbd8-c9391eeb65f6","Type":"ContainerStarted","Data":"ee88787ec9a79c1aba531c5c4f95067043adbe2585ae39a159af808c359ae4e6"} Jun 15 08:23:12.300147 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:12.300065 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g586f" Jun 15 08:23:12.300215 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:12.300065 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:23:14.311862 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:14.311824 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" event={"ID":"a953eaea-9b77-4055-bbd8-c9391eeb65f6","Type":"ContainerStarted","Data":"dae22bda12a6f481e8434832d6a5bfb18400d81094f0dc7ccd54b1ecc977c3f2"} Jun 15 08:23:14.312399 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:14.311887 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" event={"ID":"a953eaea-9b77-4055-bbd8-c9391eeb65f6","Type":"ContainerStarted","Data":"ba4f58940ce41ae3ff0f428f35052d18f89614cc8a3e02608a1d521390b3f2ee"} Jun 15 08:23:14.330189 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:14.330140 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nqqhj" podStartSLOduration=2.599700649 podStartE2EDuration="4.3301262s" totalImagesPullingTime="1.730425551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:23:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:14.328037567 +0000 UTC m=+286.302036163" watchObservedRunningTime="2026-06-15 08:23:14.3301262 +0000 UTC m=+286.304124794" Jun 15 08:23:15.262907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.262870 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:23:15.263092 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.262915 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:23:15.265543 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.265517 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfd67d73-cda0-4c6e-bbd3-7127f2bcef94-metrics-tls\") pod \"dns-default-g586f\" (UID: \"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94\") " pod="openshift-dns/dns-default-g586f" Jun 15 08:23:15.265753 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.265728 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls\") pod \"image-registry-64b944dc54-z9hdf\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:23:15.303595 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.303565 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pm97c\"" Jun 15 08:23:15.303769 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.303565 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r86n2\"" Jun 15 08:23:15.311033 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.311009 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:23:15.311033 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.311028 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g586f" Jun 15 08:23:15.563112 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.563081 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g586f"] Jun 15 08:23:15.566575 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:23:15.566547 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd67d73_cda0_4c6e_bbd3_7127f2bcef94.slice/crio-158924a3f109e9786b1dda1374b61c76a3fbf27c29596cbac93e21ece8b9a957 WatchSource:0}: Error finding container 158924a3f109e9786b1dda1374b61c76a3fbf27c29596cbac93e21ece8b9a957: Status 404 returned error can't find the container with id 158924a3f109e9786b1dda1374b61c76a3fbf27c29596cbac93e21ece8b9a957 Jun 15 08:23:15.587345 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.587320 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b944dc54-z9hdf"] Jun 15 08:23:15.589507 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:23:15.589482 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c132e12_5da5_424b_a957_50952de70322.slice/crio-f765c566521c919bf8116393270294f894ae9d1069d6f6d3681c5ae29016e4dd WatchSource:0}: Error finding container f765c566521c919bf8116393270294f894ae9d1069d6f6d3681c5ae29016e4dd: Status 404 returned error can't find the container with id f765c566521c919bf8116393270294f894ae9d1069d6f6d3681c5ae29016e4dd Jun 15 08:23:15.762853 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.762820 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j9th7"] Jun 15 08:23:15.766103 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.766059 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.768354 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.768336 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 08:23:15.768455 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.768344 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c5hrr\"" Jun 15 08:23:15.768514 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.768442 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 08:23:15.768514 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.768500 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 08:23:15.867814 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.867779 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bddb12b-a865-475b-a532-9a338f05fd7a-metrics-client-ca\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.867991 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.867825 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bddb12b-a865-475b-a532-9a338f05fd7a-sys\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.867991 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.867879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9bddb12b-a865-475b-a532-9a338f05fd7a-root\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.867991 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.867903 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-tls\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.867991 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.867937 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-wtmp\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.867991 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.867980 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq8mm\" (UniqueName: \"kubernetes.io/projected/9bddb12b-a865-475b-a532-9a338f05fd7a-kube-api-access-lq8mm\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.868250 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.868004 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.868250 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.868106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-accelerators-collector-config\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.868250 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.868151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-textfile\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.969196 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.969165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9bddb12b-a865-475b-a532-9a338f05fd7a-root\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.969360 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.969205 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-tls\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.969360 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.969255 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-wtmp\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.969360 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.969279 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9bddb12b-a865-475b-a532-9a338f05fd7a-root\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.969360 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.969292 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq8mm\" (UniqueName: \"kubernetes.io/projected/9bddb12b-a865-475b-a532-9a338f05fd7a-kube-api-access-lq8mm\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.969360 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.969318 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.969613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.969374 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-accelerators-collector-config\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.969613 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:23:15.969390 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 15 08:23:15.969613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.969428 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-wtmp\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.969613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.969397 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-textfile\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.969613 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:23:15.969454 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-tls podName:9bddb12b-a865-475b-a532-9a338f05fd7a nodeName:}" failed. No retries permitted until 2026-06-15 08:23:16.469434515 +0000 UTC m=+288.443433100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-tls") pod "node-exporter-j9th7" (UID: "9bddb12b-a865-475b-a532-9a338f05fd7a") : secret "node-exporter-tls" not found Jun 15 08:23:15.969613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.969528 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bddb12b-a865-475b-a532-9a338f05fd7a-metrics-client-ca\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.969613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.969558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bddb12b-a865-475b-a532-9a338f05fd7a-sys\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.969613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.969616 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bddb12b-a865-475b-a532-9a338f05fd7a-sys\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.970073 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.969717 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-textfile\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.970073 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.969994 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bddb12b-a865-475b-a532-9a338f05fd7a-metrics-client-ca\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.970073 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.970059 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-accelerators-collector-config\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.972198 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.972181 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:15.977574 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:15.977557 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq8mm\" (UniqueName: \"kubernetes.io/projected/9bddb12b-a865-475b-a532-9a338f05fd7a-kube-api-access-lq8mm\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:16.319626 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:16.319593 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g586f" event={"ID":"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94","Type":"ContainerStarted","Data":"158924a3f109e9786b1dda1374b61c76a3fbf27c29596cbac93e21ece8b9a957"} Jun 15 08:23:16.321005 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:16.320982 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" event={"ID":"2c132e12-5da5-424b-a957-50952de70322","Type":"ContainerStarted","Data":"a2e1844f38fa31f42ffa660d4e422e5cf5a0496710c35fdd0b6caf321fc4d8be"} Jun 15 08:23:16.321113 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:16.321018 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" event={"ID":"2c132e12-5da5-424b-a957-50952de70322","Type":"ContainerStarted","Data":"f765c566521c919bf8116393270294f894ae9d1069d6f6d3681c5ae29016e4dd"} Jun 15 08:23:16.321113 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:16.321038 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:23:16.322453 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:16.322432 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64656ffd67-56j8b" event={"ID":"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4","Type":"ContainerStarted","Data":"6db4352c77c65270cc101679b7b7fd5b4697357531fc62652df0010a13312b3d"} Jun 15 08:23:16.341507 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:16.341466 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" podStartSLOduration=287.341452082 podStartE2EDuration="4m47.341452082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:18:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:16.340451348 +0000 UTC m=+288.314449945" watchObservedRunningTime="2026-06-15 08:23:16.341452082 +0000 UTC m=+288.315450676" Jun 15 08:23:16.359102 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:16.359047 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64656ffd67-56j8b" podStartSLOduration=1.963301124 podStartE2EDuration="5.359029069s" totalImagesPullingTime="3.395727945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:16.357491279 +0000 UTC m=+288.331490064" watchObservedRunningTime="2026-06-15 08:23:16.359029069 +0000 UTC m=+288.333027667" Jun 15 08:23:16.474810 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:16.474773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-tls\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:16.479928 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:16.478366 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bddb12b-a865-475b-a532-9a338f05fd7a-node-exporter-tls\") pod \"node-exporter-j9th7\" (UID: \"9bddb12b-a865-475b-a532-9a338f05fd7a\") " pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:16.676109 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:16.676031 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j9th7" Jun 15 08:23:16.689784 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:23:16.689748 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bddb12b_a865_475b_a532_9a338f05fd7a.slice/crio-ae0eb81cf89f941f87831843788b9b263e2b9fab9bf95587b19634d6170f1888 WatchSource:0}: Error finding container ae0eb81cf89f941f87831843788b9b263e2b9fab9bf95587b19634d6170f1888: Status 404 returned error can't find the container with id ae0eb81cf89f941f87831843788b9b263e2b9fab9bf95587b19634d6170f1888 Jun 15 08:23:17.328084 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:17.328043 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9th7" event={"ID":"9bddb12b-a865-475b-a532-9a338f05fd7a","Type":"ContainerStarted","Data":"ae0eb81cf89f941f87831843788b9b263e2b9fab9bf95587b19634d6170f1888"} Jun 15 08:23:18.337237 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.337213 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9th7" event={"ID":"9bddb12b-a865-475b-a532-9a338f05fd7a","Type":"ContainerStarted","Data":"3a675c1938562e1fd3939d183877788f5f43dd9795badf033d2ca9e6d7d4ad01"} Jun 15 08:23:18.844062 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.843979 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c75766b75-bcltf"] Jun 15 08:23:18.847432 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.847417 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:18.852671 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.852642 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 15 08:23:18.852881 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.852861 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 15 08:23:18.852976 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.852863 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-pshonf0tag2\"" Jun 15 08:23:18.853038 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.853014 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-h6hg5\"" Jun 15 08:23:18.853124 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.853109 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 15 08:23:18.853177 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.853139 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 15 08:23:18.853223 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.853211 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 15 08:23:18.862005 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.861984 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c75766b75-bcltf"] Jun 15 08:23:18.998248 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.998203 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:18.998422 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.998278 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:18.998422 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.998307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-metrics-client-ca\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:18.998422 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.998335 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-tls\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:18.998542 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.998418 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-grpc-tls\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:18.998542 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.998465 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:18.998542 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.998523 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:18.998632 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:18.998555 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gpt7\" (UniqueName: \"kubernetes.io/projected/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-kube-api-access-9gpt7\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.099683 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.099595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.099683 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.099637 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gpt7\" (UniqueName: \"kubernetes.io/projected/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-kube-api-access-9gpt7\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.099683 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.099656 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.099963 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.099838 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.099963 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.099868 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-metrics-client-ca\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.099963 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.099891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-tls\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.100130 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.100082 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-grpc-tls\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.100184 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.100169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.100597 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.100562 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-metrics-client-ca\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.102671 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.102646 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.102801 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.102785 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.102939 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.102916 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.103001 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.102990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.103062 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.103007 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-thanos-querier-tls\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.103158 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.103142 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-secret-grpc-tls\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.107941 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.107919 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gpt7\" (UniqueName: \"kubernetes.io/projected/d4c91bf9-75f8-453c-bb3f-a33bc3065f9b-kube-api-access-9gpt7\") pod \"thanos-querier-6c75766b75-bcltf\" (UID: \"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b\") " pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.156299 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.156268 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:19.291483 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.291455 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c75766b75-bcltf"] Jun 15 08:23:19.295056 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:23:19.295028 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c91bf9_75f8_453c_bb3f_a33bc3065f9b.slice/crio-8feca7b99a29656c29274668886db47206951303d0a777d029d2cd719e4d84b0 WatchSource:0}: Error finding container 8feca7b99a29656c29274668886db47206951303d0a777d029d2cd719e4d84b0: Status 404 returned error can't find the container with id 8feca7b99a29656c29274668886db47206951303d0a777d029d2cd719e4d84b0 Jun 15 08:23:19.347272 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.347235 2561 generic.go:356] "Generic (PLEG): container finished" podID="9bddb12b-a865-475b-a532-9a338f05fd7a" containerID="3a675c1938562e1fd3939d183877788f5f43dd9795badf033d2ca9e6d7d4ad01" exitCode=0 Jun 15 08:23:19.347659 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.347318 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9th7" event={"ID":"9bddb12b-a865-475b-a532-9a338f05fd7a","Type":"ContainerDied","Data":"3a675c1938562e1fd3939d183877788f5f43dd9795badf033d2ca9e6d7d4ad01"} Jun 15 08:23:19.348438 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.348418 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" event={"ID":"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b","Type":"ContainerStarted","Data":"8feca7b99a29656c29274668886db47206951303d0a777d029d2cd719e4d84b0"} Jun 15 08:23:19.350035 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.349980 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g586f" event={"ID":"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94","Type":"ContainerStarted","Data":"fc76060aaf09010141e8a0d2d4cabf752f97552dfacf1934dedd72d8876c5e7c"} Jun 15 08:23:19.350035 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.350027 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g586f" event={"ID":"dfd67d73-cda0-4c6e-bbd3-7127f2bcef94","Type":"ContainerStarted","Data":"4000992aa9c73bf13cdda4c77a5198c911ac6479ee2215fb337d2272f9f834c6"} Jun 15 08:23:19.350144 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.350079 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g586f" Jun 15 08:23:19.381180 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:19.381141 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g586f" podStartSLOduration=251.711923361 podStartE2EDuration="4m14.381126944s" totalImagesPullingTime="2.669203583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:19.379926645 +0000 UTC m=+291.353925259" watchObservedRunningTime="2026-06-15 08:23:19.381126944 +0000 UTC m=+291.355125539" Jun 15 08:23:20.356120 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:20.356084 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9th7" event={"ID":"9bddb12b-a865-475b-a532-9a338f05fd7a","Type":"ContainerStarted","Data":"cfc2749eafb52cb9b60f6dad6d0dad1b831ab4b5daa8375edb1c2c4df02c2cd7"} Jun 15 08:23:20.356514 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:20.356148 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9th7" event={"ID":"9bddb12b-a865-475b-a532-9a338f05fd7a","Type":"ContainerStarted","Data":"26b86c0009d7f00d8fb959388d830bc6769a3d43b2f87f4a213f4b68a96f426e"} Jun 15 08:23:20.378265 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:20.378207 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j9th7" podStartSLOduration=3.751785572 podStartE2EDuration="5.378192835s" totalImagesPullingTime="1.541561079s" totalInitContainerRuntime="84.846184ms" isStatefulPod=true podCreationTimestamp="2026-06-15 08:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:20.375879832 +0000 UTC m=+292.349878434" watchObservedRunningTime="2026-06-15 08:23:20.378192835 +0000 UTC m=+292.352191429" Jun 15 08:23:20.958229 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:20.958198 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-9b7d69696-s6pbc"] Jun 15 08:23:20.961034 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:20.961019 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:20.965318 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:20.965296 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mjp4w\"" Jun 15 08:23:20.965970 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:20.965748 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 15 08:23:20.965970 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:20.965765 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 15 08:23:20.965970 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:20.965864 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 15 08:23:20.965970 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:20.965894 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 15 08:23:20.966206 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:20.966138 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 15 08:23:20.970990 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:20.970971 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 15 08:23:20.984172 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:20.984144 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9b7d69696-s6pbc"] Jun 15 08:23:21.007900 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.007871 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64656ffd67-56j8b"] Jun 15 08:23:21.036054 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.036029 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74c695b675-jqfpm"] Jun 15 08:23:21.039450 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.039432 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.046239 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.046218 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 15 08:23:21.049917 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.049893 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c695b675-jqfpm"] Jun 15 08:23:21.117685 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.117649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-secret-telemeter-client\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.117880 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.117736 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-serving-certs-ca-bundle\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.117880 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.117771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-federate-client-tls\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.117880 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.117815 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-metrics-client-ca\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.117880 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.117841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9xm7\" (UniqueName: \"kubernetes.io/projected/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-kube-api-access-j9xm7\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.118077 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.117891 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.118077 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.117926 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-telemeter-client-tls\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.118077 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.117970 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.219122 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219018 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-serving-certs-ca-bundle\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.219122 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219071 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-federate-client-tls\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.219122 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219102 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-oauth-config\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.219391 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219183 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-metrics-client-ca\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.219391 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219219 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9xm7\" (UniqueName: \"kubernetes.io/projected/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-kube-api-access-j9xm7\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.219391 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219256 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-trusted-ca-bundle\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.219391 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219288 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.219391 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219313 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-serving-cert\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.219391 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219350 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm6b4\" (UniqueName: \"kubernetes.io/projected/06ea2a99-1bc1-4869-8f72-3d320d6f5114-kube-api-access-xm6b4\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.219391 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219390 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-telemeter-client-tls\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.219769 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219430 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.219769 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-service-ca\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.219769 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219486 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-oauth-serving-cert\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.219769 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219518 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-config\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.219769 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219584 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-secret-telemeter-client\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.220004 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.219890 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-serving-certs-ca-bundle\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.220543 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.220136 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-metrics-client-ca\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.220661 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.220605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.222353 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.222333 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-federate-client-tls\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.222724 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.222681 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-secret-telemeter-client\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.223102 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.223077 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.223225 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.223200 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-telemeter-client-tls\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.227993 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.227970 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9xm7\" (UniqueName: \"kubernetes.io/projected/ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02-kube-api-access-j9xm7\") pod \"telemeter-client-9b7d69696-s6pbc\" (UID: \"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02\") " pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.271436 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.271406 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" Jun 15 08:23:21.320076 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.320038 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-oauth-config\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.320222 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.320102 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-trusted-ca-bundle\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.320222 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.320129 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-serving-cert\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.320222 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.320162 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm6b4\" (UniqueName: \"kubernetes.io/projected/06ea2a99-1bc1-4869-8f72-3d320d6f5114-kube-api-access-xm6b4\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.320377 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.320357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-service-ca\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.320430 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.320396 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-oauth-serving-cert\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.320479 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.320435 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-config\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.320970 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.320950 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-trusted-ca-bundle\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.321068 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.321055 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-oauth-serving-cert\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.321323 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.321302 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-service-ca\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.321370 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.321333 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-config\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.323024 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.322988 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-oauth-config\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.323121 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.323083 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-serving-cert\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.328300 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.328277 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm6b4\" (UniqueName: \"kubernetes.io/projected/06ea2a99-1bc1-4869-8f72-3d320d6f5114-kube-api-access-xm6b4\") pod \"console-74c695b675-jqfpm\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.349191 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.349167 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:21.696060 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.696031 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9b7d69696-s6pbc"] Jun 15 08:23:21.699476 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:23:21.699452 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee51c0ed_2ca3_4f89_9fb4_b28ad8017e02.slice/crio-6dc02ccdd484636ced3e9a1ddf62c0f1429172641cd69c0aa3da8ed3039329a8 WatchSource:0}: Error finding container 6dc02ccdd484636ced3e9a1ddf62c0f1429172641cd69c0aa3da8ed3039329a8: Status 404 returned error can't find the container with id 6dc02ccdd484636ced3e9a1ddf62c0f1429172641cd69c0aa3da8ed3039329a8 Jun 15 08:23:21.708106 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.708076 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c695b675-jqfpm"] Jun 15 08:23:21.711195 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:23:21.711155 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ea2a99_1bc1_4869_8f72_3d320d6f5114.slice/crio-64670c10d14bfa30119a731feec66e7c1c3fe2db69e62eec6e057b664dcb2658 WatchSource:0}: Error finding container 64670c10d14bfa30119a731feec66e7c1c3fe2db69e62eec6e057b664dcb2658: Status 404 returned error can't find the container with id 64670c10d14bfa30119a731feec66e7c1c3fe2db69e62eec6e057b664dcb2658 Jun 15 08:23:21.916056 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.916023 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:21.999453 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:21.999420 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 08:23:22.003673 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.003651 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.006629 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.006360 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zxg27\"" Jun 15 08:23:22.006629 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.006388 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 08:23:22.006629 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.006402 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 08:23:22.006629 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.006408 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 08:23:22.006629 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.006437 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 08:23:22.007186 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.007007 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 08:23:22.007618 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.007352 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 08:23:22.007618 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.007388 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 08:23:22.007618 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.007432 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 08:23:22.007618 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.007352 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 08:23:22.007618 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.007599 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 08:23:22.007944 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.007767 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 08:23:22.007944 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.007853 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 08:23:22.008163 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.008137 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 08:23:22.008545 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.008525 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 08:23:22.008980 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.008961 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7lpcbei0aps2g\"" Jun 15 08:23:22.009303 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.009285 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 08:23:22.020183 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.020159 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 08:23:22.127762 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.127660 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-config\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.127762 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.127714 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.127922 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.127770 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-web-config\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.127922 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.127791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.127922 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.127829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.127922 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.127856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.127922 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.127900 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c55e87bc-7e91-43a5-b039-2c69804933cd-config-out\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.127922 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.127918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.128132 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.127937 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.128132 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.127960 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.128132 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.128017 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.128132 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.128033 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92h2h\" (UniqueName: \"kubernetes.io/projected/c55e87bc-7e91-43a5-b039-2c69804933cd-kube-api-access-92h2h\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.128132 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.128073 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c55e87bc-7e91-43a5-b039-2c69804933cd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.128132 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.128105 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.128303 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.128138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.128303 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.128165 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.128303 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.128196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.128303 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.128214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.128303 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.128233 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.128303 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.128258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.228849 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.228803 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-web-config\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.228860 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.228912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.228945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.228996 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c55e87bc-7e91-43a5-b039-2c69804933cd-config-out\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229022 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229051 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229124 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229152 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92h2h\" (UniqueName: \"kubernetes.io/projected/c55e87bc-7e91-43a5-b039-2c69804933cd-kube-api-access-92h2h\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229182 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c55e87bc-7e91-43a5-b039-2c69804933cd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229205 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229234 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229258 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229285 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229313 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.230612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229380 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.231535 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-config\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.231535 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.231535 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.229814 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.231535 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.231396 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.232194 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.232017 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.233310 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.232588 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.233413 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.233382 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.236914 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.234324 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.236914 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.235154 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.236914 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.235445 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c55e87bc-7e91-43a5-b039-2c69804933cd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.236914 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.236045 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.237362 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.237334 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.240046 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.238940 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.240046 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.239232 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-config\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.240046 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.239238 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.240046 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.239831 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c55e87bc-7e91-43a5-b039-2c69804933cd-config-out\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.240303 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.240080 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.241294 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.241223 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.242221 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.242173 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.242221 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.242189 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-web-config\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.242488 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.242463 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.245308 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.245103 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92h2h\" (UniqueName: \"kubernetes.io/projected/c55e87bc-7e91-43a5-b039-2c69804933cd-kube-api-access-92h2h\") pod \"prometheus-k8s-0\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.315557 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.315490 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:22.367236 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.367202 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" event={"ID":"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b","Type":"ContainerStarted","Data":"c686b7a359e6878fb57fbcd8a24930eacd793af06e74d18f5e790dacf9a148a5"} Jun 15 08:23:22.367398 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.367284 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" event={"ID":"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b","Type":"ContainerStarted","Data":"9f18f13d5ed4cc00d6351964973bea76a2dad81e4a47ee60e34476858a7cc66e"} Jun 15 08:23:22.367398 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.367323 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" event={"ID":"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b","Type":"ContainerStarted","Data":"77d17d7cbbb82e8a00fd874e8d0eb7e29afbfba738f0befd26e14cbf1842fe42"} Jun 15 08:23:22.368786 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.368757 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" event={"ID":"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02","Type":"ContainerStarted","Data":"6dc02ccdd484636ced3e9a1ddf62c0f1429172641cd69c0aa3da8ed3039329a8"} Jun 15 08:23:22.370840 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.370200 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c695b675-jqfpm" event={"ID":"06ea2a99-1bc1-4869-8f72-3d320d6f5114","Type":"ContainerStarted","Data":"3f6b16ddf56b6648b67d6667e85d5e7c05135888b312181ae23bc4efe9716684"} Jun 15 08:23:22.370840 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.370236 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c695b675-jqfpm" event={"ID":"06ea2a99-1bc1-4869-8f72-3d320d6f5114","Type":"ContainerStarted","Data":"64670c10d14bfa30119a731feec66e7c1c3fe2db69e62eec6e057b664dcb2658"} Jun 15 08:23:22.389281 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.389215 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74c695b675-jqfpm" podStartSLOduration=1.389193066 podStartE2EDuration="1.389193066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:23:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:22.387262848 +0000 UTC m=+294.361261459" watchObservedRunningTime="2026-06-15 08:23:22.389193066 +0000 UTC m=+294.363191663" Jun 15 08:23:22.509381 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:22.509329 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 08:23:22.512790 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:23:22.512755 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc55e87bc_7e91_43a5_b039_2c69804933cd.slice/crio-7e33e80e59c1981e20232964df7ae5903240e8e79f66d8bec8318185c06620a9 WatchSource:0}: Error finding container 7e33e80e59c1981e20232964df7ae5903240e8e79f66d8bec8318185c06620a9: Status 404 returned error can't find the container with id 7e33e80e59c1981e20232964df7ae5903240e8e79f66d8bec8318185c06620a9 Jun 15 08:23:23.382158 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:23.382113 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" event={"ID":"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b","Type":"ContainerStarted","Data":"62c24e9ea814fe74160e6c0104457a061ffc1aa24827cbe6d464d6ab598fed4b"} Jun 15 08:23:23.382593 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:23.382216 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" event={"ID":"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b","Type":"ContainerStarted","Data":"41f184a6e84ee82088c768230c9550b654ffeffea8c287495819b344d6120ce7"} Jun 15 08:23:23.382593 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:23.382244 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" event={"ID":"d4c91bf9-75f8-453c-bb3f-a33bc3065f9b","Type":"ContainerStarted","Data":"ddda5ed51a5143bcb6079817a648e86af5274d04d38a9bd4c72c68f9a50b5ce6"} Jun 15 08:23:23.382593 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:23.382272 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:23.383384 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:23.383352 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerStarted","Data":"7e33e80e59c1981e20232964df7ae5903240e8e79f66d8bec8318185c06620a9"} Jun 15 08:23:23.406173 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:23.406117 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" podStartSLOduration=2.231147844 podStartE2EDuration="5.406102616s" totalImagesPullingTime="3.174954772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:23:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:23.404186602 +0000 UTC m=+295.378185187" watchObservedRunningTime="2026-06-15 08:23:23.406102616 +0000 UTC m=+295.380101189" Jun 15 08:23:24.389917 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:24.389871 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" event={"ID":"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02","Type":"ContainerStarted","Data":"c255cc3a5c3729508091bd26a84a0985db16494111151e44a38eab1d1eb58c54"} Jun 15 08:23:24.390311 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:24.389949 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" event={"ID":"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02","Type":"ContainerStarted","Data":"42632bdc2019a62dfaeeb21c78bfa7825e078882521249c7f8ae5600defa5028"} Jun 15 08:23:24.390311 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:24.389975 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" event={"ID":"ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02","Type":"ContainerStarted","Data":"c7788019ef30bda15bea96f5fc720934c3a65f16f40973fb2ba03ab30dddaecb"} Jun 15 08:23:24.391292 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:24.391264 2561 generic.go:356] "Generic (PLEG): container finished" podID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerID="67cb9fffd63c586127f793b75fa3fdf1e2e3b13e2b7d12b945e44904716d1a0f" exitCode=0 Jun 15 08:23:24.391393 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:24.391347 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerDied","Data":"67cb9fffd63c586127f793b75fa3fdf1e2e3b13e2b7d12b945e44904716d1a0f"} Jun 15 08:23:24.416545 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:24.416502 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-9b7d69696-s6pbc" podStartSLOduration=2.243441786 podStartE2EDuration="4.416481766s" totalImagesPullingTime="2.17303998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:24.414537636 +0000 UTC m=+296.388536242" watchObservedRunningTime="2026-06-15 08:23:24.416481766 +0000 UTC m=+296.390480385" Jun 15 08:23:26.452939 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:23:26.452895 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2jjfp" podUID="389f130c-a632-48ff-918c-c25c25daab40" Jun 15 08:23:27.413484 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:27.413459 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerStarted","Data":"658602dcff13da3cb207255c24179eb40a3cb6b7e78f74feaf584aaed45c568b"} Jun 15 08:23:28.413599 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:28.413571 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:23:28.414494 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:28.414469 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:23:28.421609 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:28.421570 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerStarted","Data":"616485ca5a0f59ad0b0bb1418bf63c503200b5c080268c4c5c1c3df79f3e9c75"} Jun 15 08:23:28.421760 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:28.421628 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerStarted","Data":"d5ceb64d9fa2e0aa98063c3d80f23655781e64cfc69aa7f6800db147d6535654"} Jun 15 08:23:28.421760 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:28.421653 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerStarted","Data":"54531f20f10b4700b8f5fdd46ec9bd54af5864971ed3e00565f951cc3cb200bb"} Jun 15 08:23:28.421760 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:28.421722 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerStarted","Data":"3982b9cdaf09b915facaf434fd1a46da1be24793c988737467392e9e8650002c"} Jun 15 08:23:28.422040 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:28.421765 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerStarted","Data":"b19cf38c3b057f2a42bb45d67560bfa25033d869b7a87f8351ddcf1e24ea3b2f"} Jun 15 08:23:28.427886 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:28.427859 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:23:28.429238 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:28.429215 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:23:28.431380 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:28.431364 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 08:23:28.470617 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:28.470112 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.148567571 podStartE2EDuration="7.470093499s" totalImagesPullingTime="4.297565102s" totalInitContainerRuntime="23.960826ms" isStatefulPod=false podCreationTimestamp="2026-06-15 08:23:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:28.467516284 +0000 UTC m=+300.441514890" watchObservedRunningTime="2026-06-15 08:23:28.470093499 +0000 UTC m=+300.444092099" Jun 15 08:23:29.358715 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:29.358672 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g586f" Jun 15 08:23:29.399054 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:29.399029 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c75766b75-bcltf" Jun 15 08:23:31.350141 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:31.350097 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:31.350499 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:31.350195 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:23:31.351557 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:31.351524 2561 patch_prober.go:28] interesting pod/console-74c695b675-jqfpm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 15 08:23:31.351676 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:31.351568 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-74c695b675-jqfpm" podUID="06ea2a99-1bc1-4869-8f72-3d320d6f5114" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 15 08:23:32.316339 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:32.316307 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:23:32.904178 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:32.904146 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64b944dc54-z9hdf"] Jun 15 08:23:32.908422 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:32.908393 2561 patch_prober.go:28] interesting pod/image-registry-64b944dc54-z9hdf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 08:23:32.908551 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:32.908441 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" podUID="2c132e12-5da5-424b-a957-50952de70322" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 08:23:35.309324 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:35.309292 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c695b675-jqfpm"] Jun 15 08:23:40.451396 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:40.451356 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:23:42.910587 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:42.910548 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:23:46.031477 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.031420 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64656ffd67-56j8b" podUID="226a6c92-8dc2-4084-aa7a-9e2db2e3ece4" containerName="console" containerID="cri-o://6db4352c77c65270cc101679b7b7fd5b4697357531fc62652df0010a13312b3d" gracePeriod=15 Jun 15 08:23:46.268342 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.268320 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:46.364014 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.363984 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcczl\" (UniqueName: \"kubernetes.io/projected/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-kube-api-access-rcczl\") pod \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " Jun 15 08:23:46.364151 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.364023 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-service-ca\") pod \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " Jun 15 08:23:46.364151 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.364048 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-oauth-serving-cert\") pod \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " Jun 15 08:23:46.364151 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.364109 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-config\") pod \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " Jun 15 08:23:46.364151 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.364142 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-serving-cert\") pod \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " Jun 15 08:23:46.364335 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.364194 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-oauth-config\") pod \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\" (UID: \"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4\") " Jun 15 08:23:46.364413 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.364386 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-service-ca" (OuterVolumeSpecName: "service-ca") pod "226a6c92-8dc2-4084-aa7a-9e2db2e3ece4" (UID: "226a6c92-8dc2-4084-aa7a-9e2db2e3ece4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:23:46.364518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.364488 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-service-ca\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:23:46.364518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.364487 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "226a6c92-8dc2-4084-aa7a-9e2db2e3ece4" (UID: "226a6c92-8dc2-4084-aa7a-9e2db2e3ece4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:23:46.364518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.364498 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-config" (OuterVolumeSpecName: "console-config") pod "226a6c92-8dc2-4084-aa7a-9e2db2e3ece4" (UID: "226a6c92-8dc2-4084-aa7a-9e2db2e3ece4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:23:46.366570 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.366541 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "226a6c92-8dc2-4084-aa7a-9e2db2e3ece4" (UID: "226a6c92-8dc2-4084-aa7a-9e2db2e3ece4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:23:46.366652 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.366564 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "226a6c92-8dc2-4084-aa7a-9e2db2e3ece4" (UID: "226a6c92-8dc2-4084-aa7a-9e2db2e3ece4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:23:46.366652 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.366602 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-kube-api-access-rcczl" (OuterVolumeSpecName: "kube-api-access-rcczl") pod "226a6c92-8dc2-4084-aa7a-9e2db2e3ece4" (UID: "226a6c92-8dc2-4084-aa7a-9e2db2e3ece4"). InnerVolumeSpecName "kube-api-access-rcczl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:23:46.465793 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.465771 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcczl\" (UniqueName: \"kubernetes.io/projected/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-kube-api-access-rcczl\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:23:46.465793 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.465795 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-oauth-serving-cert\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:23:46.465916 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.465804 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-config\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:23:46.465916 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.465812 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-serving-cert\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:23:46.465916 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.465820 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4-console-oauth-config\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:23:46.495147 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.495121 2561 generic.go:356] "Generic (PLEG): container finished" podID="eb89df0a-8315-4e72-96d5-1f399510dd51" containerID="367152c123b165543e66f4d9e58a084089a509a3647f862be092e2433a1b6c33" exitCode=0 Jun 15 08:23:46.495239 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.495194 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" event={"ID":"eb89df0a-8315-4e72-96d5-1f399510dd51","Type":"ContainerDied","Data":"367152c123b165543e66f4d9e58a084089a509a3647f862be092e2433a1b6c33"} Jun 15 08:23:46.495512 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.495491 2561 scope.go:117] "RemoveContainer" containerID="367152c123b165543e66f4d9e58a084089a509a3647f862be092e2433a1b6c33" Jun 15 08:23:46.496451 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.496426 2561 generic.go:356] "Generic (PLEG): container finished" podID="226a6c92-8dc2-4084-aa7a-9e2db2e3ece4" containerID="6db4352c77c65270cc101679b7b7fd5b4697357531fc62652df0010a13312b3d" exitCode=0 Jun 15 08:23:46.496553 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.496480 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64656ffd67-56j8b" Jun 15 08:23:46.496553 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.496512 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64656ffd67-56j8b" event={"ID":"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4","Type":"ContainerDied","Data":"6db4352c77c65270cc101679b7b7fd5b4697357531fc62652df0010a13312b3d"} Jun 15 08:23:46.496667 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.496561 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64656ffd67-56j8b" event={"ID":"226a6c92-8dc2-4084-aa7a-9e2db2e3ece4","Type":"ContainerDied","Data":"ca63689b294e9eb72c1c550463329d57dfb84b75584e03abf386f7f62b6d40e2"} Jun 15 08:23:46.496667 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.496589 2561 scope.go:117] "RemoveContainer" containerID="6db4352c77c65270cc101679b7b7fd5b4697357531fc62652df0010a13312b3d" Jun 15 08:23:46.510094 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.510068 2561 scope.go:117] "RemoveContainer" containerID="6db4352c77c65270cc101679b7b7fd5b4697357531fc62652df0010a13312b3d" Jun 15 08:23:46.510490 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:23:46.510453 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6db4352c77c65270cc101679b7b7fd5b4697357531fc62652df0010a13312b3d\": container with ID starting with 6db4352c77c65270cc101679b7b7fd5b4697357531fc62652df0010a13312b3d not found: ID does not exist" containerID="6db4352c77c65270cc101679b7b7fd5b4697357531fc62652df0010a13312b3d" Jun 15 08:23:46.510547 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.510501 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6db4352c77c65270cc101679b7b7fd5b4697357531fc62652df0010a13312b3d"} err="failed to get container status \"6db4352c77c65270cc101679b7b7fd5b4697357531fc62652df0010a13312b3d\": rpc error: code = NotFound desc = could not find container \"6db4352c77c65270cc101679b7b7fd5b4697357531fc62652df0010a13312b3d\": container with ID starting with 6db4352c77c65270cc101679b7b7fd5b4697357531fc62652df0010a13312b3d not found: ID does not exist" Jun 15 08:23:46.529507 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.529481 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64656ffd67-56j8b"] Jun 15 08:23:46.535458 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:46.535434 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64656ffd67-56j8b"] Jun 15 08:23:47.502461 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:47.502424 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-lsrqx" event={"ID":"eb89df0a-8315-4e72-96d5-1f399510dd51","Type":"ContainerStarted","Data":"243237981a556220da719246866491b99a0a162b02938af563d04fbb231c4606"} Jun 15 08:23:48.458740 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:48.458682 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="226a6c92-8dc2-4084-aa7a-9e2db2e3ece4" path="/var/lib/kubelet/pods/226a6c92-8dc2-4084-aa7a-9e2db2e3ece4/volumes" Jun 15 08:23:57.924074 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:57.924019 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" podUID="2c132e12-5da5-424b-a957-50952de70322" containerName="registry" containerID="cri-o://a2e1844f38fa31f42ffa660d4e422e5cf5a0496710c35fdd0b6caf321fc4d8be" gracePeriod=30 Jun 15 08:23:58.206405 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.206382 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:23:58.366213 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.366181 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c132e12-5da5-424b-a957-50952de70322-image-registry-private-configuration\") pod \"2c132e12-5da5-424b-a957-50952de70322\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " Jun 15 08:23:58.366213 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.366217 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls\") pod \"2c132e12-5da5-424b-a957-50952de70322\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " Jun 15 08:23:58.366445 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.366247 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wml6\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-kube-api-access-2wml6\") pod \"2c132e12-5da5-424b-a957-50952de70322\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " Jun 15 08:23:58.366445 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.366267 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c132e12-5da5-424b-a957-50952de70322-trusted-ca\") pod \"2c132e12-5da5-424b-a957-50952de70322\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " Jun 15 08:23:58.366549 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.366456 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-bound-sa-token\") pod \"2c132e12-5da5-424b-a957-50952de70322\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " Jun 15 08:23:58.366549 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.366492 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c132e12-5da5-424b-a957-50952de70322-registry-certificates\") pod \"2c132e12-5da5-424b-a957-50952de70322\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " Jun 15 08:23:58.366654 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.366556 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c132e12-5da5-424b-a957-50952de70322-installation-pull-secrets\") pod \"2c132e12-5da5-424b-a957-50952de70322\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " Jun 15 08:23:58.366654 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.366595 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c132e12-5da5-424b-a957-50952de70322-ca-trust-extracted\") pod \"2c132e12-5da5-424b-a957-50952de70322\" (UID: \"2c132e12-5da5-424b-a957-50952de70322\") " Jun 15 08:23:58.366792 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.366736 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c132e12-5da5-424b-a957-50952de70322-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2c132e12-5da5-424b-a957-50952de70322" (UID: "2c132e12-5da5-424b-a957-50952de70322"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:23:58.367021 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.366977 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c132e12-5da5-424b-a957-50952de70322-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2c132e12-5da5-424b-a957-50952de70322" (UID: "2c132e12-5da5-424b-a957-50952de70322"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:23:58.367209 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.367190 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c132e12-5da5-424b-a957-50952de70322-trusted-ca\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:23:58.367280 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.367215 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c132e12-5da5-424b-a957-50952de70322-registry-certificates\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:23:58.368803 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.368780 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-kube-api-access-2wml6" (OuterVolumeSpecName: "kube-api-access-2wml6") pod "2c132e12-5da5-424b-a957-50952de70322" (UID: "2c132e12-5da5-424b-a957-50952de70322"). InnerVolumeSpecName "kube-api-access-2wml6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:23:58.369405 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.369368 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2c132e12-5da5-424b-a957-50952de70322" (UID: "2c132e12-5da5-424b-a957-50952de70322"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:23:58.369405 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.369374 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2c132e12-5da5-424b-a957-50952de70322" (UID: "2c132e12-5da5-424b-a957-50952de70322"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:23:58.369667 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.369644 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c132e12-5da5-424b-a957-50952de70322-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2c132e12-5da5-424b-a957-50952de70322" (UID: "2c132e12-5da5-424b-a957-50952de70322"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:23:58.369768 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.369745 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c132e12-5da5-424b-a957-50952de70322-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2c132e12-5da5-424b-a957-50952de70322" (UID: "2c132e12-5da5-424b-a957-50952de70322"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:23:58.377963 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.377938 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c132e12-5da5-424b-a957-50952de70322-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2c132e12-5da5-424b-a957-50952de70322" (UID: "2c132e12-5da5-424b-a957-50952de70322"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:23:58.468379 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.468350 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c132e12-5da5-424b-a957-50952de70322-image-registry-private-configuration\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:23:58.468379 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.468374 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-registry-tls\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:23:58.468505 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.468384 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wml6\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-kube-api-access-2wml6\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:23:58.468505 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.468394 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c132e12-5da5-424b-a957-50952de70322-bound-sa-token\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:23:58.468505 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.468402 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c132e12-5da5-424b-a957-50952de70322-installation-pull-secrets\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:23:58.468505 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.468410 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c132e12-5da5-424b-a957-50952de70322-ca-trust-extracted\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:23:58.549605 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.549569 2561 generic.go:356] "Generic (PLEG): container finished" podID="2c132e12-5da5-424b-a957-50952de70322" containerID="a2e1844f38fa31f42ffa660d4e422e5cf5a0496710c35fdd0b6caf321fc4d8be" exitCode=0 Jun 15 08:23:58.549781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.549608 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" Jun 15 08:23:58.549781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.549653 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" event={"ID":"2c132e12-5da5-424b-a957-50952de70322","Type":"ContainerDied","Data":"a2e1844f38fa31f42ffa660d4e422e5cf5a0496710c35fdd0b6caf321fc4d8be"} Jun 15 08:23:58.549781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.549717 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b944dc54-z9hdf" event={"ID":"2c132e12-5da5-424b-a957-50952de70322","Type":"ContainerDied","Data":"f765c566521c919bf8116393270294f894ae9d1069d6f6d3681c5ae29016e4dd"} Jun 15 08:23:58.549781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.549743 2561 scope.go:117] "RemoveContainer" containerID="a2e1844f38fa31f42ffa660d4e422e5cf5a0496710c35fdd0b6caf321fc4d8be" Jun 15 08:23:58.558043 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.558027 2561 scope.go:117] "RemoveContainer" containerID="a2e1844f38fa31f42ffa660d4e422e5cf5a0496710c35fdd0b6caf321fc4d8be" Jun 15 08:23:58.558306 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:23:58.558284 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2e1844f38fa31f42ffa660d4e422e5cf5a0496710c35fdd0b6caf321fc4d8be\": container with ID starting with a2e1844f38fa31f42ffa660d4e422e5cf5a0496710c35fdd0b6caf321fc4d8be not found: ID does not exist" containerID="a2e1844f38fa31f42ffa660d4e422e5cf5a0496710c35fdd0b6caf321fc4d8be" Jun 15 08:23:58.558352 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.558313 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2e1844f38fa31f42ffa660d4e422e5cf5a0496710c35fdd0b6caf321fc4d8be"} err="failed to get container status \"a2e1844f38fa31f42ffa660d4e422e5cf5a0496710c35fdd0b6caf321fc4d8be\": rpc error: code = NotFound desc = could not find container \"a2e1844f38fa31f42ffa660d4e422e5cf5a0496710c35fdd0b6caf321fc4d8be\": container with ID starting with a2e1844f38fa31f42ffa660d4e422e5cf5a0496710c35fdd0b6caf321fc4d8be not found: ID does not exist" Jun 15 08:23:58.565671 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.565650 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64b944dc54-z9hdf"] Jun 15 08:23:58.570956 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:23:58.570936 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64b944dc54-z9hdf"] Jun 15 08:24:00.329440 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.329396 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74c695b675-jqfpm" podUID="06ea2a99-1bc1-4869-8f72-3d320d6f5114" containerName="console" containerID="cri-o://3f6b16ddf56b6648b67d6667e85d5e7c05135888b312181ae23bc4efe9716684" gracePeriod=15 Jun 15 08:24:00.456078 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.456048 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c132e12-5da5-424b-a957-50952de70322" path="/var/lib/kubelet/pods/2c132e12-5da5-424b-a957-50952de70322/volumes" Jun 15 08:24:00.560933 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.560905 2561 generic.go:356] "Generic (PLEG): container finished" podID="06ea2a99-1bc1-4869-8f72-3d320d6f5114" containerID="3f6b16ddf56b6648b67d6667e85d5e7c05135888b312181ae23bc4efe9716684" exitCode=0 Jun 15 08:24:00.561082 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.560986 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c695b675-jqfpm" event={"ID":"06ea2a99-1bc1-4869-8f72-3d320d6f5114","Type":"ContainerDied","Data":"3f6b16ddf56b6648b67d6667e85d5e7c05135888b312181ae23bc4efe9716684"} Jun 15 08:24:00.582277 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.582223 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:24:00.686654 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.686627 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm6b4\" (UniqueName: \"kubernetes.io/projected/06ea2a99-1bc1-4869-8f72-3d320d6f5114-kube-api-access-xm6b4\") pod \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " Jun 15 08:24:00.686822 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.686669 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-config\") pod \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " Jun 15 08:24:00.686822 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.686795 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-serving-cert\") pod \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " Jun 15 08:24:00.686910 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.686843 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-oauth-config\") pod \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " Jun 15 08:24:00.686910 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.686862 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-oauth-serving-cert\") pod \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " Jun 15 08:24:00.686910 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.686881 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-service-ca\") pod \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " Jun 15 08:24:00.687053 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.686943 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-trusted-ca-bundle\") pod \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\" (UID: \"06ea2a99-1bc1-4869-8f72-3d320d6f5114\") " Jun 15 08:24:00.687423 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.687104 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-config" (OuterVolumeSpecName: "console-config") pod "06ea2a99-1bc1-4869-8f72-3d320d6f5114" (UID: "06ea2a99-1bc1-4869-8f72-3d320d6f5114"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:24:00.687423 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.687296 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-config\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:00.687423 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.687385 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "06ea2a99-1bc1-4869-8f72-3d320d6f5114" (UID: "06ea2a99-1bc1-4869-8f72-3d320d6f5114"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:24:00.687423 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.687381 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-service-ca" (OuterVolumeSpecName: "service-ca") pod "06ea2a99-1bc1-4869-8f72-3d320d6f5114" (UID: "06ea2a99-1bc1-4869-8f72-3d320d6f5114"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:24:00.687890 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.687645 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "06ea2a99-1bc1-4869-8f72-3d320d6f5114" (UID: "06ea2a99-1bc1-4869-8f72-3d320d6f5114"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:24:00.688897 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.688874 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06ea2a99-1bc1-4869-8f72-3d320d6f5114-kube-api-access-xm6b4" (OuterVolumeSpecName: "kube-api-access-xm6b4") pod "06ea2a99-1bc1-4869-8f72-3d320d6f5114" (UID: "06ea2a99-1bc1-4869-8f72-3d320d6f5114"). InnerVolumeSpecName "kube-api-access-xm6b4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:24:00.688995 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.688953 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "06ea2a99-1bc1-4869-8f72-3d320d6f5114" (UID: "06ea2a99-1bc1-4869-8f72-3d320d6f5114"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:00.689040 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.689017 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "06ea2a99-1bc1-4869-8f72-3d320d6f5114" (UID: "06ea2a99-1bc1-4869-8f72-3d320d6f5114"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:00.788593 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.788561 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-serving-cert\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:00.788593 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.788588 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06ea2a99-1bc1-4869-8f72-3d320d6f5114-console-oauth-config\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:00.788770 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.788601 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-oauth-serving-cert\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:00.788770 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.788615 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-service-ca\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:00.788770 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.788628 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06ea2a99-1bc1-4869-8f72-3d320d6f5114-trusted-ca-bundle\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:00.788770 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:00.788640 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm6b4\" (UniqueName: \"kubernetes.io/projected/06ea2a99-1bc1-4869-8f72-3d320d6f5114-kube-api-access-xm6b4\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:01.565844 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:01.565816 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c695b675-jqfpm" Jun 15 08:24:01.566295 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:01.565816 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c695b675-jqfpm" event={"ID":"06ea2a99-1bc1-4869-8f72-3d320d6f5114","Type":"ContainerDied","Data":"64670c10d14bfa30119a731feec66e7c1c3fe2db69e62eec6e057b664dcb2658"} Jun 15 08:24:01.566295 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:01.565950 2561 scope.go:117] "RemoveContainer" containerID="3f6b16ddf56b6648b67d6667e85d5e7c05135888b312181ae23bc4efe9716684" Jun 15 08:24:01.586229 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:01.586204 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c695b675-jqfpm"] Jun 15 08:24:01.592420 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:01.592400 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74c695b675-jqfpm"] Jun 15 08:24:02.456116 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:02.456086 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06ea2a99-1bc1-4869-8f72-3d320d6f5114" path="/var/lib/kubelet/pods/06ea2a99-1bc1-4869-8f72-3d320d6f5114/volumes" Jun 15 08:24:06.586576 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:06.586495 2561 generic.go:356] "Generic (PLEG): container finished" podID="392eda8d-2202-40ef-a382-fb2afe22a5a4" containerID="7f306857cc096ca17a0b13b5586feeb8822a74c7bbc6dfbed22b203700e191dd" exitCode=0 Jun 15 08:24:06.586576 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:06.586542 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" event={"ID":"392eda8d-2202-40ef-a382-fb2afe22a5a4","Type":"ContainerDied","Data":"7f306857cc096ca17a0b13b5586feeb8822a74c7bbc6dfbed22b203700e191dd"} Jun 15 08:24:06.587049 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:06.586905 2561 scope.go:117] "RemoveContainer" containerID="7f306857cc096ca17a0b13b5586feeb8822a74c7bbc6dfbed22b203700e191dd" Jun 15 08:24:07.592855 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:07.592822 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-zw5mc" event={"ID":"392eda8d-2202-40ef-a382-fb2afe22a5a4","Type":"ContainerStarted","Data":"80f5c479c1664ad544089255d72acd5abf836f8cb9cdd51de1a0f307f16d25ec"} Jun 15 08:24:22.316117 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:22.316019 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:22.335944 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:22.335920 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:22.670914 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:22.670839 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:40.445070 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.445027 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 08:24:40.445685 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.445411 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="prometheus" containerID="cri-o://658602dcff13da3cb207255c24179eb40a3cb6b7e78f74feaf584aaed45c568b" gracePeriod=600 Jun 15 08:24:40.445685 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.445439 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="thanos-sidecar" containerID="cri-o://3982b9cdaf09b915facaf434fd1a46da1be24793c988737467392e9e8650002c" gracePeriod=600 Jun 15 08:24:40.445685 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.445448 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="config-reloader" containerID="cri-o://b19cf38c3b057f2a42bb45d67560bfa25033d869b7a87f8351ddcf1e24ea3b2f" gracePeriod=600 Jun 15 08:24:40.445685 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.445481 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="kube-rbac-proxy" containerID="cri-o://d5ceb64d9fa2e0aa98063c3d80f23655781e64cfc69aa7f6800db147d6535654" gracePeriod=600 Jun 15 08:24:40.445685 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.445423 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="kube-rbac-proxy-thanos" containerID="cri-o://616485ca5a0f59ad0b0bb1418bf63c503200b5c080268c4c5c1c3df79f3e9c75" gracePeriod=600 Jun 15 08:24:40.445685 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.445578 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="kube-rbac-proxy-web" containerID="cri-o://54531f20f10b4700b8f5fdd46ec9bd54af5864971ed3e00565f951cc3cb200bb" gracePeriod=600 Jun 15 08:24:40.730607 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.730510 2561 generic.go:356] "Generic (PLEG): container finished" podID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerID="616485ca5a0f59ad0b0bb1418bf63c503200b5c080268c4c5c1c3df79f3e9c75" exitCode=0 Jun 15 08:24:40.730607 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.730537 2561 generic.go:356] "Generic (PLEG): container finished" podID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerID="d5ceb64d9fa2e0aa98063c3d80f23655781e64cfc69aa7f6800db147d6535654" exitCode=0 Jun 15 08:24:40.730607 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.730545 2561 generic.go:356] "Generic (PLEG): container finished" podID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerID="3982b9cdaf09b915facaf434fd1a46da1be24793c988737467392e9e8650002c" exitCode=0 Jun 15 08:24:40.730607 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.730554 2561 generic.go:356] "Generic (PLEG): container finished" podID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerID="b19cf38c3b057f2a42bb45d67560bfa25033d869b7a87f8351ddcf1e24ea3b2f" exitCode=0 Jun 15 08:24:40.730607 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.730561 2561 generic.go:356] "Generic (PLEG): container finished" podID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerID="658602dcff13da3cb207255c24179eb40a3cb6b7e78f74feaf584aaed45c568b" exitCode=0 Jun 15 08:24:40.730607 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.730586 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerDied","Data":"616485ca5a0f59ad0b0bb1418bf63c503200b5c080268c4c5c1c3df79f3e9c75"} Jun 15 08:24:40.730930 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.730749 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerDied","Data":"d5ceb64d9fa2e0aa98063c3d80f23655781e64cfc69aa7f6800db147d6535654"} Jun 15 08:24:40.730930 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.730808 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerDied","Data":"3982b9cdaf09b915facaf434fd1a46da1be24793c988737467392e9e8650002c"} Jun 15 08:24:40.730930 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.730859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerDied","Data":"b19cf38c3b057f2a42bb45d67560bfa25033d869b7a87f8351ddcf1e24ea3b2f"} Jun 15 08:24:40.730930 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:40.730907 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerDied","Data":"658602dcff13da3cb207255c24179eb40a3cb6b7e78f74feaf584aaed45c568b"} Jun 15 08:24:41.694204 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.694174 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:41.739467 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.739435 2561 generic.go:356] "Generic (PLEG): container finished" podID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerID="54531f20f10b4700b8f5fdd46ec9bd54af5864971ed3e00565f951cc3cb200bb" exitCode=0 Jun 15 08:24:41.739632 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.739523 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerDied","Data":"54531f20f10b4700b8f5fdd46ec9bd54af5864971ed3e00565f951cc3cb200bb"} Jun 15 08:24:41.739632 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.739617 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c55e87bc-7e91-43a5-b039-2c69804933cd","Type":"ContainerDied","Data":"7e33e80e59c1981e20232964df7ae5903240e8e79f66d8bec8318185c06620a9"} Jun 15 08:24:41.739632 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.739541 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:41.739805 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.739669 2561 scope.go:117] "RemoveContainer" containerID="616485ca5a0f59ad0b0bb1418bf63c503200b5c080268c4c5c1c3df79f3e9c75" Jun 15 08:24:41.748841 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.748817 2561 scope.go:117] "RemoveContainer" containerID="d5ceb64d9fa2e0aa98063c3d80f23655781e64cfc69aa7f6800db147d6535654" Jun 15 08:24:41.757321 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.757295 2561 scope.go:117] "RemoveContainer" containerID="54531f20f10b4700b8f5fdd46ec9bd54af5864971ed3e00565f951cc3cb200bb" Jun 15 08:24:41.765190 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.765169 2561 scope.go:117] "RemoveContainer" containerID="3982b9cdaf09b915facaf434fd1a46da1be24793c988737467392e9e8650002c" Jun 15 08:24:41.772707 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.772672 2561 scope.go:117] "RemoveContainer" containerID="b19cf38c3b057f2a42bb45d67560bfa25033d869b7a87f8351ddcf1e24ea3b2f" Jun 15 08:24:41.780026 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.780004 2561 scope.go:117] "RemoveContainer" containerID="658602dcff13da3cb207255c24179eb40a3cb6b7e78f74feaf584aaed45c568b" Jun 15 08:24:41.788498 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.788474 2561 scope.go:117] "RemoveContainer" containerID="67cb9fffd63c586127f793b75fa3fdf1e2e3b13e2b7d12b945e44904716d1a0f" Jun 15 08:24:41.795672 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.795651 2561 scope.go:117] "RemoveContainer" containerID="616485ca5a0f59ad0b0bb1418bf63c503200b5c080268c4c5c1c3df79f3e9c75" Jun 15 08:24:41.795955 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:24:41.795936 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"616485ca5a0f59ad0b0bb1418bf63c503200b5c080268c4c5c1c3df79f3e9c75\": container with ID starting with 616485ca5a0f59ad0b0bb1418bf63c503200b5c080268c4c5c1c3df79f3e9c75 not found: ID does not exist" containerID="616485ca5a0f59ad0b0bb1418bf63c503200b5c080268c4c5c1c3df79f3e9c75" Jun 15 08:24:41.796009 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.795965 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"616485ca5a0f59ad0b0bb1418bf63c503200b5c080268c4c5c1c3df79f3e9c75"} err="failed to get container status \"616485ca5a0f59ad0b0bb1418bf63c503200b5c080268c4c5c1c3df79f3e9c75\": rpc error: code = NotFound desc = could not find container \"616485ca5a0f59ad0b0bb1418bf63c503200b5c080268c4c5c1c3df79f3e9c75\": container with ID starting with 616485ca5a0f59ad0b0bb1418bf63c503200b5c080268c4c5c1c3df79f3e9c75 not found: ID does not exist" Jun 15 08:24:41.796009 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.795984 2561 scope.go:117] "RemoveContainer" containerID="d5ceb64d9fa2e0aa98063c3d80f23655781e64cfc69aa7f6800db147d6535654" Jun 15 08:24:41.796215 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:24:41.796190 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5ceb64d9fa2e0aa98063c3d80f23655781e64cfc69aa7f6800db147d6535654\": container with ID starting with d5ceb64d9fa2e0aa98063c3d80f23655781e64cfc69aa7f6800db147d6535654 not found: ID does not exist" containerID="d5ceb64d9fa2e0aa98063c3d80f23655781e64cfc69aa7f6800db147d6535654" Jun 15 08:24:41.796215 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.796209 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5ceb64d9fa2e0aa98063c3d80f23655781e64cfc69aa7f6800db147d6535654"} err="failed to get container status \"d5ceb64d9fa2e0aa98063c3d80f23655781e64cfc69aa7f6800db147d6535654\": rpc error: code = NotFound desc = could not find container \"d5ceb64d9fa2e0aa98063c3d80f23655781e64cfc69aa7f6800db147d6535654\": container with ID starting with d5ceb64d9fa2e0aa98063c3d80f23655781e64cfc69aa7f6800db147d6535654 not found: ID does not exist" Jun 15 08:24:41.796293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.796222 2561 scope.go:117] "RemoveContainer" containerID="54531f20f10b4700b8f5fdd46ec9bd54af5864971ed3e00565f951cc3cb200bb" Jun 15 08:24:41.796457 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:24:41.796442 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54531f20f10b4700b8f5fdd46ec9bd54af5864971ed3e00565f951cc3cb200bb\": container with ID starting with 54531f20f10b4700b8f5fdd46ec9bd54af5864971ed3e00565f951cc3cb200bb not found: ID does not exist" containerID="54531f20f10b4700b8f5fdd46ec9bd54af5864971ed3e00565f951cc3cb200bb" Jun 15 08:24:41.796494 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.796462 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54531f20f10b4700b8f5fdd46ec9bd54af5864971ed3e00565f951cc3cb200bb"} err="failed to get container status \"54531f20f10b4700b8f5fdd46ec9bd54af5864971ed3e00565f951cc3cb200bb\": rpc error: code = NotFound desc = could not find container \"54531f20f10b4700b8f5fdd46ec9bd54af5864971ed3e00565f951cc3cb200bb\": container with ID starting with 54531f20f10b4700b8f5fdd46ec9bd54af5864971ed3e00565f951cc3cb200bb not found: ID does not exist" Jun 15 08:24:41.796494 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.796476 2561 scope.go:117] "RemoveContainer" containerID="3982b9cdaf09b915facaf434fd1a46da1be24793c988737467392e9e8650002c" Jun 15 08:24:41.796660 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:24:41.796643 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3982b9cdaf09b915facaf434fd1a46da1be24793c988737467392e9e8650002c\": container with ID starting with 3982b9cdaf09b915facaf434fd1a46da1be24793c988737467392e9e8650002c not found: ID does not exist" containerID="3982b9cdaf09b915facaf434fd1a46da1be24793c988737467392e9e8650002c" Jun 15 08:24:41.796757 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.796665 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3982b9cdaf09b915facaf434fd1a46da1be24793c988737467392e9e8650002c"} err="failed to get container status \"3982b9cdaf09b915facaf434fd1a46da1be24793c988737467392e9e8650002c\": rpc error: code = NotFound desc = could not find container \"3982b9cdaf09b915facaf434fd1a46da1be24793c988737467392e9e8650002c\": container with ID starting with 3982b9cdaf09b915facaf434fd1a46da1be24793c988737467392e9e8650002c not found: ID does not exist" Jun 15 08:24:41.796757 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.796678 2561 scope.go:117] "RemoveContainer" containerID="b19cf38c3b057f2a42bb45d67560bfa25033d869b7a87f8351ddcf1e24ea3b2f" Jun 15 08:24:41.796908 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:24:41.796893 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b19cf38c3b057f2a42bb45d67560bfa25033d869b7a87f8351ddcf1e24ea3b2f\": container with ID starting with b19cf38c3b057f2a42bb45d67560bfa25033d869b7a87f8351ddcf1e24ea3b2f not found: ID does not exist" containerID="b19cf38c3b057f2a42bb45d67560bfa25033d869b7a87f8351ddcf1e24ea3b2f" Jun 15 08:24:41.796959 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.796913 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b19cf38c3b057f2a42bb45d67560bfa25033d869b7a87f8351ddcf1e24ea3b2f"} err="failed to get container status \"b19cf38c3b057f2a42bb45d67560bfa25033d869b7a87f8351ddcf1e24ea3b2f\": rpc error: code = NotFound desc = could not find container \"b19cf38c3b057f2a42bb45d67560bfa25033d869b7a87f8351ddcf1e24ea3b2f\": container with ID starting with b19cf38c3b057f2a42bb45d67560bfa25033d869b7a87f8351ddcf1e24ea3b2f not found: ID does not exist" Jun 15 08:24:41.796959 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.796934 2561 scope.go:117] "RemoveContainer" containerID="658602dcff13da3cb207255c24179eb40a3cb6b7e78f74feaf584aaed45c568b" Jun 15 08:24:41.797163 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:24:41.797143 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"658602dcff13da3cb207255c24179eb40a3cb6b7e78f74feaf584aaed45c568b\": container with ID starting with 658602dcff13da3cb207255c24179eb40a3cb6b7e78f74feaf584aaed45c568b not found: ID does not exist" containerID="658602dcff13da3cb207255c24179eb40a3cb6b7e78f74feaf584aaed45c568b" Jun 15 08:24:41.797197 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.797170 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658602dcff13da3cb207255c24179eb40a3cb6b7e78f74feaf584aaed45c568b"} err="failed to get container status \"658602dcff13da3cb207255c24179eb40a3cb6b7e78f74feaf584aaed45c568b\": rpc error: code = NotFound desc = could not find container \"658602dcff13da3cb207255c24179eb40a3cb6b7e78f74feaf584aaed45c568b\": container with ID starting with 658602dcff13da3cb207255c24179eb40a3cb6b7e78f74feaf584aaed45c568b not found: ID does not exist" Jun 15 08:24:41.797197 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.797186 2561 scope.go:117] "RemoveContainer" containerID="67cb9fffd63c586127f793b75fa3fdf1e2e3b13e2b7d12b945e44904716d1a0f" Jun 15 08:24:41.797404 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:24:41.797387 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67cb9fffd63c586127f793b75fa3fdf1e2e3b13e2b7d12b945e44904716d1a0f\": container with ID starting with 67cb9fffd63c586127f793b75fa3fdf1e2e3b13e2b7d12b945e44904716d1a0f not found: ID does not exist" containerID="67cb9fffd63c586127f793b75fa3fdf1e2e3b13e2b7d12b945e44904716d1a0f" Jun 15 08:24:41.797441 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.797409 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67cb9fffd63c586127f793b75fa3fdf1e2e3b13e2b7d12b945e44904716d1a0f"} err="failed to get container status \"67cb9fffd63c586127f793b75fa3fdf1e2e3b13e2b7d12b945e44904716d1a0f\": rpc error: code = NotFound desc = could not find container \"67cb9fffd63c586127f793b75fa3fdf1e2e3b13e2b7d12b945e44904716d1a0f\": container with ID starting with 67cb9fffd63c586127f793b75fa3fdf1e2e3b13e2b7d12b945e44904716d1a0f not found: ID does not exist" Jun 15 08:24:41.838934 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.838898 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c55e87bc-7e91-43a5-b039-2c69804933cd-config-out\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.838934 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.838936 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-metrics-client-ca\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839125 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.838964 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839125 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839003 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-thanos-prometheus-http-client-file\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839125 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839107 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-db\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839259 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839141 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-kube-rbac-proxy\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839259 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839170 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-web-config\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839259 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839197 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-grpc-tls\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839259 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839224 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-config\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839259 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839247 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92h2h\" (UniqueName: \"kubernetes.io/projected/c55e87bc-7e91-43a5-b039-2c69804933cd-kube-api-access-92h2h\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839501 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839270 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c55e87bc-7e91-43a5-b039-2c69804933cd-tls-assets\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839501 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839306 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-metrics-client-certs\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839501 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839339 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-kubelet-serving-ca-bundle\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839501 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839369 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-trusted-ca-bundle\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839501 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839396 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-0\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839501 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839445 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-2\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839501 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839449 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:24:41.839501 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839470 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-tls\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839501 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839497 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-serving-certs-ca-bundle\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839950 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839534 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-1\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.839950 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839570 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c55e87bc-7e91-43a5-b039-2c69804933cd\" (UID: \"c55e87bc-7e91-43a5-b039-2c69804933cd\") " Jun 15 08:24:41.840045 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.839946 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:24:41.840091 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.840074 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:24:41.840173 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.840155 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.840224 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.840180 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-metrics-client-ca\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.841181 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.840302 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:24:41.841181 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.840367 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:24:41.841181 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.840805 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:24:41.841181 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.840945 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:24:41.842052 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.842020 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:24:41.842847 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.842724 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:41.843484 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.843447 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:41.843596 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.843504 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:41.844037 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.843988 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:41.844136 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.844094 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-config" (OuterVolumeSpecName: "config") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:41.844244 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.844222 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:41.844400 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.844374 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:41.844872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.844845 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c55e87bc-7e91-43a5-b039-2c69804933cd-config-out" (OuterVolumeSpecName: "config-out") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:24:41.845052 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.845017 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:41.845630 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.845611 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c55e87bc-7e91-43a5-b039-2c69804933cd-kube-api-access-92h2h" (OuterVolumeSpecName: "kube-api-access-92h2h") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "kube-api-access-92h2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:24:41.845865 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.845849 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c55e87bc-7e91-43a5-b039-2c69804933cd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:24:41.856629 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.856591 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-web-config" (OuterVolumeSpecName: "web-config") pod "c55e87bc-7e91-43a5-b039-2c69804933cd" (UID: "c55e87bc-7e91-43a5-b039-2c69804933cd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:24:41.941471 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941423 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941471 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941458 2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941471 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941469 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-db\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941471 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941478 2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-kube-rbac-proxy\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941471 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941487 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-web-config\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941495 2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-grpc-tls\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941503 2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-config\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941512 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92h2h\" (UniqueName: \"kubernetes.io/projected/c55e87bc-7e91-43a5-b039-2c69804933cd-kube-api-access-92h2h\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941520 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c55e87bc-7e91-43a5-b039-2c69804933cd-tls-assets\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941528 2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-metrics-client-certs\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941536 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941546 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941555 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941563 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941571 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941579 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c55e87bc-7e91-43a5-b039-2c69804933cd-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941587 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c55e87bc-7e91-43a5-b039-2c69804933cd-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:41.941812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:41.941595 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c55e87bc-7e91-43a5-b039-2c69804933cd-config-out\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:24:42.064863 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.064827 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 08:24:42.072729 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.072688 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 08:24:42.130921 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.130886 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 08:24:42.131186 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131174 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="prometheus" Jun 15 08:24:42.131228 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131188 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="prometheus" Jun 15 08:24:42.131228 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131198 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="thanos-sidecar" Jun 15 08:24:42.131228 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131204 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="thanos-sidecar" Jun 15 08:24:42.131228 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131211 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="config-reloader" Jun 15 08:24:42.131228 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131216 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="config-reloader" Jun 15 08:24:42.131228 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131222 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="kube-rbac-proxy" Jun 15 08:24:42.131228 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131227 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="kube-rbac-proxy" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131239 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c132e12-5da5-424b-a957-50952de70322" containerName="registry" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131244 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c132e12-5da5-424b-a957-50952de70322" containerName="registry" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131250 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06ea2a99-1bc1-4869-8f72-3d320d6f5114" containerName="console" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131254 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="06ea2a99-1bc1-4869-8f72-3d320d6f5114" containerName="console" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131264 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="kube-rbac-proxy-web" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131269 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="kube-rbac-proxy-web" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131278 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="init-config-reloader" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131282 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="init-config-reloader" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131289 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226a6c92-8dc2-4084-aa7a-9e2db2e3ece4" containerName="console" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131294 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="226a6c92-8dc2-4084-aa7a-9e2db2e3ece4" containerName="console" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131299 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="kube-rbac-proxy-thanos" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131305 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="kube-rbac-proxy-thanos" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131350 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="config-reloader" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131357 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="226a6c92-8dc2-4084-aa7a-9e2db2e3ece4" containerName="console" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131365 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="06ea2a99-1bc1-4869-8f72-3d320d6f5114" containerName="console" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131372 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="kube-rbac-proxy-web" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131376 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="kube-rbac-proxy" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131383 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="kube-rbac-proxy-thanos" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131387 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="thanos-sidecar" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131394 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c132e12-5da5-424b-a957-50952de70322" containerName="registry" Jun 15 08:24:42.131431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.131398 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" containerName="prometheus" Jun 15 08:24:42.136817 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.136792 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.139642 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.139599 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 08:24:42.139642 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.139638 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 08:24:42.140926 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.140904 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 08:24:42.141028 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.140906 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 08:24:42.141028 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.140906 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 08:24:42.141028 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.140906 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7lpcbei0aps2g\"" Jun 15 08:24:42.141708 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.141678 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 08:24:42.142283 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.142262 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 08:24:42.142730 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.142690 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 08:24:42.144407 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.144389 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 08:24:42.144604 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.144575 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 08:24:42.144604 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.144585 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 08:24:42.144846 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.144798 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 08:24:42.145040 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.145021 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zxg27\"" Jun 15 08:24:42.145099 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.145046 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 08:24:42.152330 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.149355 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 08:24:42.152330 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.151921 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 08:24:42.156990 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.156958 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 08:24:42.243950 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.243913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.243950 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.243948 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244163 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244006 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244163 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244059 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244163 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-web-config\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244163 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244163 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244121 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244163 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244163 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244153 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26454ad9-469c-401b-9af2-2f6097e13f49-config-out\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244400 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244225 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244400 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244254 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nchzd\" (UniqueName: \"kubernetes.io/projected/26454ad9-469c-401b-9af2-2f6097e13f49-kube-api-access-nchzd\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244400 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244272 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-config\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244400 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244292 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244400 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244313 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244400 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244340 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244400 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244355 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244400 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244380 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244680 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26454ad9-469c-401b-9af2-2f6097e13f49-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244680 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244423 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.244680 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.244437 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.345250 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.345166 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.345250 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.345219 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26454ad9-469c-401b-9af2-2f6097e13f49-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.345250 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.345239 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.345250 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.345256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.345577 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.345291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.345577 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.345310 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.345577 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.345328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.345823 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.345801 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346031 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.345905 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346031 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.345959 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-web-config\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346031 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.345990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346250 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.346201 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346303 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.346008 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346365 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.346317 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346365 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.346348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346466 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.346380 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26454ad9-469c-401b-9af2-2f6097e13f49-config-out\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346466 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.346428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346466 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.346452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nchzd\" (UniqueName: \"kubernetes.io/projected/26454ad9-469c-401b-9af2-2f6097e13f49-kube-api-access-nchzd\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346617 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.346479 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-config\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346617 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.346515 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346617 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.346556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346617 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.346609 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.346835 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.346635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.347225 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.347172 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.349507 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.348531 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26454ad9-469c-401b-9af2-2f6097e13f49-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.349507 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.348611 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.349507 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.348632 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.349507 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.348844 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.349507 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.348885 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-web-config\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.349507 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.348907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.349507 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.349160 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.349507 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.349487 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.349507 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.349511 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.350203 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.350037 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.350426 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.350403 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-config\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.350872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.350852 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26454ad9-469c-401b-9af2-2f6097e13f49-config-out\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.351544 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.351521 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.351626 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.351613 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26454ad9-469c-401b-9af2-2f6097e13f49-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.352373 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.352354 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26454ad9-469c-401b-9af2-2f6097e13f49-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.355650 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.355626 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nchzd\" (UniqueName: \"kubernetes.io/projected/26454ad9-469c-401b-9af2-2f6097e13f49-kube-api-access-nchzd\") pod \"prometheus-k8s-0\" (UID: \"26454ad9-469c-401b-9af2-2f6097e13f49\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.447485 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.447450 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:24:42.447662 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.447549 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:24:42.449977 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.449950 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f130c-a632-48ff-918c-c25c25daab40-metrics-certs\") pod \"network-metrics-daemon-2jjfp\" (UID: \"389f130c-a632-48ff-918c-c25c25daab40\") " pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:24:42.456711 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.456662 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c55e87bc-7e91-43a5-b039-2c69804933cd" path="/var/lib/kubelet/pods/c55e87bc-7e91-43a5-b039-2c69804933cd/volumes" Jun 15 08:24:42.554634 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.554608 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-646t6\"" Jun 15 08:24:42.562730 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.562684 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jjfp" Jun 15 08:24:42.594757 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.594723 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 08:24:42.598411 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:24:42.598365 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26454ad9_469c_401b_9af2_2f6097e13f49.slice/crio-e43be0ff17c40058fd73291698f5a479aab4f2ee5dd38cb37e362e416084e9be WatchSource:0}: Error finding container e43be0ff17c40058fd73291698f5a479aab4f2ee5dd38cb37e362e416084e9be: Status 404 returned error can't find the container with id e43be0ff17c40058fd73291698f5a479aab4f2ee5dd38cb37e362e416084e9be Jun 15 08:24:42.704933 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.704907 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2jjfp"] Jun 15 08:24:42.746200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.746160 2561 generic.go:356] "Generic (PLEG): container finished" podID="26454ad9-469c-401b-9af2-2f6097e13f49" containerID="04b01e646059b094797ee827eb3299c109a89bf3cc895757d2da083a16bfb05a" exitCode=0 Jun 15 08:24:42.746359 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.746243 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26454ad9-469c-401b-9af2-2f6097e13f49","Type":"ContainerDied","Data":"04b01e646059b094797ee827eb3299c109a89bf3cc895757d2da083a16bfb05a"} Jun 15 08:24:42.746359 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.746315 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26454ad9-469c-401b-9af2-2f6097e13f49","Type":"ContainerStarted","Data":"e43be0ff17c40058fd73291698f5a479aab4f2ee5dd38cb37e362e416084e9be"} Jun 15 08:24:42.761615 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:24:42.761587 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389f130c_a632_48ff_918c_c25c25daab40.slice/crio-2c1f6e40060625dfe1dae685a3798b78f071ba99b289329ac19634ea43113bd4 WatchSource:0}: Error finding container 2c1f6e40060625dfe1dae685a3798b78f071ba99b289329ac19634ea43113bd4: Status 404 returned error can't find the container with id 2c1f6e40060625dfe1dae685a3798b78f071ba99b289329ac19634ea43113bd4 Jun 15 08:24:42.763377 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:42.763362 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 08:24:43.754293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:43.754252 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26454ad9-469c-401b-9af2-2f6097e13f49","Type":"ContainerStarted","Data":"b395a9223a89f8b902c865882a31e96d6cee40ddd4ef4ef16dae41ee7d02c359"} Jun 15 08:24:43.754768 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:43.754341 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26454ad9-469c-401b-9af2-2f6097e13f49","Type":"ContainerStarted","Data":"0948b4e66395060f1b22291656454601d1cad287603b74d3a300c4d5ed60aaa2"} Jun 15 08:24:43.754768 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:43.754382 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26454ad9-469c-401b-9af2-2f6097e13f49","Type":"ContainerStarted","Data":"92c5e6233f9439c80f67cd56b02ee8ac912d32515eec70300e0647248d4300a6"} Jun 15 08:24:43.754768 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:43.754416 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26454ad9-469c-401b-9af2-2f6097e13f49","Type":"ContainerStarted","Data":"3c55ba137b09cad85f20b13546b678b348d642227ee1587e94d8e2e0fb1a6046"} Jun 15 08:24:43.754768 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:43.754470 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26454ad9-469c-401b-9af2-2f6097e13f49","Type":"ContainerStarted","Data":"550831005bd27abb382d4a33a07a68d95d9c03cc4406d13b4d017410408d8b81"} Jun 15 08:24:43.754768 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:43.754505 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26454ad9-469c-401b-9af2-2f6097e13f49","Type":"ContainerStarted","Data":"2c123eec2cb496d7b2f6518bf3e0ccea5c1bf23102d5bd8d4fdfb0483260ddfd"} Jun 15 08:24:43.755601 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:43.755575 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jjfp" event={"ID":"389f130c-a632-48ff-918c-c25c25daab40","Type":"ContainerStarted","Data":"2c1f6e40060625dfe1dae685a3798b78f071ba99b289329ac19634ea43113bd4"} Jun 15 08:24:43.789903 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:43.789855 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.7709236229999998 podStartE2EDuration="1.789834354s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.910731ms" isStatefulPod=false podCreationTimestamp="2026-06-15 08:24:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:24:43.787191127 +0000 UTC m=+375.761189735" watchObservedRunningTime="2026-06-15 08:24:43.789834354 +0000 UTC m=+375.763832950" Jun 15 08:24:44.761762 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:44.761720 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jjfp" event={"ID":"389f130c-a632-48ff-918c-c25c25daab40","Type":"ContainerStarted","Data":"247a6562f4598036d9de8a02c8c601a60dac1a1f7922ee82789fc4537289c96e"} Jun 15 08:24:44.762131 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:44.761789 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jjfp" event={"ID":"389f130c-a632-48ff-918c-c25c25daab40","Type":"ContainerStarted","Data":"95a60eca48234ce5ec777b49ec61e7c259e436d29e3080bf8a1c1f4ab5c79646"} Jun 15 08:24:44.777931 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:44.777885 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2jjfp" podStartSLOduration=375.775774077 podStartE2EDuration="6m16.777869851s" totalImagesPullingTime="1.002095774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:24:44.776972689 +0000 UTC m=+376.750971309" watchObservedRunningTime="2026-06-15 08:24:44.777869851 +0000 UTC m=+376.751868447" Jun 15 08:24:47.448208 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:24:47.448152 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:25:42.447878 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:25:42.447837 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:25:42.464495 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:25:42.464468 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:25:43.030721 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:25:43.017332 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 08:26:32.418943 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:32.418903 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-p4vx6"] Jun 15 08:26:32.422388 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:32.422365 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-p4vx6" Jun 15 08:26:32.426347 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:32.426320 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-q5ftm\"" Jun 15 08:26:32.426608 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:32.426592 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 15 08:26:32.427238 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:32.427219 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 15 08:26:32.436418 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:32.436394 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-p4vx6"] Jun 15 08:26:32.596877 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:32.596847 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b2813e0-dbf4-4206-b10e-dd62732302c7-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-p4vx6\" (UID: \"2b2813e0-dbf4-4206-b10e-dd62732302c7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-p4vx6" Jun 15 08:26:32.596877 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:32.596878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kv7v\" (UniqueName: \"kubernetes.io/projected/2b2813e0-dbf4-4206-b10e-dd62732302c7-kube-api-access-5kv7v\") pod \"cert-manager-cainjector-5d99449ffd-p4vx6\" (UID: \"2b2813e0-dbf4-4206-b10e-dd62732302c7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-p4vx6" Jun 15 08:26:32.697877 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:32.697846 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b2813e0-dbf4-4206-b10e-dd62732302c7-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-p4vx6\" (UID: \"2b2813e0-dbf4-4206-b10e-dd62732302c7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-p4vx6" Jun 15 08:26:32.698043 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:32.697884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kv7v\" (UniqueName: \"kubernetes.io/projected/2b2813e0-dbf4-4206-b10e-dd62732302c7-kube-api-access-5kv7v\") pod \"cert-manager-cainjector-5d99449ffd-p4vx6\" (UID: \"2b2813e0-dbf4-4206-b10e-dd62732302c7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-p4vx6" Jun 15 08:26:32.707025 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:32.706991 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b2813e0-dbf4-4206-b10e-dd62732302c7-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-p4vx6\" (UID: \"2b2813e0-dbf4-4206-b10e-dd62732302c7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-p4vx6" Jun 15 08:26:32.707180 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:32.707117 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kv7v\" (UniqueName: \"kubernetes.io/projected/2b2813e0-dbf4-4206-b10e-dd62732302c7-kube-api-access-5kv7v\") pod \"cert-manager-cainjector-5d99449ffd-p4vx6\" (UID: \"2b2813e0-dbf4-4206-b10e-dd62732302c7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-p4vx6" Jun 15 08:26:32.745581 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:32.745548 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-p4vx6" Jun 15 08:26:32.882961 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:32.882916 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-p4vx6"] Jun 15 08:26:32.885946 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:26:32.885917 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b2813e0_dbf4_4206_b10e_dd62732302c7.slice/crio-f2c80e099d99968a23259da842cf8fa3f5f8e58d454f3d54c73b5b404f1fb54a WatchSource:0}: Error finding container f2c80e099d99968a23259da842cf8fa3f5f8e58d454f3d54c73b5b404f1fb54a: Status 404 returned error can't find the container with id f2c80e099d99968a23259da842cf8fa3f5f8e58d454f3d54c73b5b404f1fb54a Jun 15 08:26:33.206442 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:33.206399 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-p4vx6" event={"ID":"2b2813e0-dbf4-4206-b10e-dd62732302c7","Type":"ContainerStarted","Data":"f2c80e099d99968a23259da842cf8fa3f5f8e58d454f3d54c73b5b404f1fb54a"} Jun 15 08:26:36.224128 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:26:36.224088 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-p4vx6" event={"ID":"2b2813e0-dbf4-4206-b10e-dd62732302c7","Type":"ContainerStarted","Data":"784c98cba0559233bf7fc1bf7f715fea58cf2224aa5eecd5235c16b486cf3ec0"} Jun 15 08:27:09.103930 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.103875 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-p4vx6" podStartSLOduration=34.067746133 podStartE2EDuration="37.103859449s" totalImagesPullingTime="3.036113316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:26:36.253152991 +0000 UTC m=+488.227151586" watchObservedRunningTime="2026-06-15 08:27:09.103859449 +0000 UTC m=+521.077858044" Jun 15 08:27:09.104808 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.104790 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp"] Jun 15 08:27:09.125618 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.125591 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.129382 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.129353 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp"] Jun 15 08:27:09.130946 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.130911 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 08:27:09.131080 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.130971 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 08:27:09.131445 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.131429 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 08:27:09.131869 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.131842 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 08:27:09.137875 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.137859 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fd6vf\"" Jun 15 08:27:09.207917 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.207889 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0cc8ec7b-806c-4014-ac61-b47a35c68f83-manifests\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.208041 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.207924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmcdv\" (UniqueName: \"kubernetes.io/projected/0cc8ec7b-806c-4014-ac61-b47a35c68f83-kube-api-access-tmcdv\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.208041 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.207987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0cc8ec7b-806c-4014-ac61-b47a35c68f83-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.208041 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.208019 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cc8ec7b-806c-4014-ac61-b47a35c68f83-tmp\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.208144 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.208047 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cc8ec7b-806c-4014-ac61-b47a35c68f83-webhook-cert\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.308776 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.308750 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0cc8ec7b-806c-4014-ac61-b47a35c68f83-manifests\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.308902 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.308782 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmcdv\" (UniqueName: \"kubernetes.io/projected/0cc8ec7b-806c-4014-ac61-b47a35c68f83-kube-api-access-tmcdv\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.308902 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.308823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0cc8ec7b-806c-4014-ac61-b47a35c68f83-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.308902 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.308853 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cc8ec7b-806c-4014-ac61-b47a35c68f83-tmp\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.308902 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.308870 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cc8ec7b-806c-4014-ac61-b47a35c68f83-webhook-cert\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.309179 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.309156 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0cc8ec7b-806c-4014-ac61-b47a35c68f83-manifests\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.311324 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.311300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cc8ec7b-806c-4014-ac61-b47a35c68f83-tmp\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.311426 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.311411 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cc8ec7b-806c-4014-ac61-b47a35c68f83-webhook-cert\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.311514 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.311500 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0cc8ec7b-806c-4014-ac61-b47a35c68f83-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.322323 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.322300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmcdv\" (UniqueName: \"kubernetes.io/projected/0cc8ec7b-806c-4014-ac61-b47a35c68f83-kube-api-access-tmcdv\") pod \"opendatahub-operator-controller-manager-6996b7d859-28tfp\" (UID: \"0cc8ec7b-806c-4014-ac61-b47a35c68f83\") " pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.438881 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.438791 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:09.616429 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:09.616404 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp"] Jun 15 08:27:09.619027 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:27:09.618995 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc8ec7b_806c_4014_ac61_b47a35c68f83.slice/crio-e78c5531e74c6ee6fec28281bb260f829cac3a4606fe80357575426c5a2cc6ac WatchSource:0}: Error finding container e78c5531e74c6ee6fec28281bb260f829cac3a4606fe80357575426c5a2cc6ac: Status 404 returned error can't find the container with id e78c5531e74c6ee6fec28281bb260f829cac3a4606fe80357575426c5a2cc6ac Jun 15 08:27:10.362917 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:10.362876 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" event={"ID":"0cc8ec7b-806c-4014-ac61-b47a35c68f83","Type":"ContainerStarted","Data":"e78c5531e74c6ee6fec28281bb260f829cac3a4606fe80357575426c5a2cc6ac"} Jun 15 08:27:13.381493 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:13.381452 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" event={"ID":"0cc8ec7b-806c-4014-ac61-b47a35c68f83","Type":"ContainerStarted","Data":"90494f056d803ba9d7eb706c8d1b6cbc98b87f84a5fcba8484ed8c2bb9f7dafb"} Jun 15 08:27:14.387590 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:14.387552 2561 generic.go:356] "Generic (PLEG): container finished" podID="0cc8ec7b-806c-4014-ac61-b47a35c68f83" containerID="90494f056d803ba9d7eb706c8d1b6cbc98b87f84a5fcba8484ed8c2bb9f7dafb" exitCode=0 Jun 15 08:27:14.387990 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:14.387634 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" event={"ID":"0cc8ec7b-806c-4014-ac61-b47a35c68f83","Type":"ContainerDied","Data":"90494f056d803ba9d7eb706c8d1b6cbc98b87f84a5fcba8484ed8c2bb9f7dafb"} Jun 15 08:27:15.393824 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:15.393736 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" event={"ID":"0cc8ec7b-806c-4014-ac61-b47a35c68f83","Type":"ContainerStarted","Data":"5b554b2d33eeca16742f489ff47cc2c12addd6e2bae4aecc9c00617281860e12"} Jun 15 08:27:15.394205 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:15.393859 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:15.415282 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:15.415224 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" podStartSLOduration=2.126189125 podStartE2EDuration="6.415206723s" totalImagesPullingTime="3.244204691s" totalInitContainerRuntime="1.044812907s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:27:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:27:15.413467473 +0000 UTC m=+527.387466068" watchObservedRunningTime="2026-06-15 08:27:15.415206723 +0000 UTC m=+527.389205317" Jun 15 08:27:26.401751 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:26.401690 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6996b7d859-28tfp" Jun 15 08:27:29.218641 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.218612 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w"] Jun 15 08:27:29.230854 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.230829 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:29.234992 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.234967 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 15 08:27:29.235127 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.234968 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 15 08:27:29.235127 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.234968 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7rn6b\"" Jun 15 08:27:29.236192 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.236174 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 15 08:27:29.237862 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.237842 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 15 08:27:29.237954 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.237903 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 15 08:27:29.248499 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.248478 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w"] Jun 15 08:27:29.298418 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.298388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/79a14df2-b268-4a5a-af2c-745afa53ac83-manager-config\") pod \"lws-controller-manager-6bd5868f66-wbm9w\" (UID: \"79a14df2-b268-4a5a-af2c-745afa53ac83\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:29.298571 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.298422 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79a14df2-b268-4a5a-af2c-745afa53ac83-cert\") pod \"lws-controller-manager-6bd5868f66-wbm9w\" (UID: \"79a14df2-b268-4a5a-af2c-745afa53ac83\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:29.298571 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.298439 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/79a14df2-b268-4a5a-af2c-745afa53ac83-metrics-cert\") pod \"lws-controller-manager-6bd5868f66-wbm9w\" (UID: \"79a14df2-b268-4a5a-af2c-745afa53ac83\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:29.298571 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.298535 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x29n2\" (UniqueName: \"kubernetes.io/projected/79a14df2-b268-4a5a-af2c-745afa53ac83-kube-api-access-x29n2\") pod \"lws-controller-manager-6bd5868f66-wbm9w\" (UID: \"79a14df2-b268-4a5a-af2c-745afa53ac83\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:29.399370 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.399343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x29n2\" (UniqueName: \"kubernetes.io/projected/79a14df2-b268-4a5a-af2c-745afa53ac83-kube-api-access-x29n2\") pod \"lws-controller-manager-6bd5868f66-wbm9w\" (UID: \"79a14df2-b268-4a5a-af2c-745afa53ac83\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:29.399529 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.399433 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/79a14df2-b268-4a5a-af2c-745afa53ac83-manager-config\") pod \"lws-controller-manager-6bd5868f66-wbm9w\" (UID: \"79a14df2-b268-4a5a-af2c-745afa53ac83\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:29.399529 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.399471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79a14df2-b268-4a5a-af2c-745afa53ac83-cert\") pod \"lws-controller-manager-6bd5868f66-wbm9w\" (UID: \"79a14df2-b268-4a5a-af2c-745afa53ac83\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:29.399529 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.399495 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/79a14df2-b268-4a5a-af2c-745afa53ac83-metrics-cert\") pod \"lws-controller-manager-6bd5868f66-wbm9w\" (UID: \"79a14df2-b268-4a5a-af2c-745afa53ac83\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:29.400209 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.400166 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/79a14df2-b268-4a5a-af2c-745afa53ac83-manager-config\") pod \"lws-controller-manager-6bd5868f66-wbm9w\" (UID: \"79a14df2-b268-4a5a-af2c-745afa53ac83\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:29.402101 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.402082 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79a14df2-b268-4a5a-af2c-745afa53ac83-cert\") pod \"lws-controller-manager-6bd5868f66-wbm9w\" (UID: \"79a14df2-b268-4a5a-af2c-745afa53ac83\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:29.402245 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.402224 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/79a14df2-b268-4a5a-af2c-745afa53ac83-metrics-cert\") pod \"lws-controller-manager-6bd5868f66-wbm9w\" (UID: \"79a14df2-b268-4a5a-af2c-745afa53ac83\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:29.414296 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.414274 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x29n2\" (UniqueName: \"kubernetes.io/projected/79a14df2-b268-4a5a-af2c-745afa53ac83-kube-api-access-x29n2\") pod \"lws-controller-manager-6bd5868f66-wbm9w\" (UID: \"79a14df2-b268-4a5a-af2c-745afa53ac83\") " pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:29.540065 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.540006 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:29.669152 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:29.669127 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w"] Jun 15 08:27:29.671724 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:27:29.671684 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a14df2_b268_4a5a_af2c_745afa53ac83.slice/crio-8a44e5e82903fef6ce67a3a6d515a3111389a4521c26bcb618ecdd0df68d0c30 WatchSource:0}: Error finding container 8a44e5e82903fef6ce67a3a6d515a3111389a4521c26bcb618ecdd0df68d0c30: Status 404 returned error can't find the container with id 8a44e5e82903fef6ce67a3a6d515a3111389a4521c26bcb618ecdd0df68d0c30 Jun 15 08:27:30.462379 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:30.462351 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" event={"ID":"79a14df2-b268-4a5a-af2c-745afa53ac83","Type":"ContainerStarted","Data":"8a44e5e82903fef6ce67a3a6d515a3111389a4521c26bcb618ecdd0df68d0c30"} Jun 15 08:27:32.475986 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:32.475798 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" event={"ID":"79a14df2-b268-4a5a-af2c-745afa53ac83","Type":"ContainerStarted","Data":"6adec509a2fa68b9066f68d33a803c3150095e7842c85e9209ca8c9832825085"} Jun 15 08:27:32.476352 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:32.476001 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:27:32.496648 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:32.496608 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" podStartSLOduration=0.769010637 podStartE2EDuration="3.496594917s" totalImagesPullingTime="2.72758428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:27:32.49438601 +0000 UTC m=+544.468384633" watchObservedRunningTime="2026-06-15 08:27:32.496594917 +0000 UTC m=+544.470593579" Jun 15 08:27:43.482251 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:27:43.482216 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6bd5868f66-wbm9w" Jun 15 08:28:03.239479 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.239447 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs"] Jun 15 08:28:03.246550 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.246528 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.250515 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.250491 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jwzd6\"" Jun 15 08:28:03.250639 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.250607 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 15 08:28:03.250718 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.250666 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 08:28:03.250852 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.250830 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 08:28:03.267812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.267780 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs"] Jun 15 08:28:03.391303 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.391265 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.391476 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.391329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.391476 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.391349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.391476 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.391366 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrs4z\" (UniqueName: \"kubernetes.io/projected/a61e7f67-1080-4510-a1f2-1736fcbc3084-kube-api-access-nrs4z\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.391476 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.391386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a61e7f67-1080-4510-a1f2-1736fcbc3084-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.391476 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.391456 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a61e7f67-1080-4510-a1f2-1736fcbc3084-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.391653 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.391485 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.391653 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.391503 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a61e7f67-1080-4510-a1f2-1736fcbc3084-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.391653 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.391545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.492513 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.492420 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.492513 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.492460 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.492513 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.492486 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrs4z\" (UniqueName: \"kubernetes.io/projected/a61e7f67-1080-4510-a1f2-1736fcbc3084-kube-api-access-nrs4z\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.492513 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.492507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a61e7f67-1080-4510-a1f2-1736fcbc3084-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.492951 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.492541 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a61e7f67-1080-4510-a1f2-1736fcbc3084-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.492951 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.492566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.492951 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.492583 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a61e7f67-1080-4510-a1f2-1736fcbc3084-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.492951 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.492634 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.492951 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.492679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.493206 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.492984 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.493206 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.493022 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.493302 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.493239 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.493302 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.493256 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.493377 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.493354 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a61e7f67-1080-4510-a1f2-1736fcbc3084-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.495090 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.495065 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a61e7f67-1080-4510-a1f2-1736fcbc3084-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.495200 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.495175 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a61e7f67-1080-4510-a1f2-1736fcbc3084-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.512503 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.512474 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a61e7f67-1080-4510-a1f2-1736fcbc3084-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.515362 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.515338 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrs4z\" (UniqueName: \"kubernetes.io/projected/a61e7f67-1080-4510-a1f2-1736fcbc3084-kube-api-access-nrs4z\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcgbpqs\" (UID: \"a61e7f67-1080-4510-a1f2-1736fcbc3084\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.560214 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.560178 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:03.736946 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:03.736918 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs"] Jun 15 08:28:03.738599 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:28:03.738574 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61e7f67_1080_4510_a1f2_1736fcbc3084.slice/crio-7d38e56339304ec1f3564d2f6d5e123f8b8ed18f22d1f227a1285a4e05f911bb WatchSource:0}: Error finding container 7d38e56339304ec1f3564d2f6d5e123f8b8ed18f22d1f227a1285a4e05f911bb: Status 404 returned error can't find the container with id 7d38e56339304ec1f3564d2f6d5e123f8b8ed18f22d1f227a1285a4e05f911bb Jun 15 08:28:04.619823 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:04.619792 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" event={"ID":"a61e7f67-1080-4510-a1f2-1736fcbc3084","Type":"ContainerStarted","Data":"7d38e56339304ec1f3564d2f6d5e123f8b8ed18f22d1f227a1285a4e05f911bb"} Jun 15 08:28:06.748790 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:06.748749 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 15 08:28:06.749178 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:06.748851 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 15 08:28:06.749178 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:06.748902 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 15 08:28:07.635931 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:07.635891 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" event={"ID":"a61e7f67-1080-4510-a1f2-1736fcbc3084","Type":"ContainerStarted","Data":"4dd7d0de809346accd3d3dbba6007157d086429d211ababeefd0aeeb91892ab5"} Jun 15 08:28:07.656291 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:07.656231 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" podStartSLOduration=1.648366014 podStartE2EDuration="4.656215049s" totalImagesPullingTime="3.007849035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:28:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:28:07.654517689 +0000 UTC m=+579.628516285" watchObservedRunningTime="2026-06-15 08:28:07.656215049 +0000 UTC m=+579.630213701" Jun 15 08:28:08.022013 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.021975 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5477d47596-tjmjj"] Jun 15 08:28:08.024717 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.024668 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5477d47596-tjmjj" Jun 15 08:28:08.028352 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.028319 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 15 08:28:08.028517 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.028497 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4qb2v\"" Jun 15 08:28:08.035886 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.035859 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5477d47596-tjmjj"] Jun 15 08:28:08.136767 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.136733 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f05ae4cd-46c2-4626-b67b-fb8df1d12ae2-redirect-config\") pod \"dashboard-redirect-5477d47596-tjmjj\" (UID: \"f05ae4cd-46c2-4626-b67b-fb8df1d12ae2\") " pod="opendatahub/dashboard-redirect-5477d47596-tjmjj" Jun 15 08:28:08.136948 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.136784 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqzmb\" (UniqueName: \"kubernetes.io/projected/f05ae4cd-46c2-4626-b67b-fb8df1d12ae2-kube-api-access-jqzmb\") pod \"dashboard-redirect-5477d47596-tjmjj\" (UID: \"f05ae4cd-46c2-4626-b67b-fb8df1d12ae2\") " pod="opendatahub/dashboard-redirect-5477d47596-tjmjj" Jun 15 08:28:08.237338 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.237300 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f05ae4cd-46c2-4626-b67b-fb8df1d12ae2-redirect-config\") pod \"dashboard-redirect-5477d47596-tjmjj\" (UID: \"f05ae4cd-46c2-4626-b67b-fb8df1d12ae2\") " pod="opendatahub/dashboard-redirect-5477d47596-tjmjj" Jun 15 08:28:08.237558 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.237350 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqzmb\" (UniqueName: \"kubernetes.io/projected/f05ae4cd-46c2-4626-b67b-fb8df1d12ae2-kube-api-access-jqzmb\") pod \"dashboard-redirect-5477d47596-tjmjj\" (UID: \"f05ae4cd-46c2-4626-b67b-fb8df1d12ae2\") " pod="opendatahub/dashboard-redirect-5477d47596-tjmjj" Jun 15 08:28:08.238140 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.238114 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f05ae4cd-46c2-4626-b67b-fb8df1d12ae2-redirect-config\") pod \"dashboard-redirect-5477d47596-tjmjj\" (UID: \"f05ae4cd-46c2-4626-b67b-fb8df1d12ae2\") " pod="opendatahub/dashboard-redirect-5477d47596-tjmjj" Jun 15 08:28:08.246291 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.246268 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqzmb\" (UniqueName: \"kubernetes.io/projected/f05ae4cd-46c2-4626-b67b-fb8df1d12ae2-kube-api-access-jqzmb\") pod \"dashboard-redirect-5477d47596-tjmjj\" (UID: \"f05ae4cd-46c2-4626-b67b-fb8df1d12ae2\") " pod="opendatahub/dashboard-redirect-5477d47596-tjmjj" Jun 15 08:28:08.336984 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.336898 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5477d47596-tjmjj" Jun 15 08:28:08.469684 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.469656 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5477d47596-tjmjj"] Jun 15 08:28:08.472336 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:28:08.472307 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf05ae4cd_46c2_4626_b67b_fb8df1d12ae2.slice/crio-026ae0ba3795b06cf443d1d9cb39b15b053e0a0bdf0db2be7e140aa47ecc8189 WatchSource:0}: Error finding container 026ae0ba3795b06cf443d1d9cb39b15b053e0a0bdf0db2be7e140aa47ecc8189: Status 404 returned error can't find the container with id 026ae0ba3795b06cf443d1d9cb39b15b053e0a0bdf0db2be7e140aa47ecc8189 Jun 15 08:28:08.560349 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.560321 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:08.565301 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.565270 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:08.642077 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.641981 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5477d47596-tjmjj" event={"ID":"f05ae4cd-46c2-4626-b67b-fb8df1d12ae2","Type":"ContainerStarted","Data":"026ae0ba3795b06cf443d1d9cb39b15b053e0a0bdf0db2be7e140aa47ecc8189"} Jun 15 08:28:08.642221 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.642164 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:08.643222 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:08.643202 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcgbpqs" Jun 15 08:28:11.657339 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:11.657301 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5477d47596-tjmjj" event={"ID":"f05ae4cd-46c2-4626-b67b-fb8df1d12ae2","Type":"ContainerStarted","Data":"9357df7fc0b404c0e13ae5c4d7ce1d7cdf156f105d86d7f01f4874c8511a0c2d"} Jun 15 08:28:11.678276 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:11.678219 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5477d47596-tjmjj" podStartSLOduration=0.96036618 podStartE2EDuration="3.678203337s" totalImagesPullingTime="2.717837157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:28:11.677489898 +0000 UTC m=+583.651488493" watchObservedRunningTime="2026-06-15 08:28:11.678203337 +0000 UTC m=+583.652201931" Jun 15 08:28:28.392190 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.392155 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f9c674876-66pl9"] Jun 15 08:28:28.396056 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.396033 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.398509 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.398486 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 15 08:28:28.399294 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.399271 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 15 08:28:28.399426 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.399294 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 15 08:28:28.399426 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.399350 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8b8vt\"" Jun 15 08:28:28.399426 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.399295 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 15 08:28:28.399426 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.399389 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 15 08:28:28.399779 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.399592 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 15 08:28:28.399779 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.399707 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 15 08:28:28.404296 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.404270 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 15 08:28:28.410086 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.410057 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9c674876-66pl9"] Jun 15 08:28:28.451433 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.451404 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:28:28.451741 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.451724 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:28:28.465624 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.465598 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:28:28.466390 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.466370 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:28:28.514207 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.514110 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-oauth-serving-cert\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.514207 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.514151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-console-serving-cert\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.514207 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.514185 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-trusted-ca-bundle\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.519420 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.514251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-console-oauth-config\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.519420 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.514282 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-service-ca\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.519420 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.514307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-console-config\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.519420 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.514329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f47k2\" (UniqueName: \"kubernetes.io/projected/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-kube-api-access-f47k2\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.615252 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.615220 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-trusted-ca-bundle\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.615402 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.615277 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-console-oauth-config\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.615402 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.615317 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-service-ca\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.615514 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.615489 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-console-config\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.615625 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.615552 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f47k2\" (UniqueName: \"kubernetes.io/projected/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-kube-api-access-f47k2\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.615679 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.615635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-oauth-serving-cert\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.615755 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.615735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-console-serving-cert\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.616117 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.616092 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-service-ca\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.616240 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.616132 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-trusted-ca-bundle\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.616423 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.616397 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-oauth-serving-cert\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.616569 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.616550 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-console-config\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.618102 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.618080 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-console-serving-cert\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.618305 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.618288 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-console-oauth-config\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.623873 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.623853 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f47k2\" (UniqueName: \"kubernetes.io/projected/5307a0e3-c4de-4b49-8f57-52bf37b3a4bc-kube-api-access-f47k2\") pod \"console-5f9c674876-66pl9\" (UID: \"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc\") " pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.706962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.706923 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:28.857394 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:28.857367 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9c674876-66pl9"] Jun 15 08:28:28.859179 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:28:28.859146 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5307a0e3_c4de_4b49_8f57_52bf37b3a4bc.slice/crio-b4ddd2ca389468296e607656a7200464607e169ec6caee44e3565fe82b034ff3 WatchSource:0}: Error finding container b4ddd2ca389468296e607656a7200464607e169ec6caee44e3565fe82b034ff3: Status 404 returned error can't find the container with id b4ddd2ca389468296e607656a7200464607e169ec6caee44e3565fe82b034ff3 Jun 15 08:28:29.734150 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:29.734114 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpxfh"] Jun 15 08:28:29.738119 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:29.738096 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bpxfh" Jun 15 08:28:29.740547 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:29.740523 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 08:28:29.741216 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:29.741186 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9c674876-66pl9" event={"ID":"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc","Type":"ContainerStarted","Data":"8f71231cbfec4f5ea753c0dd8eee73638f904657c0d11216e18b1fa6b8169be3"} Jun 15 08:28:29.741320 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:29.741233 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9c674876-66pl9" event={"ID":"5307a0e3-c4de-4b49-8f57-52bf37b3a4bc","Type":"ContainerStarted","Data":"b4ddd2ca389468296e607656a7200464607e169ec6caee44e3565fe82b034ff3"} Jun 15 08:28:29.741414 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:29.741385 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5lml6\"" Jun 15 08:28:29.741471 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:29.741410 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 08:28:29.750476 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:29.750450 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpxfh"] Jun 15 08:28:29.777876 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:29.777822 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f9c674876-66pl9" podStartSLOduration=1.7778083869999999 podStartE2EDuration="1.777808387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:28:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:28:29.776544145 +0000 UTC m=+601.750542740" watchObservedRunningTime="2026-06-15 08:28:29.777808387 +0000 UTC m=+601.751806981" Jun 15 08:28:29.827293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:29.827254 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xrwz\" (UniqueName: \"kubernetes.io/projected/566bdf39-9459-4fdd-a3ee-7a49182fc1a9-kube-api-access-9xrwz\") pod \"kuadrant-operator-catalog-bpxfh\" (UID: \"566bdf39-9459-4fdd-a3ee-7a49182fc1a9\") " pod="kuadrant-system/kuadrant-operator-catalog-bpxfh" Jun 15 08:28:29.928445 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:29.928395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xrwz\" (UniqueName: \"kubernetes.io/projected/566bdf39-9459-4fdd-a3ee-7a49182fc1a9-kube-api-access-9xrwz\") pod \"kuadrant-operator-catalog-bpxfh\" (UID: \"566bdf39-9459-4fdd-a3ee-7a49182fc1a9\") " pod="kuadrant-system/kuadrant-operator-catalog-bpxfh" Jun 15 08:28:29.946324 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:29.946298 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xrwz\" (UniqueName: \"kubernetes.io/projected/566bdf39-9459-4fdd-a3ee-7a49182fc1a9-kube-api-access-9xrwz\") pod \"kuadrant-operator-catalog-bpxfh\" (UID: \"566bdf39-9459-4fdd-a3ee-7a49182fc1a9\") " pod="kuadrant-system/kuadrant-operator-catalog-bpxfh" Jun 15 08:28:30.049751 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:30.049643 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bpxfh" Jun 15 08:28:30.094609 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:30.094574 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpxfh"] Jun 15 08:28:30.185122 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:30.185101 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpxfh"] Jun 15 08:28:30.187097 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:28:30.187059 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod566bdf39_9459_4fdd_a3ee_7a49182fc1a9.slice/crio-c9956ee36362df04c54060e8d83f047a8b2973bbd2f8e6f2aaa3987083e3482f WatchSource:0}: Error finding container c9956ee36362df04c54060e8d83f047a8b2973bbd2f8e6f2aaa3987083e3482f: Status 404 returned error can't find the container with id c9956ee36362df04c54060e8d83f047a8b2973bbd2f8e6f2aaa3987083e3482f Jun 15 08:28:30.303887 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:30.303810 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rssqp"] Jun 15 08:28:30.308335 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:30.308320 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rssqp" Jun 15 08:28:30.314782 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:30.314759 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rssqp"] Jun 15 08:28:30.332603 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:30.332573 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nx42\" (UniqueName: \"kubernetes.io/projected/297af14c-4d83-4799-8d16-40fdd3a89a6a-kube-api-access-5nx42\") pod \"kuadrant-operator-catalog-rssqp\" (UID: \"297af14c-4d83-4799-8d16-40fdd3a89a6a\") " pod="kuadrant-system/kuadrant-operator-catalog-rssqp" Jun 15 08:28:30.433083 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:30.433051 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nx42\" (UniqueName: \"kubernetes.io/projected/297af14c-4d83-4799-8d16-40fdd3a89a6a-kube-api-access-5nx42\") pod \"kuadrant-operator-catalog-rssqp\" (UID: \"297af14c-4d83-4799-8d16-40fdd3a89a6a\") " pod="kuadrant-system/kuadrant-operator-catalog-rssqp" Jun 15 08:28:30.444451 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:30.444416 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nx42\" (UniqueName: \"kubernetes.io/projected/297af14c-4d83-4799-8d16-40fdd3a89a6a-kube-api-access-5nx42\") pod \"kuadrant-operator-catalog-rssqp\" (UID: \"297af14c-4d83-4799-8d16-40fdd3a89a6a\") " pod="kuadrant-system/kuadrant-operator-catalog-rssqp" Jun 15 08:28:30.619431 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:30.619345 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rssqp" Jun 15 08:28:30.748607 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:30.748574 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bpxfh" event={"ID":"566bdf39-9459-4fdd-a3ee-7a49182fc1a9","Type":"ContainerStarted","Data":"c9956ee36362df04c54060e8d83f047a8b2973bbd2f8e6f2aaa3987083e3482f"} Jun 15 08:28:30.766615 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:30.766593 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rssqp"] Jun 15 08:28:30.769051 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:28:30.769025 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297af14c_4d83_4799_8d16_40fdd3a89a6a.slice/crio-7e127410a3889bd3af2236d00841c5024fb520f106a45b5047d7ce0f1c49275b WatchSource:0}: Error finding container 7e127410a3889bd3af2236d00841c5024fb520f106a45b5047d7ce0f1c49275b: Status 404 returned error can't find the container with id 7e127410a3889bd3af2236d00841c5024fb520f106a45b5047d7ce0f1c49275b Jun 15 08:28:31.757024 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:31.756984 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rssqp" event={"ID":"297af14c-4d83-4799-8d16-40fdd3a89a6a","Type":"ContainerStarted","Data":"7e127410a3889bd3af2236d00841c5024fb520f106a45b5047d7ce0f1c49275b"} Jun 15 08:28:32.763117 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:32.763077 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bpxfh" event={"ID":"566bdf39-9459-4fdd-a3ee-7a49182fc1a9","Type":"ContainerStarted","Data":"a80f92b21bb7b73112a2ffb15409bc3afd892eb89a605315390ac839a7c2ec60"} Jun 15 08:28:32.763605 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:32.763111 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-bpxfh" podUID="566bdf39-9459-4fdd-a3ee-7a49182fc1a9" containerName="registry-server" containerID="cri-o://a80f92b21bb7b73112a2ffb15409bc3afd892eb89a605315390ac839a7c2ec60" gracePeriod=2 Jun 15 08:28:32.764747 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:32.764724 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rssqp" event={"ID":"297af14c-4d83-4799-8d16-40fdd3a89a6a","Type":"ContainerStarted","Data":"d5f99341b469581b1a7e88041f012e87b64149c0862808cabe3513ff1aaa8a36"} Jun 15 08:28:32.781226 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:32.781183 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bpxfh" podStartSLOduration=1.5224586279999999 podStartE2EDuration="3.781168315s" totalImagesPullingTime="2.258709687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:28:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:28:32.779341452 +0000 UTC m=+604.753340066" watchObservedRunningTime="2026-06-15 08:28:32.781168315 +0000 UTC m=+604.755166911" Jun 15 08:28:32.796958 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:32.796910 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rssqp" podStartSLOduration=1.117110891 podStartE2EDuration="2.796895267s" totalImagesPullingTime="1.679784376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:28:32.79642824 +0000 UTC m=+604.770426863" watchObservedRunningTime="2026-06-15 08:28:32.796895267 +0000 UTC m=+604.770893862" Jun 15 08:28:33.017464 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:33.017400 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bpxfh" Jun 15 08:28:33.066770 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:33.066734 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xrwz\" (UniqueName: \"kubernetes.io/projected/566bdf39-9459-4fdd-a3ee-7a49182fc1a9-kube-api-access-9xrwz\") pod \"566bdf39-9459-4fdd-a3ee-7a49182fc1a9\" (UID: \"566bdf39-9459-4fdd-a3ee-7a49182fc1a9\") " Jun 15 08:28:33.069103 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:33.069074 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/566bdf39-9459-4fdd-a3ee-7a49182fc1a9-kube-api-access-9xrwz" (OuterVolumeSpecName: "kube-api-access-9xrwz") pod "566bdf39-9459-4fdd-a3ee-7a49182fc1a9" (UID: "566bdf39-9459-4fdd-a3ee-7a49182fc1a9"). InnerVolumeSpecName "kube-api-access-9xrwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:28:33.167564 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:33.167532 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xrwz\" (UniqueName: \"kubernetes.io/projected/566bdf39-9459-4fdd-a3ee-7a49182fc1a9-kube-api-access-9xrwz\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:28:33.770739 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:33.770635 2561 generic.go:356] "Generic (PLEG): container finished" podID="566bdf39-9459-4fdd-a3ee-7a49182fc1a9" containerID="a80f92b21bb7b73112a2ffb15409bc3afd892eb89a605315390ac839a7c2ec60" exitCode=0 Jun 15 08:28:33.770739 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:33.770677 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bpxfh" Jun 15 08:28:33.770739 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:33.770719 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bpxfh" event={"ID":"566bdf39-9459-4fdd-a3ee-7a49182fc1a9","Type":"ContainerDied","Data":"a80f92b21bb7b73112a2ffb15409bc3afd892eb89a605315390ac839a7c2ec60"} Jun 15 08:28:33.771332 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:33.770775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bpxfh" event={"ID":"566bdf39-9459-4fdd-a3ee-7a49182fc1a9","Type":"ContainerDied","Data":"c9956ee36362df04c54060e8d83f047a8b2973bbd2f8e6f2aaa3987083e3482f"} Jun 15 08:28:33.771332 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:33.770803 2561 scope.go:117] "RemoveContainer" containerID="a80f92b21bb7b73112a2ffb15409bc3afd892eb89a605315390ac839a7c2ec60" Jun 15 08:28:33.781616 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:33.781597 2561 scope.go:117] "RemoveContainer" containerID="a80f92b21bb7b73112a2ffb15409bc3afd892eb89a605315390ac839a7c2ec60" Jun 15 08:28:33.781889 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:28:33.781871 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a80f92b21bb7b73112a2ffb15409bc3afd892eb89a605315390ac839a7c2ec60\": container with ID starting with a80f92b21bb7b73112a2ffb15409bc3afd892eb89a605315390ac839a7c2ec60 not found: ID does not exist" containerID="a80f92b21bb7b73112a2ffb15409bc3afd892eb89a605315390ac839a7c2ec60" Jun 15 08:28:33.781942 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:33.781900 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a80f92b21bb7b73112a2ffb15409bc3afd892eb89a605315390ac839a7c2ec60"} err="failed to get container status \"a80f92b21bb7b73112a2ffb15409bc3afd892eb89a605315390ac839a7c2ec60\": rpc error: code = NotFound desc = could not find container \"a80f92b21bb7b73112a2ffb15409bc3afd892eb89a605315390ac839a7c2ec60\": container with ID starting with a80f92b21bb7b73112a2ffb15409bc3afd892eb89a605315390ac839a7c2ec60 not found: ID does not exist" Jun 15 08:28:33.793072 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:33.793048 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpxfh"] Jun 15 08:28:33.797262 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:33.797239 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpxfh"] Jun 15 08:28:34.457850 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:34.457822 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="566bdf39-9459-4fdd-a3ee-7a49182fc1a9" path="/var/lib/kubelet/pods/566bdf39-9459-4fdd-a3ee-7a49182fc1a9/volumes" Jun 15 08:28:38.707422 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:38.707381 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:38.707962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:38.707490 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:38.712236 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:38.712214 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:38.798618 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:38.798589 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f9c674876-66pl9" Jun 15 08:28:40.619872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:40.619821 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rssqp" Jun 15 08:28:40.620363 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:40.619901 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rssqp" Jun 15 08:28:40.642622 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:40.642591 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rssqp" Jun 15 08:28:40.827111 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:28:40.827083 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rssqp" Jun 15 08:29:01.188194 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:01.188112 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-j8q9n"] Jun 15 08:29:01.188655 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:01.188452 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566bdf39-9459-4fdd-a3ee-7a49182fc1a9" containerName="registry-server" Jun 15 08:29:01.188655 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:01.188463 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="566bdf39-9459-4fdd-a3ee-7a49182fc1a9" containerName="registry-server" Jun 15 08:29:01.188655 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:01.188538 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="566bdf39-9459-4fdd-a3ee-7a49182fc1a9" containerName="registry-server" Jun 15 08:29:01.192814 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:01.192796 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j8q9n" Jun 15 08:29:01.195559 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:01.195538 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-rfktp\"" Jun 15 08:29:01.195887 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:01.195872 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 15 08:29:01.201218 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:01.201199 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-j8q9n"] Jun 15 08:29:01.211324 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:01.211307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfnnt\" (UniqueName: \"kubernetes.io/projected/85559a85-6f78-4c83-8d96-028fbf0aac40-kube-api-access-mfnnt\") pod \"dns-operator-controller-manager-864dd78c4c-j8q9n\" (UID: \"85559a85-6f78-4c83-8d96-028fbf0aac40\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j8q9n" Jun 15 08:29:01.312614 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:01.312590 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfnnt\" (UniqueName: \"kubernetes.io/projected/85559a85-6f78-4c83-8d96-028fbf0aac40-kube-api-access-mfnnt\") pod \"dns-operator-controller-manager-864dd78c4c-j8q9n\" (UID: \"85559a85-6f78-4c83-8d96-028fbf0aac40\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j8q9n" Jun 15 08:29:01.320845 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:01.320817 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfnnt\" (UniqueName: \"kubernetes.io/projected/85559a85-6f78-4c83-8d96-028fbf0aac40-kube-api-access-mfnnt\") pod \"dns-operator-controller-manager-864dd78c4c-j8q9n\" (UID: \"85559a85-6f78-4c83-8d96-028fbf0aac40\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j8q9n" Jun 15 08:29:01.503683 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:01.503650 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j8q9n" Jun 15 08:29:01.638300 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:01.638280 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-j8q9n"] Jun 15 08:29:01.640995 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:29:01.640965 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85559a85_6f78_4c83_8d96_028fbf0aac40.slice/crio-9c5ccd851f2910babf8752f4a4d5e35b360a7f50da1d00ab0caa2929bb12f0e1 WatchSource:0}: Error finding container 9c5ccd851f2910babf8752f4a4d5e35b360a7f50da1d00ab0caa2929bb12f0e1: Status 404 returned error can't find the container with id 9c5ccd851f2910babf8752f4a4d5e35b360a7f50da1d00ab0caa2929bb12f0e1 Jun 15 08:29:01.910464 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:01.910386 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j8q9n" event={"ID":"85559a85-6f78-4c83-8d96-028fbf0aac40","Type":"ContainerStarted","Data":"9c5ccd851f2910babf8752f4a4d5e35b360a7f50da1d00ab0caa2929bb12f0e1"} Jun 15 08:29:03.922954 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:03.922844 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j8q9n" event={"ID":"85559a85-6f78-4c83-8d96-028fbf0aac40","Type":"ContainerStarted","Data":"66c009ac7c88e1603dde8804237506da6246d35586f65cd0d5c48406bccfb60f"} Jun 15 08:29:03.923348 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:03.923077 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j8q9n" Jun 15 08:29:03.941107 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:03.941056 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j8q9n" podStartSLOduration=1.010652204 podStartE2EDuration="2.941043382s" totalImagesPullingTime="1.930391178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:29:03.939328367 +0000 UTC m=+635.913326979" watchObservedRunningTime="2026-06-15 08:29:03.941043382 +0000 UTC m=+635.915041977" Jun 15 08:29:05.259541 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:05.259509 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9lxzd"] Jun 15 08:29:05.263008 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:05.262992 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lxzd" Jun 15 08:29:05.266430 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:05.266415 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gvs6x\"" Jun 15 08:29:05.275604 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:05.275582 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9lxzd"] Jun 15 08:29:05.347775 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:05.347737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxkfd\" (UniqueName: \"kubernetes.io/projected/73ab13c2-f953-410f-b1e3-36ad342a38d1-kube-api-access-nxkfd\") pod \"authorino-operator-75cc8d5cb7-9lxzd\" (UID: \"73ab13c2-f953-410f-b1e3-36ad342a38d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lxzd" Jun 15 08:29:05.448771 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:05.448742 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxkfd\" (UniqueName: \"kubernetes.io/projected/73ab13c2-f953-410f-b1e3-36ad342a38d1-kube-api-access-nxkfd\") pod \"authorino-operator-75cc8d5cb7-9lxzd\" (UID: \"73ab13c2-f953-410f-b1e3-36ad342a38d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lxzd" Jun 15 08:29:05.460339 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:05.460316 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxkfd\" (UniqueName: \"kubernetes.io/projected/73ab13c2-f953-410f-b1e3-36ad342a38d1-kube-api-access-nxkfd\") pod \"authorino-operator-75cc8d5cb7-9lxzd\" (UID: \"73ab13c2-f953-410f-b1e3-36ad342a38d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lxzd" Jun 15 08:29:05.573004 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:05.572929 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lxzd" Jun 15 08:29:05.703341 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:05.703278 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9lxzd"] Jun 15 08:29:05.705502 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:29:05.705470 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ab13c2_f953_410f_b1e3_36ad342a38d1.slice/crio-962aeb629910f53b0f35acb2003ffba0cfe088aead0b849d11f93059d6bdb0fd WatchSource:0}: Error finding container 962aeb629910f53b0f35acb2003ffba0cfe088aead0b849d11f93059d6bdb0fd: Status 404 returned error can't find the container with id 962aeb629910f53b0f35acb2003ffba0cfe088aead0b849d11f93059d6bdb0fd Jun 15 08:29:05.934089 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:05.934006 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lxzd" event={"ID":"73ab13c2-f953-410f-b1e3-36ad342a38d1","Type":"ContainerStarted","Data":"962aeb629910f53b0f35acb2003ffba0cfe088aead0b849d11f93059d6bdb0fd"} Jun 15 08:29:08.570121 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:08.570089 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d"] Jun 15 08:29:08.573625 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:08.573606 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:08.578202 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:08.578182 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ckbck\"" Jun 15 08:29:08.591378 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:08.591354 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d"] Jun 15 08:29:08.680447 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:08.680414 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk6sf\" (UniqueName: \"kubernetes.io/projected/2925ada1-6073-462f-b813-2f730fa22641-kube-api-access-wk6sf\") pod \"limitador-operator-controller-manager-859d7b78bd-kfv9d\" (UID: \"2925ada1-6073-462f-b813-2f730fa22641\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:08.781978 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:08.781943 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk6sf\" (UniqueName: \"kubernetes.io/projected/2925ada1-6073-462f-b813-2f730fa22641-kube-api-access-wk6sf\") pod \"limitador-operator-controller-manager-859d7b78bd-kfv9d\" (UID: \"2925ada1-6073-462f-b813-2f730fa22641\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:08.793455 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:08.793423 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk6sf\" (UniqueName: \"kubernetes.io/projected/2925ada1-6073-462f-b813-2f730fa22641-kube-api-access-wk6sf\") pod \"limitador-operator-controller-manager-859d7b78bd-kfv9d\" (UID: \"2925ada1-6073-462f-b813-2f730fa22641\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:08.883285 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:08.883224 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:08.951306 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:08.951208 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lxzd" event={"ID":"73ab13c2-f953-410f-b1e3-36ad342a38d1","Type":"ContainerStarted","Data":"5f3c5d6ea53067063d9e7a887c15f50ae3c7ed914d288fa699abb98a8cae96bf"} Jun 15 08:29:08.951460 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:08.951308 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lxzd" Jun 15 08:29:08.974774 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:08.974731 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lxzd" podStartSLOduration=1.767109383 podStartE2EDuration="3.974690449s" totalImagesPullingTime="2.207581066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:29:08.97381461 +0000 UTC m=+640.947813203" watchObservedRunningTime="2026-06-15 08:29:08.974690449 +0000 UTC m=+640.948689045" Jun 15 08:29:09.015948 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:09.015919 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d"] Jun 15 08:29:09.019075 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:29:09.019050 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2925ada1_6073_462f_b813_2f730fa22641.slice/crio-061ec4cd455d9c77c5b7bf92bff6028eadc601a31aab69b708c4426f0818212f WatchSource:0}: Error finding container 061ec4cd455d9c77c5b7bf92bff6028eadc601a31aab69b708c4426f0818212f: Status 404 returned error can't find the container with id 061ec4cd455d9c77c5b7bf92bff6028eadc601a31aab69b708c4426f0818212f Jun 15 08:29:09.958496 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:09.958461 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" event={"ID":"2925ada1-6073-462f-b813-2f730fa22641","Type":"ContainerStarted","Data":"061ec4cd455d9c77c5b7bf92bff6028eadc601a31aab69b708c4426f0818212f"} Jun 15 08:29:10.964909 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:10.964879 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" event={"ID":"2925ada1-6073-462f-b813-2f730fa22641","Type":"ContainerStarted","Data":"c35f76682b8e9d400e8dd87b3ddf9853adab60399aa177c5a2c7486accad62b6"} Jun 15 08:29:10.965257 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:10.964935 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:10.980969 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:10.980926 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" podStartSLOduration=1.15980329 podStartE2EDuration="2.98091152s" totalImagesPullingTime="1.82110823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:29:10.979513154 +0000 UTC m=+642.953511750" watchObservedRunningTime="2026-06-15 08:29:10.98091152 +0000 UTC m=+642.954910115" Jun 15 08:29:14.930628 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:14.930598 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j8q9n" Jun 15 08:29:19.960581 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:19.960550 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lxzd" Jun 15 08:29:21.972863 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:21.972833 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:34.291097 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.291055 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx"] Jun 15 08:29:34.296269 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.296247 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:34.300445 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.300430 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wlhzp\"" Jun 15 08:29:34.313729 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.313688 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx"] Jun 15 08:29:34.405458 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.405428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tp2p\" (UniqueName: \"kubernetes.io/projected/12d3424d-353b-45ad-9084-c334c114eaed-kube-api-access-5tp2p\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ftlxx\" (UID: \"12d3424d-353b-45ad-9084-c334c114eaed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:34.405592 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.405493 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12d3424d-353b-45ad-9084-c334c114eaed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ftlxx\" (UID: \"12d3424d-353b-45ad-9084-c334c114eaed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:34.506759 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.506731 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tp2p\" (UniqueName: \"kubernetes.io/projected/12d3424d-353b-45ad-9084-c334c114eaed-kube-api-access-5tp2p\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ftlxx\" (UID: \"12d3424d-353b-45ad-9084-c334c114eaed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:34.506923 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.506807 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12d3424d-353b-45ad-9084-c334c114eaed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ftlxx\" (UID: \"12d3424d-353b-45ad-9084-c334c114eaed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:34.507146 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.507123 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12d3424d-353b-45ad-9084-c334c114eaed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ftlxx\" (UID: \"12d3424d-353b-45ad-9084-c334c114eaed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:34.515439 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.515413 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tp2p\" (UniqueName: \"kubernetes.io/projected/12d3424d-353b-45ad-9084-c334c114eaed-kube-api-access-5tp2p\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ftlxx\" (UID: \"12d3424d-353b-45ad-9084-c334c114eaed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:34.606929 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.606858 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:34.742032 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.742011 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx"] Jun 15 08:29:34.744590 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:29:34.744563 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d3424d_353b_45ad_9084_c334c114eaed.slice/crio-8be47805ec256faea46bbc89174070f4b0ac5fecb13e6243a11a3b9a57957727 WatchSource:0}: Error finding container 8be47805ec256faea46bbc89174070f4b0ac5fecb13e6243a11a3b9a57957727: Status 404 returned error can't find the container with id 8be47805ec256faea46bbc89174070f4b0ac5fecb13e6243a11a3b9a57957727 Jun 15 08:29:34.932166 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.932104 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx"] Jun 15 08:29:34.937892 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.937865 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx"] Jun 15 08:29:34.957323 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.957297 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24"] Jun 15 08:29:34.961994 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.961976 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" Jun 15 08:29:34.972140 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.972114 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d"] Jun 15 08:29:34.972511 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.972481 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" podUID="2925ada1-6073-462f-b813-2f730fa22641" containerName="manager" containerID="cri-o://c35f76682b8e9d400e8dd87b3ddf9853adab60399aa177c5a2c7486accad62b6" gracePeriod=2 Jun 15 08:29:34.975166 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.975142 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24"] Jun 15 08:29:34.986677 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.986654 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d"] Jun 15 08:29:34.998873 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.998854 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mj5qm"] Jun 15 08:29:34.999240 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.999228 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2925ada1-6073-462f-b813-2f730fa22641" containerName="manager" Jun 15 08:29:34.999282 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.999243 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2925ada1-6073-462f-b813-2f730fa22641" containerName="manager" Jun 15 08:29:34.999316 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:34.999309 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2925ada1-6073-462f-b813-2f730fa22641" containerName="manager" Jun 15 08:29:35.002583 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.002562 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mj5qm" Jun 15 08:29:35.003576 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:29:35.003511 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kfv9d\" is forbidden: User \"system:node:ip-10-0-136-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-100.ec2.internal' and this object" podUID="2925ada1-6073-462f-b813-2f730fa22641" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:35.017887 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.017864 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mj5qm"] Jun 15 08:29:35.036362 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:29:35.036336 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kfv9d\" is forbidden: User \"system:node:ip-10-0-136-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-100.ec2.internal' and this object" podUID="2925ada1-6073-462f-b813-2f730fa22641" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:35.111844 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.111809 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tdn2\" (UniqueName: \"kubernetes.io/projected/4112bab3-1f86-4ee1-9253-b9b5a7853f01-kube-api-access-2tdn2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z5g24\" (UID: \"4112bab3-1f86-4ee1-9253-b9b5a7853f01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" Jun 15 08:29:35.111996 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.111879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4112bab3-1f86-4ee1-9253-b9b5a7853f01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z5g24\" (UID: \"4112bab3-1f86-4ee1-9253-b9b5a7853f01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" Jun 15 08:29:35.112046 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.112015 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzwxn\" (UniqueName: \"kubernetes.io/projected/e5d3f70b-6645-48a4-9dd8-af6f5e502463-kube-api-access-rzwxn\") pod \"limitador-operator-controller-manager-859d7b78bd-mj5qm\" (UID: \"e5d3f70b-6645-48a4-9dd8-af6f5e502463\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mj5qm" Jun 15 08:29:35.205450 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.205427 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:35.207658 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:29:35.207631 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kfv9d\" is forbidden: User \"system:node:ip-10-0-136-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-100.ec2.internal' and this object" podUID="2925ada1-6073-462f-b813-2f730fa22641" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:35.213054 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.213024 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzwxn\" (UniqueName: \"kubernetes.io/projected/e5d3f70b-6645-48a4-9dd8-af6f5e502463-kube-api-access-rzwxn\") pod \"limitador-operator-controller-manager-859d7b78bd-mj5qm\" (UID: \"e5d3f70b-6645-48a4-9dd8-af6f5e502463\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mj5qm" Jun 15 08:29:35.213157 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.213078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tdn2\" (UniqueName: \"kubernetes.io/projected/4112bab3-1f86-4ee1-9253-b9b5a7853f01-kube-api-access-2tdn2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z5g24\" (UID: \"4112bab3-1f86-4ee1-9253-b9b5a7853f01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" Jun 15 08:29:35.213157 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.213134 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4112bab3-1f86-4ee1-9253-b9b5a7853f01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z5g24\" (UID: \"4112bab3-1f86-4ee1-9253-b9b5a7853f01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" Jun 15 08:29:35.213544 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.213519 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4112bab3-1f86-4ee1-9253-b9b5a7853f01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z5g24\" (UID: \"4112bab3-1f86-4ee1-9253-b9b5a7853f01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" Jun 15 08:29:35.221609 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.221590 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzwxn\" (UniqueName: \"kubernetes.io/projected/e5d3f70b-6645-48a4-9dd8-af6f5e502463-kube-api-access-rzwxn\") pod \"limitador-operator-controller-manager-859d7b78bd-mj5qm\" (UID: \"e5d3f70b-6645-48a4-9dd8-af6f5e502463\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mj5qm" Jun 15 08:29:35.224144 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.224126 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tdn2\" (UniqueName: \"kubernetes.io/projected/4112bab3-1f86-4ee1-9253-b9b5a7853f01-kube-api-access-2tdn2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z5g24\" (UID: \"4112bab3-1f86-4ee1-9253-b9b5a7853f01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" Jun 15 08:29:35.275124 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.275107 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" Jun 15 08:29:35.314311 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.314284 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk6sf\" (UniqueName: \"kubernetes.io/projected/2925ada1-6073-462f-b813-2f730fa22641-kube-api-access-wk6sf\") pod \"2925ada1-6073-462f-b813-2f730fa22641\" (UID: \"2925ada1-6073-462f-b813-2f730fa22641\") " Jun 15 08:29:35.317142 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.317119 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2925ada1-6073-462f-b813-2f730fa22641-kube-api-access-wk6sf" (OuterVolumeSpecName: "kube-api-access-wk6sf") pod "2925ada1-6073-462f-b813-2f730fa22641" (UID: "2925ada1-6073-462f-b813-2f730fa22641"). InnerVolumeSpecName "kube-api-access-wk6sf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:29:35.344825 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.344774 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mj5qm" Jun 15 08:29:35.415576 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.415541 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk6sf\" (UniqueName: \"kubernetes.io/projected/2925ada1-6073-462f-b813-2f730fa22641-kube-api-access-wk6sf\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:29:35.432456 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.432427 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24"] Jun 15 08:29:35.435373 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:29:35.435342 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4112bab3_1f86_4ee1_9253_b9b5a7853f01.slice/crio-accaf319970b516de704c5a8c3c25a2e7deef4f1ab3533ff112d0a3c0e95a28d WatchSource:0}: Error finding container accaf319970b516de704c5a8c3c25a2e7deef4f1ab3533ff112d0a3c0e95a28d: Status 404 returned error can't find the container with id accaf319970b516de704c5a8c3c25a2e7deef4f1ab3533ff112d0a3c0e95a28d Jun 15 08:29:35.525959 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:35.525836 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mj5qm"] Jun 15 08:29:35.529734 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:29:35.529670 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d3f70b_6645_48a4_9dd8_af6f5e502463.slice/crio-1d8db28b2069c4dea7169b04daa2864931b4adcdcbda345f43c47ee843a9401e WatchSource:0}: Error finding container 1d8db28b2069c4dea7169b04daa2864931b4adcdcbda345f43c47ee843a9401e: Status 404 returned error can't find the container with id 1d8db28b2069c4dea7169b04daa2864931b4adcdcbda345f43c47ee843a9401e Jun 15 08:29:36.091229 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:36.091192 2561 generic.go:356] "Generic (PLEG): container finished" podID="2925ada1-6073-462f-b813-2f730fa22641" containerID="c35f76682b8e9d400e8dd87b3ddf9853adab60399aa177c5a2c7486accad62b6" exitCode=0 Jun 15 08:29:36.091411 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:36.091243 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:36.091411 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:36.091250 2561 scope.go:117] "RemoveContainer" containerID="c35f76682b8e9d400e8dd87b3ddf9853adab60399aa177c5a2c7486accad62b6" Jun 15 08:29:36.093124 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:36.092970 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" event={"ID":"4112bab3-1f86-4ee1-9253-b9b5a7853f01","Type":"ContainerStarted","Data":"accaf319970b516de704c5a8c3c25a2e7deef4f1ab3533ff112d0a3c0e95a28d"} Jun 15 08:29:36.093494 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:29:36.093464 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kfv9d\" is forbidden: User \"system:node:ip-10-0-136-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-100.ec2.internal' and this object" podUID="2925ada1-6073-462f-b813-2f730fa22641" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:36.095057 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:36.095031 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mj5qm" event={"ID":"e5d3f70b-6645-48a4-9dd8-af6f5e502463","Type":"ContainerStarted","Data":"732cc9939844ed9d5e87425fb5a49d1637991ba7ad73320d5d091084e947ad2c"} Jun 15 08:29:36.095174 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:36.095081 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mj5qm" event={"ID":"e5d3f70b-6645-48a4-9dd8-af6f5e502463","Type":"ContainerStarted","Data":"1d8db28b2069c4dea7169b04daa2864931b4adcdcbda345f43c47ee843a9401e"} Jun 15 08:29:36.095174 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:36.095157 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mj5qm" Jun 15 08:29:36.108121 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:36.108100 2561 scope.go:117] "RemoveContainer" containerID="c35f76682b8e9d400e8dd87b3ddf9853adab60399aa177c5a2c7486accad62b6" Jun 15 08:29:36.108439 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:29:36.108413 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c35f76682b8e9d400e8dd87b3ddf9853adab60399aa177c5a2c7486accad62b6\": container with ID starting with c35f76682b8e9d400e8dd87b3ddf9853adab60399aa177c5a2c7486accad62b6 not found: ID does not exist" containerID="c35f76682b8e9d400e8dd87b3ddf9853adab60399aa177c5a2c7486accad62b6" Jun 15 08:29:36.108532 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:36.108451 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c35f76682b8e9d400e8dd87b3ddf9853adab60399aa177c5a2c7486accad62b6"} err="failed to get container status \"c35f76682b8e9d400e8dd87b3ddf9853adab60399aa177c5a2c7486accad62b6\": rpc error: code = NotFound desc = could not find container \"c35f76682b8e9d400e8dd87b3ddf9853adab60399aa177c5a2c7486accad62b6\": container with ID starting with c35f76682b8e9d400e8dd87b3ddf9853adab60399aa177c5a2c7486accad62b6 not found: ID does not exist" Jun 15 08:29:36.114371 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:29:36.114319 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kfv9d\" is forbidden: User \"system:node:ip-10-0-136-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-100.ec2.internal' and this object" podUID="2925ada1-6073-462f-b813-2f730fa22641" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:36.114825 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:36.114776 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mj5qm" podStartSLOduration=2.114759811 podStartE2EDuration="2.114759811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:29:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:29:36.111906598 +0000 UTC m=+668.085905197" watchObservedRunningTime="2026-06-15 08:29:36.114759811 +0000 UTC m=+668.088758404" Jun 15 08:29:36.116131 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:29:36.116102 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kfv9d\" is forbidden: User \"system:node:ip-10-0-136-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-100.ec2.internal' and this object" podUID="2925ada1-6073-462f-b813-2f730fa22641" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfv9d" Jun 15 08:29:36.460111 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:36.460057 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2925ada1-6073-462f-b813-2f730fa22641" path="/var/lib/kubelet/pods/2925ada1-6073-462f-b813-2f730fa22641/volumes" Jun 15 08:29:39.117789 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:39.117748 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" podUID="12d3424d-353b-45ad-9084-c334c114eaed" containerName="manager" containerID="cri-o://52f946750232fcb5483f898662d81bd6dcbf850e344aeeaa89ae0bc3402e31de" gracePeriod=2 Jun 15 08:29:39.119588 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:39.119561 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" event={"ID":"4112bab3-1f86-4ee1-9253-b9b5a7853f01","Type":"ContainerStarted","Data":"2e9f2aa07159f922c25d966bc3e7bf004f0fd97ac941c382d36fd71f76eb4584"} Jun 15 08:29:39.119789 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:39.119729 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" Jun 15 08:29:39.120971 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:29:39.120940 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ftlxx\" is forbidden: User \"system:node:ip-10-0-136-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-100.ec2.internal' and this object" podUID="12d3424d-353b-45ad-9084-c334c114eaed" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:39.155052 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:29:39.155028 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ftlxx\" is forbidden: User \"system:node:ip-10-0-136-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-100.ec2.internal' and this object" podUID="12d3424d-353b-45ad-9084-c334c114eaed" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:39.362467 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:39.362441 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:39.365439 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:29:39.365407 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ftlxx\" is forbidden: User \"system:node:ip-10-0-136-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-100.ec2.internal' and this object" podUID="12d3424d-353b-45ad-9084-c334c114eaed" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:39.557302 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:39.557269 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12d3424d-353b-45ad-9084-c334c114eaed-extensions-socket-volume\") pod \"12d3424d-353b-45ad-9084-c334c114eaed\" (UID: \"12d3424d-353b-45ad-9084-c334c114eaed\") " Jun 15 08:29:39.557498 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:39.557361 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tp2p\" (UniqueName: \"kubernetes.io/projected/12d3424d-353b-45ad-9084-c334c114eaed-kube-api-access-5tp2p\") pod \"12d3424d-353b-45ad-9084-c334c114eaed\" (UID: \"12d3424d-353b-45ad-9084-c334c114eaed\") " Jun 15 08:29:39.557605 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:39.557579 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d3424d-353b-45ad-9084-c334c114eaed-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "12d3424d-353b-45ad-9084-c334c114eaed" (UID: "12d3424d-353b-45ad-9084-c334c114eaed"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:29:39.557663 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:39.557644 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12d3424d-353b-45ad-9084-c334c114eaed-extensions-socket-volume\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:29:39.559600 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:39.559573 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d3424d-353b-45ad-9084-c334c114eaed-kube-api-access-5tp2p" (OuterVolumeSpecName: "kube-api-access-5tp2p") pod "12d3424d-353b-45ad-9084-c334c114eaed" (UID: "12d3424d-353b-45ad-9084-c334c114eaed"). InnerVolumeSpecName "kube-api-access-5tp2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:29:39.658771 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:39.658740 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tp2p\" (UniqueName: \"kubernetes.io/projected/12d3424d-353b-45ad-9084-c334c114eaed-kube-api-access-5tp2p\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:29:40.126141 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:40.126106 2561 generic.go:356] "Generic (PLEG): container finished" podID="12d3424d-353b-45ad-9084-c334c114eaed" containerID="52f946750232fcb5483f898662d81bd6dcbf850e344aeeaa89ae0bc3402e31de" exitCode=2 Jun 15 08:29:40.126600 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:40.126152 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:40.126600 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:40.126202 2561 scope.go:117] "RemoveContainer" containerID="52f946750232fcb5483f898662d81bd6dcbf850e344aeeaa89ae0bc3402e31de" Jun 15 08:29:40.128506 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:29:40.128479 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ftlxx\" is forbidden: User \"system:node:ip-10-0-136-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-100.ec2.internal' and this object" podUID="12d3424d-353b-45ad-9084-c334c114eaed" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:40.135601 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:40.135585 2561 scope.go:117] "RemoveContainer" containerID="52f946750232fcb5483f898662d81bd6dcbf850e344aeeaa89ae0bc3402e31de" Jun 15 08:29:40.135872 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:29:40.135849 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52f946750232fcb5483f898662d81bd6dcbf850e344aeeaa89ae0bc3402e31de\": container with ID starting with 52f946750232fcb5483f898662d81bd6dcbf850e344aeeaa89ae0bc3402e31de not found: ID does not exist" containerID="52f946750232fcb5483f898662d81bd6dcbf850e344aeeaa89ae0bc3402e31de" Jun 15 08:29:40.135927 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:40.135885 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52f946750232fcb5483f898662d81bd6dcbf850e344aeeaa89ae0bc3402e31de"} err="failed to get container status \"52f946750232fcb5483f898662d81bd6dcbf850e344aeeaa89ae0bc3402e31de\": rpc error: code = NotFound desc = could not find container \"52f946750232fcb5483f898662d81bd6dcbf850e344aeeaa89ae0bc3402e31de\": container with ID starting with 52f946750232fcb5483f898662d81bd6dcbf850e344aeeaa89ae0bc3402e31de not found: ID does not exist" Jun 15 08:29:40.136252 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:29:40.136229 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ftlxx\" is forbidden: User \"system:node:ip-10-0-136-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-100.ec2.internal' and this object" podUID="12d3424d-353b-45ad-9084-c334c114eaed" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftlxx" Jun 15 08:29:40.458004 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:40.457972 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12d3424d-353b-45ad-9084-c334c114eaed" path="/var/lib/kubelet/pods/12d3424d-353b-45ad-9084-c334c114eaed/volumes" Jun 15 08:29:47.107116 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:47.107089 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mj5qm" Jun 15 08:29:47.126157 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:47.126101 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" podStartSLOduration=9.637314041 podStartE2EDuration="13.12608465s" totalImagesPullingTime="3.488770609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:29:39.14943294 +0000 UTC m=+671.123431554" watchObservedRunningTime="2026-06-15 08:29:47.12608465 +0000 UTC m=+679.100083246" Jun 15 08:29:50.128229 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:29:50.128202 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" Jun 15 08:30:02.477886 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:02.477853 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24"] Jun 15 08:30:02.478334 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:02.478096 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" podUID="4112bab3-1f86-4ee1-9253-b9b5a7853f01" containerName="manager" containerID="cri-o://2e9f2aa07159f922c25d966bc3e7bf004f0fd97ac941c382d36fd71f76eb4584" gracePeriod=10 Jun 15 08:30:02.723519 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:02.723496 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" Jun 15 08:30:02.854945 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:02.854864 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4112bab3-1f86-4ee1-9253-b9b5a7853f01-extensions-socket-volume\") pod \"4112bab3-1f86-4ee1-9253-b9b5a7853f01\" (UID: \"4112bab3-1f86-4ee1-9253-b9b5a7853f01\") " Jun 15 08:30:02.854945 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:02.854931 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tdn2\" (UniqueName: \"kubernetes.io/projected/4112bab3-1f86-4ee1-9253-b9b5a7853f01-kube-api-access-2tdn2\") pod \"4112bab3-1f86-4ee1-9253-b9b5a7853f01\" (UID: \"4112bab3-1f86-4ee1-9253-b9b5a7853f01\") " Jun 15 08:30:02.855380 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:02.855352 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4112bab3-1f86-4ee1-9253-b9b5a7853f01-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4112bab3-1f86-4ee1-9253-b9b5a7853f01" (UID: "4112bab3-1f86-4ee1-9253-b9b5a7853f01"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:30:02.857129 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:02.857104 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4112bab3-1f86-4ee1-9253-b9b5a7853f01-kube-api-access-2tdn2" (OuterVolumeSpecName: "kube-api-access-2tdn2") pod "4112bab3-1f86-4ee1-9253-b9b5a7853f01" (UID: "4112bab3-1f86-4ee1-9253-b9b5a7853f01"). InnerVolumeSpecName "kube-api-access-2tdn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:30:02.956286 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:02.956260 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4112bab3-1f86-4ee1-9253-b9b5a7853f01-extensions-socket-volume\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:30:02.956286 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:02.956286 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tdn2\" (UniqueName: \"kubernetes.io/projected/4112bab3-1f86-4ee1-9253-b9b5a7853f01-kube-api-access-2tdn2\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:30:03.241688 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:03.241655 2561 generic.go:356] "Generic (PLEG): container finished" podID="4112bab3-1f86-4ee1-9253-b9b5a7853f01" containerID="2e9f2aa07159f922c25d966bc3e7bf004f0fd97ac941c382d36fd71f76eb4584" exitCode=0 Jun 15 08:30:03.241858 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:03.241708 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" Jun 15 08:30:03.241858 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:03.241733 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" event={"ID":"4112bab3-1f86-4ee1-9253-b9b5a7853f01","Type":"ContainerDied","Data":"2e9f2aa07159f922c25d966bc3e7bf004f0fd97ac941c382d36fd71f76eb4584"} Jun 15 08:30:03.241858 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:03.241774 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24" event={"ID":"4112bab3-1f86-4ee1-9253-b9b5a7853f01","Type":"ContainerDied","Data":"accaf319970b516de704c5a8c3c25a2e7deef4f1ab3533ff112d0a3c0e95a28d"} Jun 15 08:30:03.241858 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:03.241795 2561 scope.go:117] "RemoveContainer" containerID="2e9f2aa07159f922c25d966bc3e7bf004f0fd97ac941c382d36fd71f76eb4584" Jun 15 08:30:03.250574 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:03.250555 2561 scope.go:117] "RemoveContainer" containerID="2e9f2aa07159f922c25d966bc3e7bf004f0fd97ac941c382d36fd71f76eb4584" Jun 15 08:30:03.250850 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:30:03.250831 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e9f2aa07159f922c25d966bc3e7bf004f0fd97ac941c382d36fd71f76eb4584\": container with ID starting with 2e9f2aa07159f922c25d966bc3e7bf004f0fd97ac941c382d36fd71f76eb4584 not found: ID does not exist" containerID="2e9f2aa07159f922c25d966bc3e7bf004f0fd97ac941c382d36fd71f76eb4584" Jun 15 08:30:03.250893 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:03.250859 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9f2aa07159f922c25d966bc3e7bf004f0fd97ac941c382d36fd71f76eb4584"} err="failed to get container status \"2e9f2aa07159f922c25d966bc3e7bf004f0fd97ac941c382d36fd71f76eb4584\": rpc error: code = NotFound desc = could not find container \"2e9f2aa07159f922c25d966bc3e7bf004f0fd97ac941c382d36fd71f76eb4584\": container with ID starting with 2e9f2aa07159f922c25d966bc3e7bf004f0fd97ac941c382d36fd71f76eb4584 not found: ID does not exist" Jun 15 08:30:03.264449 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:03.264426 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24"] Jun 15 08:30:03.268644 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:03.268623 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z5g24"] Jun 15 08:30:04.457413 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:04.457371 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4112bab3-1f86-4ee1-9253-b9b5a7853f01" path="/var/lib/kubelet/pods/4112bab3-1f86-4ee1-9253-b9b5a7853f01/volumes" Jun 15 08:30:06.486554 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.486520 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw"] Jun 15 08:30:06.487008 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.486902 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12d3424d-353b-45ad-9084-c334c114eaed" containerName="manager" Jun 15 08:30:06.487008 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.486914 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d3424d-353b-45ad-9084-c334c114eaed" containerName="manager" Jun 15 08:30:06.487008 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.486971 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4112bab3-1f86-4ee1-9253-b9b5a7853f01" containerName="manager" Jun 15 08:30:06.487008 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.486977 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4112bab3-1f86-4ee1-9253-b9b5a7853f01" containerName="manager" Jun 15 08:30:06.487169 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.487039 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4112bab3-1f86-4ee1-9253-b9b5a7853f01" containerName="manager" Jun 15 08:30:06.487169 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.487050 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="12d3424d-353b-45ad-9084-c334c114eaed" containerName="manager" Jun 15 08:30:06.491421 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.491401 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.493740 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.493720 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9l8mc\"" Jun 15 08:30:06.502145 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.502122 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw"] Jun 15 08:30:06.590357 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.590329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.590507 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.590361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.590507 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.590396 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.590592 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.590521 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.590592 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.590564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.590667 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.590587 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m98qr\" (UniqueName: \"kubernetes.io/projected/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-kube-api-access-m98qr\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.590667 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.590635 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.590804 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.590678 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.590804 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.590740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.692094 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.692062 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.692094 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.692092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.692283 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.692115 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.692283 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.692154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.692283 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.692190 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.692283 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.692219 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m98qr\" (UniqueName: \"kubernetes.io/projected/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-kube-api-access-m98qr\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.692283 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.692268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.692536 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.692304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.692536 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.692324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.692536 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.692502 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.692727 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.692586 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.692727 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.692684 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.692812 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.692778 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.692927 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.692908 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.694775 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.694758 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.694942 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.694921 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.700124 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.700095 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.700446 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.700419 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m98qr\" (UniqueName: \"kubernetes.io/projected/61ba32d4-0f86-42a6-ae3a-3f968ebd4126-kube-api-access-m98qr\") pod \"maas-default-gateway-openshift-default-8559cd5744-5bbfw\" (UID: \"61ba32d4-0f86-42a6-ae3a-3f968ebd4126\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.803182 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.803122 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:06.937262 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.937236 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw"] Jun 15 08:30:06.939481 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:30:06.939440 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ba32d4_0f86_42a6_ae3a_3f968ebd4126.slice/crio-48b6664b548300eb3a8a0fcb8b1f984e2435b67e894d41c23529a8f5b959fa73 WatchSource:0}: Error finding container 48b6664b548300eb3a8a0fcb8b1f984e2435b67e894d41c23529a8f5b959fa73: Status 404 returned error can't find the container with id 48b6664b548300eb3a8a0fcb8b1f984e2435b67e894d41c23529a8f5b959fa73 Jun 15 08:30:06.941545 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.941518 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 15 08:30:06.941800 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.941587 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 15 08:30:06.941800 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:06.941623 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 15 08:30:07.263754 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:07.263716 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" event={"ID":"61ba32d4-0f86-42a6-ae3a-3f968ebd4126","Type":"ContainerStarted","Data":"88f16dd7def59189a3a4d6eb611b3113c3d83999ae34bf2e6a3e356a9438e5ba"} Jun 15 08:30:07.263928 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:07.263778 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" event={"ID":"61ba32d4-0f86-42a6-ae3a-3f968ebd4126","Type":"ContainerStarted","Data":"48b6664b548300eb3a8a0fcb8b1f984e2435b67e894d41c23529a8f5b959fa73"} Jun 15 08:30:07.283195 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:07.283144 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" podStartSLOduration=1.283129604 podStartE2EDuration="1.283129604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:30:07.281450745 +0000 UTC m=+699.255449341" watchObservedRunningTime="2026-06-15 08:30:07.283129604 +0000 UTC m=+699.257128199" Jun 15 08:30:07.803983 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:07.803950 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:08.808805 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:08.808777 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:09.273838 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:09.273814 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:09.274897 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:09.274877 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:30:21.852898 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:21.852816 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mftlf"] Jun 15 08:30:21.856253 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:21.856232 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" Jun 15 08:30:21.858472 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:21.858431 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 15 08:30:21.858609 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:21.858593 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hv5s6\"" Jun 15 08:30:21.862792 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:21.862763 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mftlf"] Jun 15 08:30:21.948380 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:21.948348 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mftlf"] Jun 15 08:30:22.024963 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:22.024935 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt6z5\" (UniqueName: \"kubernetes.io/projected/a89cfc8b-eff6-48cf-9adc-922a9e3e4718-kube-api-access-wt6z5\") pod \"limitador-limitador-64c94fd64f-mftlf\" (UID: \"a89cfc8b-eff6-48cf-9adc-922a9e3e4718\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" Jun 15 08:30:22.025141 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:22.025065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a89cfc8b-eff6-48cf-9adc-922a9e3e4718-config-file\") pod \"limitador-limitador-64c94fd64f-mftlf\" (UID: \"a89cfc8b-eff6-48cf-9adc-922a9e3e4718\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" Jun 15 08:30:22.125892 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:22.125813 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a89cfc8b-eff6-48cf-9adc-922a9e3e4718-config-file\") pod \"limitador-limitador-64c94fd64f-mftlf\" (UID: \"a89cfc8b-eff6-48cf-9adc-922a9e3e4718\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" Jun 15 08:30:22.125892 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:22.125869 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt6z5\" (UniqueName: \"kubernetes.io/projected/a89cfc8b-eff6-48cf-9adc-922a9e3e4718-kube-api-access-wt6z5\") pod \"limitador-limitador-64c94fd64f-mftlf\" (UID: \"a89cfc8b-eff6-48cf-9adc-922a9e3e4718\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" Jun 15 08:30:22.126500 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:22.126480 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a89cfc8b-eff6-48cf-9adc-922a9e3e4718-config-file\") pod \"limitador-limitador-64c94fd64f-mftlf\" (UID: \"a89cfc8b-eff6-48cf-9adc-922a9e3e4718\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" Jun 15 08:30:22.134008 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:22.133983 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt6z5\" (UniqueName: \"kubernetes.io/projected/a89cfc8b-eff6-48cf-9adc-922a9e3e4718-kube-api-access-wt6z5\") pod \"limitador-limitador-64c94fd64f-mftlf\" (UID: \"a89cfc8b-eff6-48cf-9adc-922a9e3e4718\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" Jun 15 08:30:22.169834 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:22.169806 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" Jun 15 08:30:22.299374 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:22.299353 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mftlf"] Jun 15 08:30:22.301418 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:30:22.301383 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda89cfc8b_eff6_48cf_9adc_922a9e3e4718.slice/crio-09a533efd3a2c62f663c800e27a4e18f92557172ea048fc78b561db0bad900c3 WatchSource:0}: Error finding container 09a533efd3a2c62f663c800e27a4e18f92557172ea048fc78b561db0bad900c3: Status 404 returned error can't find the container with id 09a533efd3a2c62f663c800e27a4e18f92557172ea048fc78b561db0bad900c3 Jun 15 08:30:22.303419 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:22.303401 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 08:30:22.339552 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:22.339526 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" event={"ID":"a89cfc8b-eff6-48cf-9adc-922a9e3e4718","Type":"ContainerStarted","Data":"09a533efd3a2c62f663c800e27a4e18f92557172ea048fc78b561db0bad900c3"} Jun 15 08:30:25.359142 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:25.359052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" event={"ID":"a89cfc8b-eff6-48cf-9adc-922a9e3e4718","Type":"ContainerStarted","Data":"70a7e5394c0058a09bce7d957e65c42b723c5c00dc54dae260945972d2f3f679"} Jun 15 08:30:25.359142 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:25.359112 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" Jun 15 08:30:25.376345 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:25.376304 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" podStartSLOduration=1.651984962 podStartE2EDuration="4.376291114s" totalImagesPullingTime="2.724306152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:30:25.375332803 +0000 UTC m=+717.349331420" watchObservedRunningTime="2026-06-15 08:30:25.376291114 +0000 UTC m=+717.350289728" Jun 15 08:30:36.365962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:36.365933 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" Jun 15 08:30:39.324193 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:39.324152 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mftlf"] Jun 15 08:30:39.324779 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:39.324457 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" podUID="a89cfc8b-eff6-48cf-9adc-922a9e3e4718" containerName="limitador" containerID="cri-o://70a7e5394c0058a09bce7d957e65c42b723c5c00dc54dae260945972d2f3f679" gracePeriod=30 Jun 15 08:30:39.880418 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:39.880396 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" Jun 15 08:30:39.974389 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:39.974367 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a89cfc8b-eff6-48cf-9adc-922a9e3e4718-config-file\") pod \"a89cfc8b-eff6-48cf-9adc-922a9e3e4718\" (UID: \"a89cfc8b-eff6-48cf-9adc-922a9e3e4718\") " Jun 15 08:30:39.974534 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:39.974404 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt6z5\" (UniqueName: \"kubernetes.io/projected/a89cfc8b-eff6-48cf-9adc-922a9e3e4718-kube-api-access-wt6z5\") pod \"a89cfc8b-eff6-48cf-9adc-922a9e3e4718\" (UID: \"a89cfc8b-eff6-48cf-9adc-922a9e3e4718\") " Jun 15 08:30:39.974819 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:39.974792 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a89cfc8b-eff6-48cf-9adc-922a9e3e4718-config-file" (OuterVolumeSpecName: "config-file") pod "a89cfc8b-eff6-48cf-9adc-922a9e3e4718" (UID: "a89cfc8b-eff6-48cf-9adc-922a9e3e4718"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:30:39.976626 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:39.976609 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a89cfc8b-eff6-48cf-9adc-922a9e3e4718-kube-api-access-wt6z5" (OuterVolumeSpecName: "kube-api-access-wt6z5") pod "a89cfc8b-eff6-48cf-9adc-922a9e3e4718" (UID: "a89cfc8b-eff6-48cf-9adc-922a9e3e4718"). InnerVolumeSpecName "kube-api-access-wt6z5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:30:40.075878 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:40.075852 2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a89cfc8b-eff6-48cf-9adc-922a9e3e4718-config-file\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:30:40.075878 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:40.075878 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt6z5\" (UniqueName: \"kubernetes.io/projected/a89cfc8b-eff6-48cf-9adc-922a9e3e4718-kube-api-access-wt6z5\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:30:40.434416 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:40.434342 2561 generic.go:356] "Generic (PLEG): container finished" podID="a89cfc8b-eff6-48cf-9adc-922a9e3e4718" containerID="70a7e5394c0058a09bce7d957e65c42b723c5c00dc54dae260945972d2f3f679" exitCode=0 Jun 15 08:30:40.434416 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:40.434387 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" event={"ID":"a89cfc8b-eff6-48cf-9adc-922a9e3e4718","Type":"ContainerDied","Data":"70a7e5394c0058a09bce7d957e65c42b723c5c00dc54dae260945972d2f3f679"} Jun 15 08:30:40.434416 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:40.434403 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" Jun 15 08:30:40.434914 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:40.434449 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mftlf" event={"ID":"a89cfc8b-eff6-48cf-9adc-922a9e3e4718","Type":"ContainerDied","Data":"09a533efd3a2c62f663c800e27a4e18f92557172ea048fc78b561db0bad900c3"} Jun 15 08:30:40.434914 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:40.434480 2561 scope.go:117] "RemoveContainer" containerID="70a7e5394c0058a09bce7d957e65c42b723c5c00dc54dae260945972d2f3f679" Jun 15 08:30:40.445365 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:40.445323 2561 scope.go:117] "RemoveContainer" containerID="70a7e5394c0058a09bce7d957e65c42b723c5c00dc54dae260945972d2f3f679" Jun 15 08:30:40.445682 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:30:40.445653 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70a7e5394c0058a09bce7d957e65c42b723c5c00dc54dae260945972d2f3f679\": container with ID starting with 70a7e5394c0058a09bce7d957e65c42b723c5c00dc54dae260945972d2f3f679 not found: ID does not exist" containerID="70a7e5394c0058a09bce7d957e65c42b723c5c00dc54dae260945972d2f3f679" Jun 15 08:30:40.445806 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:40.445714 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a7e5394c0058a09bce7d957e65c42b723c5c00dc54dae260945972d2f3f679"} err="failed to get container status \"70a7e5394c0058a09bce7d957e65c42b723c5c00dc54dae260945972d2f3f679\": rpc error: code = NotFound desc = could not find container \"70a7e5394c0058a09bce7d957e65c42b723c5c00dc54dae260945972d2f3f679\": container with ID starting with 70a7e5394c0058a09bce7d957e65c42b723c5c00dc54dae260945972d2f3f679 not found: ID does not exist" Jun 15 08:30:40.458319 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:40.458290 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mftlf"] Jun 15 08:30:40.458992 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:40.458974 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mftlf"] Jun 15 08:30:42.459029 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:42.458996 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a89cfc8b-eff6-48cf-9adc-922a9e3e4718" path="/var/lib/kubelet/pods/a89cfc8b-eff6-48cf-9adc-922a9e3e4718/volumes" Jun 15 08:30:45.179141 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.179094 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-rnmmg"] Jun 15 08:30:45.179683 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.179660 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a89cfc8b-eff6-48cf-9adc-922a9e3e4718" containerName="limitador" Jun 15 08:30:45.179797 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.179685 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a89cfc8b-eff6-48cf-9adc-922a9e3e4718" containerName="limitador" Jun 15 08:30:45.179863 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.179845 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a89cfc8b-eff6-48cf-9adc-922a9e3e4718" containerName="limitador" Jun 15 08:30:45.184517 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.184492 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-rnmmg" Jun 15 08:30:45.186755 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.186732 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 15 08:30:45.193621 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.193586 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-rnmmg"] Jun 15 08:30:45.221478 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.221443 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxv5l\" (UniqueName: \"kubernetes.io/projected/a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86-kube-api-access-dxv5l\") pod \"postgres-69fb4594cf-rnmmg\" (UID: \"a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86\") " pod="opendatahub/postgres-69fb4594cf-rnmmg" Jun 15 08:30:45.221670 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.221505 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86-data\") pod \"postgres-69fb4594cf-rnmmg\" (UID: \"a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86\") " pod="opendatahub/postgres-69fb4594cf-rnmmg" Jun 15 08:30:45.322666 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.322627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxv5l\" (UniqueName: \"kubernetes.io/projected/a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86-kube-api-access-dxv5l\") pod \"postgres-69fb4594cf-rnmmg\" (UID: \"a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86\") " pod="opendatahub/postgres-69fb4594cf-rnmmg" Jun 15 08:30:45.322867 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.322690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86-data\") pod \"postgres-69fb4594cf-rnmmg\" (UID: \"a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86\") " pod="opendatahub/postgres-69fb4594cf-rnmmg" Jun 15 08:30:45.323090 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.323073 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86-data\") pod \"postgres-69fb4594cf-rnmmg\" (UID: \"a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86\") " pod="opendatahub/postgres-69fb4594cf-rnmmg" Jun 15 08:30:45.333765 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.333723 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxv5l\" (UniqueName: \"kubernetes.io/projected/a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86-kube-api-access-dxv5l\") pod \"postgres-69fb4594cf-rnmmg\" (UID: \"a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86\") " pod="opendatahub/postgres-69fb4594cf-rnmmg" Jun 15 08:30:45.496400 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.496339 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-rnmmg" Jun 15 08:30:45.652803 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:45.652773 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-rnmmg"] Jun 15 08:30:45.655163 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:30:45.655138 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9cdfb82_93e7_4a2f_a0b6_bb7a9d3afc86.slice/crio-a64623110070bd8f6e741da27404a8bd1ead80577ce8162d5bdeabb997752f08 WatchSource:0}: Error finding container a64623110070bd8f6e741da27404a8bd1ead80577ce8162d5bdeabb997752f08: Status 404 returned error can't find the container with id a64623110070bd8f6e741da27404a8bd1ead80577ce8162d5bdeabb997752f08 Jun 15 08:30:46.465581 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:46.465541 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-rnmmg" event={"ID":"a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86","Type":"ContainerStarted","Data":"a64623110070bd8f6e741da27404a8bd1ead80577ce8162d5bdeabb997752f08"} Jun 15 08:30:49.482825 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:49.482781 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-rnmmg" event={"ID":"a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86","Type":"ContainerStarted","Data":"1f6333fee7f130f8601e1e4051131eb299db6536f6b03bbeefbf5dc10bf03700"} Jun 15 08:30:49.483365 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:49.482895 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-rnmmg" Jun 15 08:30:49.508612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:49.508544 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-rnmmg" podStartSLOduration=1.733721562 podStartE2EDuration="4.508528131s" totalImagesPullingTime="2.774806569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:30:49.508345998 +0000 UTC m=+741.482344594" watchObservedRunningTime="2026-06-15 08:30:49.508528131 +0000 UTC m=+741.482526772" Jun 15 08:30:55.523588 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:30:55.523549 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-rnmmg" Jun 15 08:31:27.264529 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:27.264494 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 08:31:27.269930 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:27.269906 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 08:31:27.272367 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:27.272345 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 08:31:27.272491 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:27.272406 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 08:31:27.272491 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:27.272425 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-w8dzq\"" Jun 15 08:31:27.272491 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:27.272406 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 08:31:27.278721 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:27.278684 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 08:31:27.298132 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:27.298109 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nztf\" (UniqueName: \"kubernetes.io/projected/c6956681-a833-4025-b905-b811d33529ff-kube-api-access-4nztf\") pod \"maas-keycloak-0\" (UID: \"c6956681-a833-4025-b905-b811d33529ff\") " pod="keycloak-system/maas-keycloak-0" Jun 15 08:31:27.399244 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:27.399221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nztf\" (UniqueName: \"kubernetes.io/projected/c6956681-a833-4025-b905-b811d33529ff-kube-api-access-4nztf\") pod \"maas-keycloak-0\" (UID: \"c6956681-a833-4025-b905-b811d33529ff\") " pod="keycloak-system/maas-keycloak-0" Jun 15 08:31:27.407538 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:27.407514 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nztf\" (UniqueName: \"kubernetes.io/projected/c6956681-a833-4025-b905-b811d33529ff-kube-api-access-4nztf\") pod \"maas-keycloak-0\" (UID: \"c6956681-a833-4025-b905-b811d33529ff\") " pod="keycloak-system/maas-keycloak-0" Jun 15 08:31:27.580971 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:27.580900 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 08:31:27.714491 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:27.714468 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 08:31:27.716749 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:31:27.716681 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6956681_a833_4025_b905_b811d33529ff.slice/crio-185961af469d4103a0bd690e43f1fbfcfbd6229d04f232576b6771ad939e6c9e WatchSource:0}: Error finding container 185961af469d4103a0bd690e43f1fbfcfbd6229d04f232576b6771ad939e6c9e: Status 404 returned error can't find the container with id 185961af469d4103a0bd690e43f1fbfcfbd6229d04f232576b6771ad939e6c9e Jun 15 08:31:28.672639 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:28.672602 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c6956681-a833-4025-b905-b811d33529ff","Type":"ContainerStarted","Data":"185961af469d4103a0bd690e43f1fbfcfbd6229d04f232576b6771ad939e6c9e"} Jun 15 08:31:32.928372 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:32.928346 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 08:31:33.709977 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:33.709925 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c6956681-a833-4025-b905-b811d33529ff","Type":"ContainerStarted","Data":"c2b3fbc5a7e733ee0e4bee3fc7472c78403cf6cb3269ca9ffea5ddcceba2edd1"} Jun 15 08:31:33.730775 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:33.730726 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.5229327910000001 podStartE2EDuration="6.730708205s" totalImagesPullingTime="5.207775414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:31:33.729345483 +0000 UTC m=+785.703344079" watchObservedRunningTime="2026-06-15 08:31:33.730708205 +0000 UTC m=+785.704706806" Jun 15 08:31:34.581613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:34.581564 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 15 08:31:34.583534 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:34.583491 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 08:31:35.581393 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:35.581343 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 08:31:36.581687 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:36.581613 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 08:31:37.582354 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:37.581925 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 15 08:31:37.582870 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:37.582769 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 08:31:38.581532 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:38.581483 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 08:31:39.582180 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:39.582124 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 08:31:40.581838 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:40.581787 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 08:31:41.581750 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:41.581667 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 08:31:42.581544 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:42.581497 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 08:31:43.582087 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:43.582028 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 08:31:44.581862 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:44.581816 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 08:31:45.581427 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:45.581330 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 08:31:46.666874 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:46.666829 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 15 08:31:46.680590 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:46.680535 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 08:31:56.672855 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:31:56.672817 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 15 08:32:02.426152 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.426118 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-776b74d8c5-wl57t"] Jun 15 08:32:02.432742 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.432725 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-776b74d8c5-wl57t" Jun 15 08:32:02.436293 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.436270 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4qkwl\"" Jun 15 08:32:02.436854 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.436840 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 15 08:32:02.437518 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.437504 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 15 08:32:02.454478 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.454450 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e235155b-c14e-48af-ad09-58dbbad86d0a-webhook-cert\") pod \"maas-controller-776b74d8c5-wl57t\" (UID: \"e235155b-c14e-48af-ad09-58dbbad86d0a\") " pod="opendatahub/maas-controller-776b74d8c5-wl57t" Jun 15 08:32:02.454632 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.454607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2g7s\" (UniqueName: \"kubernetes.io/projected/e235155b-c14e-48af-ad09-58dbbad86d0a-kube-api-access-j2g7s\") pod \"maas-controller-776b74d8c5-wl57t\" (UID: \"e235155b-c14e-48af-ad09-58dbbad86d0a\") " pod="opendatahub/maas-controller-776b74d8c5-wl57t" Jun 15 08:32:02.459058 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.459037 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-776b74d8c5-wl57t"] Jun 15 08:32:02.555124 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.555094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e235155b-c14e-48af-ad09-58dbbad86d0a-webhook-cert\") pod \"maas-controller-776b74d8c5-wl57t\" (UID: \"e235155b-c14e-48af-ad09-58dbbad86d0a\") " pod="opendatahub/maas-controller-776b74d8c5-wl57t" Jun 15 08:32:02.555277 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.555165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2g7s\" (UniqueName: \"kubernetes.io/projected/e235155b-c14e-48af-ad09-58dbbad86d0a-kube-api-access-j2g7s\") pod \"maas-controller-776b74d8c5-wl57t\" (UID: \"e235155b-c14e-48af-ad09-58dbbad86d0a\") " pod="opendatahub/maas-controller-776b74d8c5-wl57t" Jun 15 08:32:02.555277 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:32:02.555242 2561 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 15 08:32:02.555388 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:32:02.555312 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e235155b-c14e-48af-ad09-58dbbad86d0a-webhook-cert podName:e235155b-c14e-48af-ad09-58dbbad86d0a nodeName:}" failed. No retries permitted until 2026-06-15 08:32:03.055295255 +0000 UTC m=+815.029293828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/e235155b-c14e-48af-ad09-58dbbad86d0a-webhook-cert") pod "maas-controller-776b74d8c5-wl57t" (UID: "e235155b-c14e-48af-ad09-58dbbad86d0a") : secret "maas-controller-webhook-cert" not found Jun 15 08:32:02.568665 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.568633 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2g7s\" (UniqueName: \"kubernetes.io/projected/e235155b-c14e-48af-ad09-58dbbad86d0a-kube-api-access-j2g7s\") pod \"maas-controller-776b74d8c5-wl57t\" (UID: \"e235155b-c14e-48af-ad09-58dbbad86d0a\") " pod="opendatahub/maas-controller-776b74d8c5-wl57t" Jun 15 08:32:02.653527 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.653496 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75b8b6dc77-d89tr"] Jun 15 08:32:02.656044 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.656028 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b8b6dc77-d89tr" Jun 15 08:32:02.669832 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.669805 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b8b6dc77-d89tr"] Jun 15 08:32:02.756332 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.756306 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/990d1ca3-7b42-44e4-855e-6e92e617c751-webhook-cert\") pod \"maas-controller-75b8b6dc77-d89tr\" (UID: \"990d1ca3-7b42-44e4-855e-6e92e617c751\") " pod="opendatahub/maas-controller-75b8b6dc77-d89tr" Jun 15 08:32:02.756489 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.756340 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf424\" (UniqueName: \"kubernetes.io/projected/990d1ca3-7b42-44e4-855e-6e92e617c751-kube-api-access-vf424\") pod \"maas-controller-75b8b6dc77-d89tr\" (UID: \"990d1ca3-7b42-44e4-855e-6e92e617c751\") " pod="opendatahub/maas-controller-75b8b6dc77-d89tr" Jun 15 08:32:02.857651 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.857620 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/990d1ca3-7b42-44e4-855e-6e92e617c751-webhook-cert\") pod \"maas-controller-75b8b6dc77-d89tr\" (UID: \"990d1ca3-7b42-44e4-855e-6e92e617c751\") " pod="opendatahub/maas-controller-75b8b6dc77-d89tr" Jun 15 08:32:02.857651 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.857653 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf424\" (UniqueName: \"kubernetes.io/projected/990d1ca3-7b42-44e4-855e-6e92e617c751-kube-api-access-vf424\") pod \"maas-controller-75b8b6dc77-d89tr\" (UID: \"990d1ca3-7b42-44e4-855e-6e92e617c751\") " pod="opendatahub/maas-controller-75b8b6dc77-d89tr" Jun 15 08:32:02.860058 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.860039 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/990d1ca3-7b42-44e4-855e-6e92e617c751-webhook-cert\") pod \"maas-controller-75b8b6dc77-d89tr\" (UID: \"990d1ca3-7b42-44e4-855e-6e92e617c751\") " pod="opendatahub/maas-controller-75b8b6dc77-d89tr" Jun 15 08:32:02.866422 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.866400 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf424\" (UniqueName: \"kubernetes.io/projected/990d1ca3-7b42-44e4-855e-6e92e617c751-kube-api-access-vf424\") pod \"maas-controller-75b8b6dc77-d89tr\" (UID: \"990d1ca3-7b42-44e4-855e-6e92e617c751\") " pod="opendatahub/maas-controller-75b8b6dc77-d89tr" Jun 15 08:32:02.965742 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:02.965684 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b8b6dc77-d89tr" Jun 15 08:32:03.059463 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:03.059428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e235155b-c14e-48af-ad09-58dbbad86d0a-webhook-cert\") pod \"maas-controller-776b74d8c5-wl57t\" (UID: \"e235155b-c14e-48af-ad09-58dbbad86d0a\") " pod="opendatahub/maas-controller-776b74d8c5-wl57t" Jun 15 08:32:03.061833 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:03.061813 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e235155b-c14e-48af-ad09-58dbbad86d0a-webhook-cert\") pod \"maas-controller-776b74d8c5-wl57t\" (UID: \"e235155b-c14e-48af-ad09-58dbbad86d0a\") " pod="opendatahub/maas-controller-776b74d8c5-wl57t" Jun 15 08:32:03.097604 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:03.097579 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b8b6dc77-d89tr"] Jun 15 08:32:03.100105 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:32:03.100080 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990d1ca3_7b42_44e4_855e_6e92e617c751.slice/crio-469a10b612674f00b2041d283873eedcf9416a6aab62bede950460fb0d67e9f9 WatchSource:0}: Error finding container 469a10b612674f00b2041d283873eedcf9416a6aab62bede950460fb0d67e9f9: Status 404 returned error can't find the container with id 469a10b612674f00b2041d283873eedcf9416a6aab62bede950460fb0d67e9f9 Jun 15 08:32:03.343374 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:03.343293 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-776b74d8c5-wl57t" Jun 15 08:32:03.475005 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:03.474911 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-776b74d8c5-wl57t"] Jun 15 08:32:03.477102 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:32:03.477077 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235155b_c14e_48af_ad09_58dbbad86d0a.slice/crio-9aea9370b9c9d42bfb8f44658c5e2996cb617d0633ba315f6b12e267509809f8 WatchSource:0}: Error finding container 9aea9370b9c9d42bfb8f44658c5e2996cb617d0633ba315f6b12e267509809f8: Status 404 returned error can't find the container with id 9aea9370b9c9d42bfb8f44658c5e2996cb617d0633ba315f6b12e267509809f8 Jun 15 08:32:03.897105 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:03.897059 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-776b74d8c5-wl57t" event={"ID":"e235155b-c14e-48af-ad09-58dbbad86d0a","Type":"ContainerStarted","Data":"9aea9370b9c9d42bfb8f44658c5e2996cb617d0633ba315f6b12e267509809f8"} Jun 15 08:32:03.899376 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:03.899287 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b8b6dc77-d89tr" event={"ID":"990d1ca3-7b42-44e4-855e-6e92e617c751","Type":"ContainerStarted","Data":"469a10b612674f00b2041d283873eedcf9416a6aab62bede950460fb0d67e9f9"} Jun 15 08:32:05.913135 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:05.913041 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-776b74d8c5-wl57t" event={"ID":"e235155b-c14e-48af-ad09-58dbbad86d0a","Type":"ContainerStarted","Data":"85b924de0f79ed7dc963f7a231074fd909d006a070e6ad1a37094c5384f9d752"} Jun 15 08:32:05.913547 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:05.913234 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-776b74d8c5-wl57t" Jun 15 08:32:05.914582 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:05.914561 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b8b6dc77-d89tr" event={"ID":"990d1ca3-7b42-44e4-855e-6e92e617c751","Type":"ContainerStarted","Data":"4a90a473769509146d2f5b2cce79201c979e3d1d5dade353b79539091b5abadf"} Jun 15 08:32:05.914723 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:05.914682 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75b8b6dc77-d89tr" Jun 15 08:32:05.941371 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:05.941329 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-776b74d8c5-wl57t" podStartSLOduration=1.8426282330000001 podStartE2EDuration="3.941317119s" totalImagesPullingTime="2.098688886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:32:05.940802529 +0000 UTC m=+817.914801123" watchObservedRunningTime="2026-06-15 08:32:05.941317119 +0000 UTC m=+817.915315712" Jun 15 08:32:05.976404 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:05.976357 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75b8b6dc77-d89tr" podStartSLOduration=1.510323583 podStartE2EDuration="3.976344404s" totalImagesPullingTime="2.466020821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:32:05.975963042 +0000 UTC m=+817.949961636" watchObservedRunningTime="2026-06-15 08:32:05.976344404 +0000 UTC m=+817.950343034" Jun 15 08:32:16.925796 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:16.925766 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-776b74d8c5-wl57t" Jun 15 08:32:16.926193 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:16.925839 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75b8b6dc77-d89tr" Jun 15 08:32:16.983958 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:16.983926 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-776b74d8c5-wl57t"] Jun 15 08:32:16.984189 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:16.984160 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-776b74d8c5-wl57t" podUID="e235155b-c14e-48af-ad09-58dbbad86d0a" containerName="manager" containerID="cri-o://85b924de0f79ed7dc963f7a231074fd909d006a070e6ad1a37094c5384f9d752" gracePeriod=30 Jun 15 08:32:17.232627 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.232601 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-776b74d8c5-wl57t" Jun 15 08:32:17.287014 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.286985 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e235155b-c14e-48af-ad09-58dbbad86d0a-webhook-cert\") pod \"e235155b-c14e-48af-ad09-58dbbad86d0a\" (UID: \"e235155b-c14e-48af-ad09-58dbbad86d0a\") " Jun 15 08:32:17.287184 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.287101 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2g7s\" (UniqueName: \"kubernetes.io/projected/e235155b-c14e-48af-ad09-58dbbad86d0a-kube-api-access-j2g7s\") pod \"e235155b-c14e-48af-ad09-58dbbad86d0a\" (UID: \"e235155b-c14e-48af-ad09-58dbbad86d0a\") " Jun 15 08:32:17.289252 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.289224 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e235155b-c14e-48af-ad09-58dbbad86d0a-kube-api-access-j2g7s" (OuterVolumeSpecName: "kube-api-access-j2g7s") pod "e235155b-c14e-48af-ad09-58dbbad86d0a" (UID: "e235155b-c14e-48af-ad09-58dbbad86d0a"). InnerVolumeSpecName "kube-api-access-j2g7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:32:17.289366 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.289268 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e235155b-c14e-48af-ad09-58dbbad86d0a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e235155b-c14e-48af-ad09-58dbbad86d0a" (UID: "e235155b-c14e-48af-ad09-58dbbad86d0a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:32:17.388136 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.388106 2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e235155b-c14e-48af-ad09-58dbbad86d0a-webhook-cert\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:32:17.388136 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.388133 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2g7s\" (UniqueName: \"kubernetes.io/projected/e235155b-c14e-48af-ad09-58dbbad86d0a-kube-api-access-j2g7s\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:32:17.974599 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.974565 2561 generic.go:356] "Generic (PLEG): container finished" podID="e235155b-c14e-48af-ad09-58dbbad86d0a" containerID="85b924de0f79ed7dc963f7a231074fd909d006a070e6ad1a37094c5384f9d752" exitCode=0 Jun 15 08:32:17.975090 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.974610 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-776b74d8c5-wl57t" Jun 15 08:32:17.975090 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.974638 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-776b74d8c5-wl57t" event={"ID":"e235155b-c14e-48af-ad09-58dbbad86d0a","Type":"ContainerDied","Data":"85b924de0f79ed7dc963f7a231074fd909d006a070e6ad1a37094c5384f9d752"} Jun 15 08:32:17.975090 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.974677 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-776b74d8c5-wl57t" event={"ID":"e235155b-c14e-48af-ad09-58dbbad86d0a","Type":"ContainerDied","Data":"9aea9370b9c9d42bfb8f44658c5e2996cb617d0633ba315f6b12e267509809f8"} Jun 15 08:32:17.975090 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.974721 2561 scope.go:117] "RemoveContainer" containerID="85b924de0f79ed7dc963f7a231074fd909d006a070e6ad1a37094c5384f9d752" Jun 15 08:32:17.983869 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.983854 2561 scope.go:117] "RemoveContainer" containerID="85b924de0f79ed7dc963f7a231074fd909d006a070e6ad1a37094c5384f9d752" Jun 15 08:32:17.984128 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:32:17.984106 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85b924de0f79ed7dc963f7a231074fd909d006a070e6ad1a37094c5384f9d752\": container with ID starting with 85b924de0f79ed7dc963f7a231074fd909d006a070e6ad1a37094c5384f9d752 not found: ID does not exist" containerID="85b924de0f79ed7dc963f7a231074fd909d006a070e6ad1a37094c5384f9d752" Jun 15 08:32:17.984194 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.984138 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b924de0f79ed7dc963f7a231074fd909d006a070e6ad1a37094c5384f9d752"} err="failed to get container status \"85b924de0f79ed7dc963f7a231074fd909d006a070e6ad1a37094c5384f9d752\": rpc error: code = NotFound desc = could not find container \"85b924de0f79ed7dc963f7a231074fd909d006a070e6ad1a37094c5384f9d752\": container with ID starting with 85b924de0f79ed7dc963f7a231074fd909d006a070e6ad1a37094c5384f9d752 not found: ID does not exist" Jun 15 08:32:17.995537 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.995505 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-776b74d8c5-wl57t"] Jun 15 08:32:17.998102 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:17.998083 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-776b74d8c5-wl57t"] Jun 15 08:32:18.456970 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:18.456935 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e235155b-c14e-48af-ad09-58dbbad86d0a" path="/var/lib/kubelet/pods/e235155b-c14e-48af-ad09-58dbbad86d0a/volumes" Jun 15 08:32:34.443382 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.443347 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-697554dff8-cdfbn"] Jun 15 08:32:34.443846 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.443791 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e235155b-c14e-48af-ad09-58dbbad86d0a" containerName="manager" Jun 15 08:32:34.443846 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.443804 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e235155b-c14e-48af-ad09-58dbbad86d0a" containerName="manager" Jun 15 08:32:34.443923 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.443883 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e235155b-c14e-48af-ad09-58dbbad86d0a" containerName="manager" Jun 15 08:32:34.448435 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.448414 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-697554dff8-cdfbn" Jun 15 08:32:34.453662 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.453641 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-c45t6\"" Jun 15 08:32:34.454587 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.454563 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 15 08:32:34.537672 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.537644 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-697554dff8-cdfbn"] Jun 15 08:32:34.539880 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.539850 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bb53651-e475-49a0-ab82-677b0d81bed2-maas-api-tls\") pod \"maas-api-697554dff8-cdfbn\" (UID: \"7bb53651-e475-49a0-ab82-677b0d81bed2\") " pod="opendatahub/maas-api-697554dff8-cdfbn" Jun 15 08:32:34.540000 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.539884 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwt29\" (UniqueName: \"kubernetes.io/projected/7bb53651-e475-49a0-ab82-677b0d81bed2-kube-api-access-gwt29\") pod \"maas-api-697554dff8-cdfbn\" (UID: \"7bb53651-e475-49a0-ab82-677b0d81bed2\") " pod="opendatahub/maas-api-697554dff8-cdfbn" Jun 15 08:32:34.540052 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.540009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bb53651-e475-49a0-ab82-677b0d81bed2-openshift-service-ca\") pod \"maas-api-697554dff8-cdfbn\" (UID: \"7bb53651-e475-49a0-ab82-677b0d81bed2\") " pod="opendatahub/maas-api-697554dff8-cdfbn" Jun 15 08:32:34.641409 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.641372 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bb53651-e475-49a0-ab82-677b0d81bed2-openshift-service-ca\") pod \"maas-api-697554dff8-cdfbn\" (UID: \"7bb53651-e475-49a0-ab82-677b0d81bed2\") " pod="opendatahub/maas-api-697554dff8-cdfbn" Jun 15 08:32:34.641601 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.641447 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bb53651-e475-49a0-ab82-677b0d81bed2-maas-api-tls\") pod \"maas-api-697554dff8-cdfbn\" (UID: \"7bb53651-e475-49a0-ab82-677b0d81bed2\") " pod="opendatahub/maas-api-697554dff8-cdfbn" Jun 15 08:32:34.641601 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.641465 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwt29\" (UniqueName: \"kubernetes.io/projected/7bb53651-e475-49a0-ab82-677b0d81bed2-kube-api-access-gwt29\") pod \"maas-api-697554dff8-cdfbn\" (UID: \"7bb53651-e475-49a0-ab82-677b0d81bed2\") " pod="opendatahub/maas-api-697554dff8-cdfbn" Jun 15 08:32:34.642112 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.642086 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bb53651-e475-49a0-ab82-677b0d81bed2-openshift-service-ca\") pod \"maas-api-697554dff8-cdfbn\" (UID: \"7bb53651-e475-49a0-ab82-677b0d81bed2\") " pod="opendatahub/maas-api-697554dff8-cdfbn" Jun 15 08:32:34.644005 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.643983 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bb53651-e475-49a0-ab82-677b0d81bed2-maas-api-tls\") pod \"maas-api-697554dff8-cdfbn\" (UID: \"7bb53651-e475-49a0-ab82-677b0d81bed2\") " pod="opendatahub/maas-api-697554dff8-cdfbn" Jun 15 08:32:34.655581 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.655557 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwt29\" (UniqueName: \"kubernetes.io/projected/7bb53651-e475-49a0-ab82-677b0d81bed2-kube-api-access-gwt29\") pod \"maas-api-697554dff8-cdfbn\" (UID: \"7bb53651-e475-49a0-ab82-677b0d81bed2\") " pod="opendatahub/maas-api-697554dff8-cdfbn" Jun 15 08:32:34.758966 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.758935 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-697554dff8-cdfbn" Jun 15 08:32:34.901647 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:34.901610 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-697554dff8-cdfbn"] Jun 15 08:32:34.909388 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:32:34.909357 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb53651_e475_49a0_ab82_677b0d81bed2.slice/crio-bfbc0831ccca933cf4255d0b3c75ed9c963cb486814a55d904f86f4f230291b1 WatchSource:0}: Error finding container bfbc0831ccca933cf4255d0b3c75ed9c963cb486814a55d904f86f4f230291b1: Status 404 returned error can't find the container with id bfbc0831ccca933cf4255d0b3c75ed9c963cb486814a55d904f86f4f230291b1 Jun 15 08:32:35.058987 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.058900 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-697554dff8-cdfbn" event={"ID":"7bb53651-e475-49a0-ab82-677b0d81bed2","Type":"ContainerStarted","Data":"bfbc0831ccca933cf4255d0b3c75ed9c963cb486814a55d904f86f4f230291b1"} Jun 15 08:32:35.126639 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.126603 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-s77kc"] Jun 15 08:32:35.131508 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.131488 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-s77kc" Jun 15 08:32:35.135577 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.135559 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 15 08:32:35.142800 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.142778 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-8b5mb"] Jun 15 08:32:35.146583 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.146565 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-8b5mb" Jun 15 08:32:35.147556 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.147538 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-s77kc"] Jun 15 08:32:35.175896 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.175873 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-8b5mb"] Jun 15 08:32:35.246257 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.246234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8hrk\" (UniqueName: \"kubernetes.io/projected/ae766e8b-beb5-466b-8c2f-2f9373a7bae5-kube-api-access-f8hrk\") pod \"payload-pre-processing-579785bc64-s77kc\" (UID: \"ae766e8b-beb5-466b-8c2f-2f9373a7bae5\") " pod="openshift-ingress/payload-pre-processing-579785bc64-s77kc" Jun 15 08:32:35.246401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.246270 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjxc6\" (UniqueName: \"kubernetes.io/projected/ab1b1699-6cea-4c1f-ad81-9fde79390542-kube-api-access-hjxc6\") pod \"payload-processing-699b6cd6c-8b5mb\" (UID: \"ab1b1699-6cea-4c1f-ad81-9fde79390542\") " pod="openshift-ingress/payload-processing-699b6cd6c-8b5mb" Jun 15 08:32:35.347750 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.347652 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hrk\" (UniqueName: \"kubernetes.io/projected/ae766e8b-beb5-466b-8c2f-2f9373a7bae5-kube-api-access-f8hrk\") pod \"payload-pre-processing-579785bc64-s77kc\" (UID: \"ae766e8b-beb5-466b-8c2f-2f9373a7bae5\") " pod="openshift-ingress/payload-pre-processing-579785bc64-s77kc" Jun 15 08:32:35.347750 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.347688 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjxc6\" (UniqueName: \"kubernetes.io/projected/ab1b1699-6cea-4c1f-ad81-9fde79390542-kube-api-access-hjxc6\") pod \"payload-processing-699b6cd6c-8b5mb\" (UID: \"ab1b1699-6cea-4c1f-ad81-9fde79390542\") " pod="openshift-ingress/payload-processing-699b6cd6c-8b5mb" Jun 15 08:32:35.359929 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.359903 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8hrk\" (UniqueName: \"kubernetes.io/projected/ae766e8b-beb5-466b-8c2f-2f9373a7bae5-kube-api-access-f8hrk\") pod \"payload-pre-processing-579785bc64-s77kc\" (UID: \"ae766e8b-beb5-466b-8c2f-2f9373a7bae5\") " pod="openshift-ingress/payload-pre-processing-579785bc64-s77kc" Jun 15 08:32:35.360168 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.360150 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjxc6\" (UniqueName: \"kubernetes.io/projected/ab1b1699-6cea-4c1f-ad81-9fde79390542-kube-api-access-hjxc6\") pod \"payload-processing-699b6cd6c-8b5mb\" (UID: \"ab1b1699-6cea-4c1f-ad81-9fde79390542\") " pod="openshift-ingress/payload-processing-699b6cd6c-8b5mb" Jun 15 08:32:35.442742 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.442686 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-s77kc" Jun 15 08:32:35.457065 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.457043 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-8b5mb" Jun 15 08:32:35.610578 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.610546 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-s77kc"] Jun 15 08:32:35.613601 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:32:35.613567 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae766e8b_beb5_466b_8c2f_2f9373a7bae5.slice/crio-c35657ef1234a5c58d91b67fa35a99517c7b8d7156125d447968282b7dae6235 WatchSource:0}: Error finding container c35657ef1234a5c58d91b67fa35a99517c7b8d7156125d447968282b7dae6235: Status 404 returned error can't find the container with id c35657ef1234a5c58d91b67fa35a99517c7b8d7156125d447968282b7dae6235 Jun 15 08:32:35.636539 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:35.635402 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-8b5mb"] Jun 15 08:32:35.637761 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:32:35.637633 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1b1699_6cea_4c1f_ad81_9fde79390542.slice/crio-420583a7f83227d042e42b3627c1fe3518ec4165d49508482423171b2a6fc0df WatchSource:0}: Error finding container 420583a7f83227d042e42b3627c1fe3518ec4165d49508482423171b2a6fc0df: Status 404 returned error can't find the container with id 420583a7f83227d042e42b3627c1fe3518ec4165d49508482423171b2a6fc0df Jun 15 08:32:36.066704 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:36.066664 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-s77kc" event={"ID":"ae766e8b-beb5-466b-8c2f-2f9373a7bae5","Type":"ContainerStarted","Data":"c35657ef1234a5c58d91b67fa35a99517c7b8d7156125d447968282b7dae6235"} Jun 15 08:32:36.068075 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:36.068046 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-8b5mb" event={"ID":"ab1b1699-6cea-4c1f-ad81-9fde79390542","Type":"ContainerStarted","Data":"420583a7f83227d042e42b3627c1fe3518ec4165d49508482423171b2a6fc0df"} Jun 15 08:32:38.105735 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:38.105657 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-697554dff8-cdfbn" event={"ID":"7bb53651-e475-49a0-ab82-677b0d81bed2","Type":"ContainerStarted","Data":"b347f348fdb5caacbd4d93b2e90167b45aff31b9260c6f312ebaf913fecb436e"} Jun 15 08:32:38.106191 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:38.105885 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-697554dff8-cdfbn" Jun 15 08:32:38.126123 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:38.126069 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-697554dff8-cdfbn" podStartSLOduration=1.826305525 podStartE2EDuration="4.12604617s" totalImagesPullingTime="2.299740645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:32:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:32:38.124426414 +0000 UTC m=+850.098425022" watchObservedRunningTime="2026-06-15 08:32:38.12604617 +0000 UTC m=+850.100044767" Jun 15 08:32:39.114002 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:39.113966 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-s77kc" event={"ID":"ae766e8b-beb5-466b-8c2f-2f9373a7bae5","Type":"ContainerStarted","Data":"ccc048892a5590193d79256e641d7b5555a723469a069837aa1e00a701bce8bd"} Jun 15 08:32:39.114377 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:39.114231 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-s77kc" Jun 15 08:32:39.116428 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:39.116399 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-8b5mb" event={"ID":"ab1b1699-6cea-4c1f-ad81-9fde79390542","Type":"ContainerStarted","Data":"81dc1a2342c2de60dca79313c2108c71fcbbaa3118b3c781fe9d0a400560e736"} Jun 15 08:32:39.116560 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:39.116493 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-8b5mb" Jun 15 08:32:39.133023 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:39.132979 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-s77kc" podStartSLOduration=0.796790362 podStartE2EDuration="4.132966711s" totalImagesPullingTime="3.336176349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:32:39.131370444 +0000 UTC m=+851.105369039" watchObservedRunningTime="2026-06-15 08:32:39.132966711 +0000 UTC m=+851.106965305" Jun 15 08:32:39.151568 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:39.151529 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-8b5mb" podStartSLOduration=0.844258447 podStartE2EDuration="4.151515092s" totalImagesPullingTime="3.307256645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:32:39.150076342 +0000 UTC m=+851.124074947" watchObservedRunningTime="2026-06-15 08:32:39.151515092 +0000 UTC m=+851.125513687" Jun 15 08:32:43.140992 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:43.140884 2561 generic.go:356] "Generic (PLEG): container finished" podID="61ba32d4-0f86-42a6-ae3a-3f968ebd4126" containerID="88f16dd7def59189a3a4d6eb611b3113c3d83999ae34bf2e6a3e356a9438e5ba" exitCode=0 Jun 15 08:32:43.140992 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:43.140951 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" event={"ID":"61ba32d4-0f86-42a6-ae3a-3f968ebd4126","Type":"ContainerDied","Data":"88f16dd7def59189a3a4d6eb611b3113c3d83999ae34bf2e6a3e356a9438e5ba"} Jun 15 08:32:43.141566 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:43.141442 2561 scope.go:117] "RemoveContainer" containerID="88f16dd7def59189a3a4d6eb611b3113c3d83999ae34bf2e6a3e356a9438e5ba" Jun 15 08:32:43.142574 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:43.142548 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 15 08:32:43.142732 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:43.142611 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 15 08:32:43.142732 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:43.142640 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 15 08:32:44.122173 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:44.122136 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-697554dff8-cdfbn" Jun 15 08:32:44.148330 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:44.148297 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" event={"ID":"61ba32d4-0f86-42a6-ae3a-3f968ebd4126","Type":"ContainerStarted","Data":"9d8d479369d8f64424be2df00e63d5e365df93044d373dfb593047f9063f9268"} Jun 15 08:32:44.803807 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:44.803766 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:32:44.803996 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:44.803959 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-5bbfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jun 15 08:32:44.804042 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:44.804011 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" podUID="61ba32d4-0f86-42a6-ae3a-3f968ebd4126" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jun 15 08:32:45.472351 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:45.472307 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 08:32:45.472859 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:45.472542 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" containerID="cri-o://c2b3fbc5a7e733ee0e4bee3fc7472c78403cf6cb3269ca9ffea5ddcceba2edd1" gracePeriod=30 Jun 15 08:32:45.803620 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:45.803521 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-5bbfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jun 15 08:32:45.803620 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:45.803594 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" podUID="61ba32d4-0f86-42a6-ae3a-3f968ebd4126" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jun 15 08:32:46.668163 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:46.668121 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/ready\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 08:32:46.804000 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:46.803961 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-5bbfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jun 15 08:32:46.804214 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:46.804028 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" podUID="61ba32d4-0f86-42a6-ae3a-3f968ebd4126" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jun 15 08:32:47.161519 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.161490 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 08:32:47.164408 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.164382 2561 generic.go:356] "Generic (PLEG): container finished" podID="c6956681-a833-4025-b905-b811d33529ff" containerID="c2b3fbc5a7e733ee0e4bee3fc7472c78403cf6cb3269ca9ffea5ddcceba2edd1" exitCode=143 Jun 15 08:32:47.164534 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.164422 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 08:32:47.164534 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.164465 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c6956681-a833-4025-b905-b811d33529ff","Type":"ContainerDied","Data":"c2b3fbc5a7e733ee0e4bee3fc7472c78403cf6cb3269ca9ffea5ddcceba2edd1"} Jun 15 08:32:47.164534 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.164519 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c6956681-a833-4025-b905-b811d33529ff","Type":"ContainerDied","Data":"185961af469d4103a0bd690e43f1fbfcfbd6229d04f232576b6771ad939e6c9e"} Jun 15 08:32:47.164641 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.164539 2561 scope.go:117] "RemoveContainer" containerID="c2b3fbc5a7e733ee0e4bee3fc7472c78403cf6cb3269ca9ffea5ddcceba2edd1" Jun 15 08:32:47.173799 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.173781 2561 scope.go:117] "RemoveContainer" containerID="c2b3fbc5a7e733ee0e4bee3fc7472c78403cf6cb3269ca9ffea5ddcceba2edd1" Jun 15 08:32:47.174104 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:32:47.174062 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b3fbc5a7e733ee0e4bee3fc7472c78403cf6cb3269ca9ffea5ddcceba2edd1\": container with ID starting with c2b3fbc5a7e733ee0e4bee3fc7472c78403cf6cb3269ca9ffea5ddcceba2edd1 not found: ID does not exist" containerID="c2b3fbc5a7e733ee0e4bee3fc7472c78403cf6cb3269ca9ffea5ddcceba2edd1" Jun 15 08:32:47.174167 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.174112 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b3fbc5a7e733ee0e4bee3fc7472c78403cf6cb3269ca9ffea5ddcceba2edd1"} err="failed to get container status \"c2b3fbc5a7e733ee0e4bee3fc7472c78403cf6cb3269ca9ffea5ddcceba2edd1\": rpc error: code = NotFound desc = could not find container \"c2b3fbc5a7e733ee0e4bee3fc7472c78403cf6cb3269ca9ffea5ddcceba2edd1\": container with ID starting with c2b3fbc5a7e733ee0e4bee3fc7472c78403cf6cb3269ca9ffea5ddcceba2edd1 not found: ID does not exist" Jun 15 08:32:47.206347 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.206317 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nztf\" (UniqueName: \"kubernetes.io/projected/c6956681-a833-4025-b905-b811d33529ff-kube-api-access-4nztf\") pod \"c6956681-a833-4025-b905-b811d33529ff\" (UID: \"c6956681-a833-4025-b905-b811d33529ff\") " Jun 15 08:32:47.209839 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.209806 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6956681-a833-4025-b905-b811d33529ff-kube-api-access-4nztf" (OuterVolumeSpecName: "kube-api-access-4nztf") pod "c6956681-a833-4025-b905-b811d33529ff" (UID: "c6956681-a833-4025-b905-b811d33529ff"). InnerVolumeSpecName "kube-api-access-4nztf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:32:47.307563 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.307527 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nztf\" (UniqueName: \"kubernetes.io/projected/c6956681-a833-4025-b905-b811d33529ff-kube-api-access-4nztf\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:32:47.489199 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.489152 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 08:32:47.498365 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.498325 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 08:32:47.536922 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.536880 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 08:32:47.537555 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.537530 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" Jun 15 08:32:47.537555 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.537554 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" Jun 15 08:32:47.537727 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.537635 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6956681-a833-4025-b905-b811d33529ff" containerName="keycloak" Jun 15 08:32:47.543497 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.542645 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 08:32:47.549641 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.548952 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 08:32:47.549641 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.549250 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 15 08:32:47.549641 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.549459 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 08:32:47.552960 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.552847 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-w8dzq\"" Jun 15 08:32:47.553062 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.553030 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 08:32:47.566494 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.566425 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 08:32:47.609998 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.609773 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82rsk\" (UniqueName: \"kubernetes.io/projected/d92e1f1e-e2e1-4385-8375-9b51e6f591db-kube-api-access-82rsk\") pod \"maas-keycloak-0\" (UID: \"d92e1f1e-e2e1-4385-8375-9b51e6f591db\") " pod="keycloak-system/maas-keycloak-0" Jun 15 08:32:47.609998 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.609907 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d92e1f1e-e2e1-4385-8375-9b51e6f591db-test-realms\") pod \"maas-keycloak-0\" (UID: \"d92e1f1e-e2e1-4385-8375-9b51e6f591db\") " pod="keycloak-system/maas-keycloak-0" Jun 15 08:32:47.710511 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.710477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d92e1f1e-e2e1-4385-8375-9b51e6f591db-test-realms\") pod \"maas-keycloak-0\" (UID: \"d92e1f1e-e2e1-4385-8375-9b51e6f591db\") " pod="keycloak-system/maas-keycloak-0" Jun 15 08:32:47.710914 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.710529 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82rsk\" (UniqueName: \"kubernetes.io/projected/d92e1f1e-e2e1-4385-8375-9b51e6f591db-kube-api-access-82rsk\") pod \"maas-keycloak-0\" (UID: \"d92e1f1e-e2e1-4385-8375-9b51e6f591db\") " pod="keycloak-system/maas-keycloak-0" Jun 15 08:32:47.711226 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.711206 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d92e1f1e-e2e1-4385-8375-9b51e6f591db-test-realms\") pod \"maas-keycloak-0\" (UID: \"d92e1f1e-e2e1-4385-8375-9b51e6f591db\") " pod="keycloak-system/maas-keycloak-0" Jun 15 08:32:47.721142 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.721118 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82rsk\" (UniqueName: \"kubernetes.io/projected/d92e1f1e-e2e1-4385-8375-9b51e6f591db-kube-api-access-82rsk\") pod \"maas-keycloak-0\" (UID: \"d92e1f1e-e2e1-4385-8375-9b51e6f591db\") " pod="keycloak-system/maas-keycloak-0" Jun 15 08:32:47.803879 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.803790 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-5bbfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jun 15 08:32:47.803879 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.803849 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" podUID="61ba32d4-0f86-42a6-ae3a-3f968ebd4126" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jun 15 08:32:47.856179 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:47.856146 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 08:32:48.037437 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:48.037407 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 08:32:48.040587 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:32:48.040537 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92e1f1e_e2e1_4385_8375_9b51e6f591db.slice/crio-51c9a1e845d3acacd927e7579e8c84bb4525d19c58ed81ffed21e628af14298c WatchSource:0}: Error finding container 51c9a1e845d3acacd927e7579e8c84bb4525d19c58ed81ffed21e628af14298c: Status 404 returned error can't find the container with id 51c9a1e845d3acacd927e7579e8c84bb4525d19c58ed81ffed21e628af14298c Jun 15 08:32:48.172338 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:48.172252 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d92e1f1e-e2e1-4385-8375-9b51e6f591db","Type":"ContainerStarted","Data":"51c9a1e845d3acacd927e7579e8c84bb4525d19c58ed81ffed21e628af14298c"} Jun 15 08:32:48.460778 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:48.460744 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6956681-a833-4025-b905-b811d33529ff" path="/var/lib/kubelet/pods/c6956681-a833-4025-b905-b811d33529ff/volumes" Jun 15 08:32:48.807476 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:48.807440 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:32:48.807918 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:48.807804 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:32:48.808425 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:48.808402 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5bbfw" Jun 15 08:32:49.180522 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:49.180429 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d92e1f1e-e2e1-4385-8375-9b51e6f591db","Type":"ContainerStarted","Data":"e98dc3820b8468125a8f5bdff1ab2c1ff7b63e99850d48317823f41caa1b5826"} Jun 15 08:32:49.212613 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:49.212549 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.8569913759999999 podStartE2EDuration="2.212528033s" totalImagesPullingTime="355.536657ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:32:49.212500017 +0000 UTC m=+861.186498611" watchObservedRunningTime="2026-06-15 08:32:49.212528033 +0000 UTC m=+861.186526629" Jun 15 08:32:49.857319 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:49.857267 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 15 08:32:49.859160 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:49.859124 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d92e1f1e-e2e1-4385-8375-9b51e6f591db" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 15 08:32:50.124135 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:50.124046 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-8b5mb" Jun 15 08:32:50.124310 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:50.124149 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-s77kc" Jun 15 08:32:50.857229 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:50.857167 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d92e1f1e-e2e1-4385-8375-9b51e6f591db" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 15 08:32:51.857618 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:51.857566 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d92e1f1e-e2e1-4385-8375-9b51e6f591db" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 15 08:32:52.857592 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:52.857534 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d92e1f1e-e2e1-4385-8375-9b51e6f591db" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 15 08:32:53.857548 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:53.857489 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d92e1f1e-e2e1-4385-8375-9b51e6f591db" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 15 08:32:54.857528 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:54.857479 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d92e1f1e-e2e1-4385-8375-9b51e6f591db" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 15 08:32:55.857709 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:55.857642 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d92e1f1e-e2e1-4385-8375-9b51e6f591db" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 15 08:32:56.857021 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:56.856973 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d92e1f1e-e2e1-4385-8375-9b51e6f591db" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 15 08:32:57.857035 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:57.856983 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 15 08:32:57.857549 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:57.857334 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d92e1f1e-e2e1-4385-8375-9b51e6f591db" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 15 08:32:58.857039 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:58.856994 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d92e1f1e-e2e1-4385-8375-9b51e6f591db" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 15 08:32:59.856917 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:32:59.856872 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d92e1f1e-e2e1-4385-8375-9b51e6f591db" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 15 08:33:00.857450 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:00.857399 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d92e1f1e-e2e1-4385-8375-9b51e6f591db" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 15 08:33:01.983580 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:01.983536 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 15 08:33:02.002840 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:02.002781 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d92e1f1e-e2e1-4385-8375-9b51e6f591db" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 08:33:11.989955 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:11.989916 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 15 08:33:28.491000 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:28.490969 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:33:28.492222 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:28.492199 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:33:28.499012 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:28.498985 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:33:28.500010 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:28.499996 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:33:50.786894 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:50.786864 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k"] Jun 15 08:33:50.790423 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:50.790406 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:50.792707 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:50.792672 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 15 08:33:50.792799 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:50.792677 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 15 08:33:50.793545 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:50.793527 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bzqr8\"" Jun 15 08:33:50.793626 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:50.793537 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 15 08:33:50.801686 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:50.801666 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k"] Jun 15 08:33:50.913748 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:50.913691 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:50.913893 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:50.913757 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:50.913893 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:50.913819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:50.913893 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:50.913848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:50.914000 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:50.913922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49vnl\" (UniqueName: \"kubernetes.io/projected/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-kube-api-access-49vnl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:50.914000 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:50.913974 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:51.015324 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.015289 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vnl\" (UniqueName: \"kubernetes.io/projected/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-kube-api-access-49vnl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:51.015324 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.015330 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:51.015555 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.015365 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:51.015555 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.015380 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:51.015555 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.015430 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:51.015555 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.015456 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:51.015850 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.015827 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:51.015917 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.015870 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:51.015917 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.015891 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:51.017780 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.017752 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:51.018036 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.018021 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:51.022869 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.022844 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49vnl\" (UniqueName: \"kubernetes.io/projected/916a45e7-40dd-4e5c-9b45-ddd752fb59e8-kube-api-access-49vnl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k\" (UID: \"916a45e7-40dd-4e5c-9b45-ddd752fb59e8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:51.101827 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.101774 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:33:51.240556 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.240529 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k"] Jun 15 08:33:51.242764 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:33:51.242733 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916a45e7_40dd_4e5c_9b45_ddd752fb59e8.slice/crio-78736f5e26a28945197444a30de561b97589da56715b17783dd3e1f58c845718 WatchSource:0}: Error finding container 78736f5e26a28945197444a30de561b97589da56715b17783dd3e1f58c845718: Status 404 returned error can't find the container with id 78736f5e26a28945197444a30de561b97589da56715b17783dd3e1f58c845718 Jun 15 08:33:51.551445 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:51.551411 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" event={"ID":"916a45e7-40dd-4e5c-9b45-ddd752fb59e8","Type":"ContainerStarted","Data":"78736f5e26a28945197444a30de561b97589da56715b17783dd3e1f58c845718"} Jun 15 08:33:57.596237 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:57.596202 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" event={"ID":"916a45e7-40dd-4e5c-9b45-ddd752fb59e8","Type":"ContainerStarted","Data":"18a372fc246796fdd5f55612404793e601536f23fa7a606e75ec6ee733058ab4"} Jun 15 08:33:58.603737 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:58.603681 2561 generic.go:356] "Generic (PLEG): container finished" podID="916a45e7-40dd-4e5c-9b45-ddd752fb59e8" containerID="18a372fc246796fdd5f55612404793e601536f23fa7a606e75ec6ee733058ab4" exitCode=0 Jun 15 08:33:58.604180 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:33:58.603776 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" event={"ID":"916a45e7-40dd-4e5c-9b45-ddd752fb59e8","Type":"ContainerDied","Data":"18a372fc246796fdd5f55612404793e601536f23fa7a606e75ec6ee733058ab4"} Jun 15 08:34:00.619579 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:00.619531 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" event={"ID":"916a45e7-40dd-4e5c-9b45-ddd752fb59e8","Type":"ContainerStarted","Data":"c2a2cbd9c0ba0c72ae14aa7a7acf593f9ecc12797d59c282cddd6b17815c42c2"} Jun 15 08:34:00.642386 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:00.642334 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" podStartSLOduration=2.976815234 podStartE2EDuration="10.642316709s" totalImagesPullingTime="6.382701413s" totalInitContainerRuntime="1.282800062s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:33:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:34:00.639054837 +0000 UTC m=+932.613053452" watchObservedRunningTime="2026-06-15 08:34:00.642316709 +0000 UTC m=+932.616315303" Jun 15 08:34:01.102023 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:01.101989 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:34:01.102211 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:01.102061 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:34:01.114723 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:01.114664 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:34:01.636585 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:01.636557 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k" Jun 15 08:34:10.886889 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:10.886857 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42"] Jun 15 08:34:10.999454 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:10.999427 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42"] Jun 15 08:34:10.999622 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:10.999522 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.002064 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.002037 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 15 08:34:11.105558 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.105528 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66f29f66-784d-458b-a52b-27baaaf61ce2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.105741 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.105578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtjqs\" (UniqueName: \"kubernetes.io/projected/66f29f66-784d-458b-a52b-27baaaf61ce2-kube-api-access-gtjqs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.105741 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.105625 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66f29f66-784d-458b-a52b-27baaaf61ce2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.105741 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.105659 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66f29f66-784d-458b-a52b-27baaaf61ce2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.105741 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.105707 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66f29f66-784d-458b-a52b-27baaaf61ce2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.105906 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.105773 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66f29f66-784d-458b-a52b-27baaaf61ce2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.206358 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.206328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66f29f66-784d-458b-a52b-27baaaf61ce2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.206506 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.206434 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66f29f66-784d-458b-a52b-27baaaf61ce2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.206506 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.206485 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtjqs\" (UniqueName: \"kubernetes.io/projected/66f29f66-784d-458b-a52b-27baaaf61ce2-kube-api-access-gtjqs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.206583 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.206539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66f29f66-784d-458b-a52b-27baaaf61ce2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.206583 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.206565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66f29f66-784d-458b-a52b-27baaaf61ce2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.206666 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.206591 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66f29f66-784d-458b-a52b-27baaaf61ce2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.206970 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.206940 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66f29f66-784d-458b-a52b-27baaaf61ce2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.207096 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.206941 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66f29f66-784d-458b-a52b-27baaaf61ce2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.207096 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.207004 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66f29f66-784d-458b-a52b-27baaaf61ce2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.208781 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.208756 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66f29f66-784d-458b-a52b-27baaaf61ce2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.209067 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.209049 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66f29f66-784d-458b-a52b-27baaaf61ce2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.215036 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.215010 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtjqs\" (UniqueName: \"kubernetes.io/projected/66f29f66-784d-458b-a52b-27baaaf61ce2-kube-api-access-gtjqs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bmm42\" (UID: \"66f29f66-784d-458b-a52b-27baaaf61ce2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.310074 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.310040 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:11.479253 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.479222 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42"] Jun 15 08:34:11.480874 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:34:11.480847 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f29f66_784d_458b_a52b_27baaaf61ce2.slice/crio-36bfedd07da968bca83eeed49d9d54e3eba9c30a2a2b96bc8449c68f3cf1aab9 WatchSource:0}: Error finding container 36bfedd07da968bca83eeed49d9d54e3eba9c30a2a2b96bc8449c68f3cf1aab9: Status 404 returned error can't find the container with id 36bfedd07da968bca83eeed49d9d54e3eba9c30a2a2b96bc8449c68f3cf1aab9 Jun 15 08:34:11.680709 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.680659 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" event={"ID":"66f29f66-784d-458b-a52b-27baaaf61ce2","Type":"ContainerStarted","Data":"4c656483a6ef773f34121b4f9466d317bf573546abc87062f08ed9fc21145bb8"} Jun 15 08:34:11.680867 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:11.680742 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" event={"ID":"66f29f66-784d-458b-a52b-27baaaf61ce2","Type":"ContainerStarted","Data":"36bfedd07da968bca83eeed49d9d54e3eba9c30a2a2b96bc8449c68f3cf1aab9"} Jun 15 08:34:13.698358 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:13.698321 2561 generic.go:356] "Generic (PLEG): container finished" podID="66f29f66-784d-458b-a52b-27baaaf61ce2" containerID="4c656483a6ef773f34121b4f9466d317bf573546abc87062f08ed9fc21145bb8" exitCode=0 Jun 15 08:34:13.698800 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:13.698396 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" event={"ID":"66f29f66-784d-458b-a52b-27baaaf61ce2","Type":"ContainerDied","Data":"4c656483a6ef773f34121b4f9466d317bf573546abc87062f08ed9fc21145bb8"} Jun 15 08:34:14.705960 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:14.705926 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" event={"ID":"66f29f66-784d-458b-a52b-27baaaf61ce2","Type":"ContainerStarted","Data":"87300fde044193e6585fb9acccd5bda9ad233aacea48cfa80e98c1c231ca7f0a"} Jun 15 08:34:14.723681 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:14.723633 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" podStartSLOduration=2.949212884 podStartE2EDuration="4.723618172s" totalImagesPullingTime="191.635522ms" totalInitContainerRuntime="1.582769766s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:34:14.72294798 +0000 UTC m=+946.696946610" watchObservedRunningTime="2026-06-15 08:34:14.723618172 +0000 UTC m=+946.697616767" Jun 15 08:34:21.310835 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:21.310792 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:21.311257 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:21.310868 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:21.323419 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:21.323394 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:21.755564 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:21.755536 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bmm42" Jun 15 08:34:23.088734 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.088686 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt"] Jun 15 08:34:23.092427 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.092410 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.095211 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.095191 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 15 08:34:23.105335 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.105305 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt"] Jun 15 08:34:23.209231 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.209194 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc05363e-b70c-4fb3-9fa4-262593293f42-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.209405 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.209274 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc05363e-b70c-4fb3-9fa4-262593293f42-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.209405 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.209338 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc05363e-b70c-4fb3-9fa4-262593293f42-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.209405 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.209400 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc05363e-b70c-4fb3-9fa4-262593293f42-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.209522 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.209433 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cc05363e-b70c-4fb3-9fa4-262593293f42-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.209522 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.209458 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms2vm\" (UniqueName: \"kubernetes.io/projected/cc05363e-b70c-4fb3-9fa4-262593293f42-kube-api-access-ms2vm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.310461 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.310419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc05363e-b70c-4fb3-9fa4-262593293f42-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.310461 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.310460 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cc05363e-b70c-4fb3-9fa4-262593293f42-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.310679 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.310484 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms2vm\" (UniqueName: \"kubernetes.io/projected/cc05363e-b70c-4fb3-9fa4-262593293f42-kube-api-access-ms2vm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.310679 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.310537 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc05363e-b70c-4fb3-9fa4-262593293f42-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.310679 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.310612 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc05363e-b70c-4fb3-9fa4-262593293f42-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.310679 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.310652 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc05363e-b70c-4fb3-9fa4-262593293f42-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.311069 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.311036 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cc05363e-b70c-4fb3-9fa4-262593293f42-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.311196 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.311077 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc05363e-b70c-4fb3-9fa4-262593293f42-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.311196 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.311107 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc05363e-b70c-4fb3-9fa4-262593293f42-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.313030 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.313006 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc05363e-b70c-4fb3-9fa4-262593293f42-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.313277 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.313262 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc05363e-b70c-4fb3-9fa4-262593293f42-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.317960 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.317942 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms2vm\" (UniqueName: \"kubernetes.io/projected/cc05363e-b70c-4fb3-9fa4-262593293f42-kube-api-access-ms2vm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt\" (UID: \"cc05363e-b70c-4fb3-9fa4-262593293f42\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.402840 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.402753 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:23.544098 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.544067 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt"] Jun 15 08:34:23.546098 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:34:23.546068 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc05363e_b70c_4fb3_9fa4_262593293f42.slice/crio-267f21e7bcdd416c4da932a4f08e97eae81728ee1a3e52526782b2d9aeb5f8c1 WatchSource:0}: Error finding container 267f21e7bcdd416c4da932a4f08e97eae81728ee1a3e52526782b2d9aeb5f8c1: Status 404 returned error can't find the container with id 267f21e7bcdd416c4da932a4f08e97eae81728ee1a3e52526782b2d9aeb5f8c1 Jun 15 08:34:23.766038 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.765989 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" event={"ID":"cc05363e-b70c-4fb3-9fa4-262593293f42","Type":"ContainerStarted","Data":"ee5415357ae53eb49d8f57bc9d39c6219b40ef1bb49d67c7996f66a47848b4f1"} Jun 15 08:34:23.766247 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:23.766099 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" event={"ID":"cc05363e-b70c-4fb3-9fa4-262593293f42","Type":"ContainerStarted","Data":"267f21e7bcdd416c4da932a4f08e97eae81728ee1a3e52526782b2d9aeb5f8c1"} Jun 15 08:34:25.778502 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:25.778469 2561 generic.go:356] "Generic (PLEG): container finished" podID="cc05363e-b70c-4fb3-9fa4-262593293f42" containerID="ee5415357ae53eb49d8f57bc9d39c6219b40ef1bb49d67c7996f66a47848b4f1" exitCode=0 Jun 15 08:34:25.778921 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:25.778546 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" event={"ID":"cc05363e-b70c-4fb3-9fa4-262593293f42","Type":"ContainerDied","Data":"ee5415357ae53eb49d8f57bc9d39c6219b40ef1bb49d67c7996f66a47848b4f1"} Jun 15 08:34:26.784991 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:26.784957 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" event={"ID":"cc05363e-b70c-4fb3-9fa4-262593293f42","Type":"ContainerStarted","Data":"7b81ee0be3319e646674f12385106e6b8735956a450fa583350e90701c103063"} Jun 15 08:34:33.402913 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:33.402868 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:33.403332 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:33.402937 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:33.415597 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:33.415575 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:34:33.436454 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:33.436408 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" podStartSLOduration=8.911871219 podStartE2EDuration="10.436392425s" totalImagesPullingTime="182.667387ms" totalInitContainerRuntime="1.341853819s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:34:26.802371889 +0000 UTC m=+958.776370484" watchObservedRunningTime="2026-06-15 08:34:33.436392425 +0000 UTC m=+965.410391019" Jun 15 08:34:33.832907 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:34:33.832883 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt" Jun 15 08:38:28.532363 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:28.532330 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:38:28.535369 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:28.535348 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:38:28.540816 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:28.540794 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:38:28.543761 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:28.543743 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:38:47.588265 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:47.588226 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75b8b6dc77-d89tr"] Jun 15 08:38:47.588797 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:47.588462 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-75b8b6dc77-d89tr" podUID="990d1ca3-7b42-44e4-855e-6e92e617c751" containerName="manager" containerID="cri-o://4a90a473769509146d2f5b2cce79201c979e3d1d5dade353b79539091b5abadf" gracePeriod=30 Jun 15 08:38:47.846608 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:47.846528 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b8b6dc77-d89tr" Jun 15 08:38:48.003273 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.003240 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/990d1ca3-7b42-44e4-855e-6e92e617c751-webhook-cert\") pod \"990d1ca3-7b42-44e4-855e-6e92e617c751\" (UID: \"990d1ca3-7b42-44e4-855e-6e92e617c751\") " Jun 15 08:38:48.003454 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.003328 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf424\" (UniqueName: \"kubernetes.io/projected/990d1ca3-7b42-44e4-855e-6e92e617c751-kube-api-access-vf424\") pod \"990d1ca3-7b42-44e4-855e-6e92e617c751\" (UID: \"990d1ca3-7b42-44e4-855e-6e92e617c751\") " Jun 15 08:38:48.005459 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.005422 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/990d1ca3-7b42-44e4-855e-6e92e617c751-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "990d1ca3-7b42-44e4-855e-6e92e617c751" (UID: "990d1ca3-7b42-44e4-855e-6e92e617c751"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:38:48.005583 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.005535 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/990d1ca3-7b42-44e4-855e-6e92e617c751-kube-api-access-vf424" (OuterVolumeSpecName: "kube-api-access-vf424") pod "990d1ca3-7b42-44e4-855e-6e92e617c751" (UID: "990d1ca3-7b42-44e4-855e-6e92e617c751"). InnerVolumeSpecName "kube-api-access-vf424". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:38:48.105120 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.105025 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf424\" (UniqueName: \"kubernetes.io/projected/990d1ca3-7b42-44e4-855e-6e92e617c751-kube-api-access-vf424\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:38:48.105120 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.105058 2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/990d1ca3-7b42-44e4-855e-6e92e617c751-webhook-cert\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:38:48.193065 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.193032 2561 generic.go:356] "Generic (PLEG): container finished" podID="990d1ca3-7b42-44e4-855e-6e92e617c751" containerID="4a90a473769509146d2f5b2cce79201c979e3d1d5dade353b79539091b5abadf" exitCode=0 Jun 15 08:38:48.193267 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.193086 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b8b6dc77-d89tr" event={"ID":"990d1ca3-7b42-44e4-855e-6e92e617c751","Type":"ContainerDied","Data":"4a90a473769509146d2f5b2cce79201c979e3d1d5dade353b79539091b5abadf"} Jun 15 08:38:48.193267 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.193090 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b8b6dc77-d89tr" Jun 15 08:38:48.193267 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.193127 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b8b6dc77-d89tr" event={"ID":"990d1ca3-7b42-44e4-855e-6e92e617c751","Type":"ContainerDied","Data":"469a10b612674f00b2041d283873eedcf9416a6aab62bede950460fb0d67e9f9"} Jun 15 08:38:48.193267 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.193149 2561 scope.go:117] "RemoveContainer" containerID="4a90a473769509146d2f5b2cce79201c979e3d1d5dade353b79539091b5abadf" Jun 15 08:38:48.205645 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.205613 2561 scope.go:117] "RemoveContainer" containerID="4a90a473769509146d2f5b2cce79201c979e3d1d5dade353b79539091b5abadf" Jun 15 08:38:48.206159 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:38:48.206130 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a90a473769509146d2f5b2cce79201c979e3d1d5dade353b79539091b5abadf\": container with ID starting with 4a90a473769509146d2f5b2cce79201c979e3d1d5dade353b79539091b5abadf not found: ID does not exist" containerID="4a90a473769509146d2f5b2cce79201c979e3d1d5dade353b79539091b5abadf" Jun 15 08:38:48.206261 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.206171 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a90a473769509146d2f5b2cce79201c979e3d1d5dade353b79539091b5abadf"} err="failed to get container status \"4a90a473769509146d2f5b2cce79201c979e3d1d5dade353b79539091b5abadf\": rpc error: code = NotFound desc = could not find container \"4a90a473769509146d2f5b2cce79201c979e3d1d5dade353b79539091b5abadf\": container with ID starting with 4a90a473769509146d2f5b2cce79201c979e3d1d5dade353b79539091b5abadf not found: ID does not exist" Jun 15 08:38:48.216818 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.216782 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75b8b6dc77-d89tr"] Jun 15 08:38:48.220827 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.220797 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75b8b6dc77-d89tr"] Jun 15 08:38:48.458712 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:38:48.458659 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="990d1ca3-7b42-44e4-855e-6e92e617c751" path="/var/lib/kubelet/pods/990d1ca3-7b42-44e4-855e-6e92e617c751/volumes" Jun 15 08:43:28.566943 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:43:28.566831 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:43:28.571999 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:43:28.571979 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:43:28.575382 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:43:28.575366 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:43:28.580130 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:43:28.580116 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:48:28.601420 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:48:28.601308 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:48:28.611324 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:48:28.611300 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:48:28.614363 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:48:28.614344 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:48:28.620850 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:48:28.620831 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:53:28.643844 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:53:28.643741 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:53:28.653466 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:53:28.653443 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:53:28.654982 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:53:28.654963 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:53:28.663234 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:53:28.663217 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:58:28.681737 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:28.681584 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:58:28.690876 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:28.690851 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:58:28.692905 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:28.692882 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:58:28.701399 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:28.701381 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znqdf_cfa5f832-2b14-434b-823f-85bad4208214/ovn-acl-logging/0.log" Jun 15 08:58:49.373668 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.373638 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q"] Jun 15 08:58:49.374284 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.374116 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="990d1ca3-7b42-44e4-855e-6e92e617c751" containerName="manager" Jun 15 08:58:49.374284 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.374129 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="990d1ca3-7b42-44e4-855e-6e92e617c751" containerName="manager" Jun 15 08:58:49.374284 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.374216 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="990d1ca3-7b42-44e4-855e-6e92e617c751" containerName="manager" Jun 15 08:58:49.377491 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.377469 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.380004 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.379983 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-090bfa95-openshift-default-dockercfg-2b689\"" Jun 15 08:58:49.397508 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.397484 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q"] Jun 15 08:58:49.488764 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.488731 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-envoy\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.488931 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.488828 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2afb0d84-3a2a-422b-be96-a0b63684238a-istiod-ca-cert\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.488931 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.488868 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-workload-certs\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.489031 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.488939 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-credential-socket\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.489031 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.489010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-token\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.489134 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.489049 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfpwp\" (UniqueName: \"kubernetes.io/projected/2afb0d84-3a2a-422b-be96-a0b63684238a-kube-api-access-gfpwp\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.489134 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.489122 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-data\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.489242 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.489168 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-workload-socket\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.489242 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.489200 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-podinfo\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.589887 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.589846 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-credential-socket\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.589887 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.589897 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-token\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.590140 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.589918 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfpwp\" (UniqueName: \"kubernetes.io/projected/2afb0d84-3a2a-422b-be96-a0b63684238a-kube-api-access-gfpwp\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.590140 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.589974 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-data\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.590140 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.590017 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-workload-socket\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.590140 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.590054 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-podinfo\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.590140 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.590088 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-envoy\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.590401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.590174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2afb0d84-3a2a-422b-be96-a0b63684238a-istiod-ca-cert\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.590401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.590217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-workload-certs\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.590401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.590306 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-credential-socket\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.590401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.590372 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-data\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.590401 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.590396 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-workload-socket\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.590675 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.590557 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-workload-certs\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.590906 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.590885 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2afb0d84-3a2a-422b-be96-a0b63684238a-istiod-ca-cert\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.592510 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.592484 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-envoy\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.592744 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.592726 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-podinfo\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.607470 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.607449 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-token\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.607816 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.607799 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfpwp\" (UniqueName: \"kubernetes.io/projected/2afb0d84-3a2a-422b-be96-a0b63684238a-kube-api-access-gfpwp\") pod \"e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.691393 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.691316 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:49.840497 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.840471 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q"] Jun 15 08:58:49.841561 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:58:49.841536 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2afb0d84_3a2a_422b_be96_a0b63684238a.slice/crio-a7d4ed5eda2c6809ba1201a78e7d35238394f023437dc47e4835f128b2a0a35e WatchSource:0}: Error finding container a7d4ed5eda2c6809ba1201a78e7d35238394f023437dc47e4835f128b2a0a35e: Status 404 returned error can't find the container with id a7d4ed5eda2c6809ba1201a78e7d35238394f023437dc47e4835f128b2a0a35e Jun 15 08:58:49.843612 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.843579 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 15 08:58:49.843670 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.843642 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 15 08:58:49.843731 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:49.843673 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 15 08:58:50.554991 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:50.554958 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" event={"ID":"2afb0d84-3a2a-422b-be96-a0b63684238a","Type":"ContainerStarted","Data":"547f469d5733184870e8f18aa31958f1fc6d857fa488d288d703a96d7580077e"} Jun 15 08:58:50.555421 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:50.555008 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" event={"ID":"2afb0d84-3a2a-422b-be96-a0b63684238a","Type":"ContainerStarted","Data":"a7d4ed5eda2c6809ba1201a78e7d35238394f023437dc47e4835f128b2a0a35e"} Jun 15 08:58:50.581413 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:50.581355 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" podStartSLOduration=1.581340361 podStartE2EDuration="1.581340361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:58:50.580174776 +0000 UTC m=+2422.554173373" watchObservedRunningTime="2026-06-15 08:58:50.581340361 +0000 UTC m=+2422.555338955" Jun 15 08:58:50.691822 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:50.691670 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:50.703104 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:50.703079 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:51.560982 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:51.560953 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:51.561941 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:51.561925 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:58:56.871594 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:56.871554 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q"] Jun 15 08:58:56.872113 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:58:56.871751 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" podUID="2afb0d84-3a2a-422b-be96-a0b63684238a" containerName="istio-proxy" containerID="cri-o://547f469d5733184870e8f18aa31958f1fc6d857fa488d288d703a96d7580077e" gracePeriod=30 Jun 15 08:59:02.124037 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.124013 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:59:02.211817 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.211791 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-workload-socket\") pod \"2afb0d84-3a2a-422b-be96-a0b63684238a\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " Jun 15 08:59:02.211972 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.211869 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-token\") pod \"2afb0d84-3a2a-422b-be96-a0b63684238a\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " Jun 15 08:59:02.211972 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.211896 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-envoy\") pod \"2afb0d84-3a2a-422b-be96-a0b63684238a\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " Jun 15 08:59:02.211972 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.211920 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2afb0d84-3a2a-422b-be96-a0b63684238a-istiod-ca-cert\") pod \"2afb0d84-3a2a-422b-be96-a0b63684238a\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " Jun 15 08:59:02.212130 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.211985 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-workload-certs\") pod \"2afb0d84-3a2a-422b-be96-a0b63684238a\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " Jun 15 08:59:02.212130 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.212010 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-data\") pod \"2afb0d84-3a2a-422b-be96-a0b63684238a\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " Jun 15 08:59:02.212130 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.212078 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2afb0d84-3a2a-422b-be96-a0b63684238a" (UID: "2afb0d84-3a2a-422b-be96-a0b63684238a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:59:02.212130 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.212114 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-podinfo\") pod \"2afb0d84-3a2a-422b-be96-a0b63684238a\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " Jun 15 08:59:02.212327 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.212183 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-credential-socket\") pod \"2afb0d84-3a2a-422b-be96-a0b63684238a\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " Jun 15 08:59:02.212327 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.212215 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfpwp\" (UniqueName: \"kubernetes.io/projected/2afb0d84-3a2a-422b-be96-a0b63684238a-kube-api-access-gfpwp\") pod \"2afb0d84-3a2a-422b-be96-a0b63684238a\" (UID: \"2afb0d84-3a2a-422b-be96-a0b63684238a\") " Jun 15 08:59:02.212327 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.212298 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2afb0d84-3a2a-422b-be96-a0b63684238a" (UID: "2afb0d84-3a2a-422b-be96-a0b63684238a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:59:02.212327 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.212309 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-data" (OuterVolumeSpecName: "istio-data") pod "2afb0d84-3a2a-422b-be96-a0b63684238a" (UID: "2afb0d84-3a2a-422b-be96-a0b63684238a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:59:02.212530 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.212402 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2afb0d84-3a2a-422b-be96-a0b63684238a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2afb0d84-3a2a-422b-be96-a0b63684238a" (UID: "2afb0d84-3a2a-422b-be96-a0b63684238a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:59:02.212591 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.212533 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2afb0d84-3a2a-422b-be96-a0b63684238a" (UID: "2afb0d84-3a2a-422b-be96-a0b63684238a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:59:02.212851 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.212655 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2afb0d84-3a2a-422b-be96-a0b63684238a-istiod-ca-cert\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:59:02.212851 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.212676 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-workload-certs\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:59:02.212962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.212850 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-data\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:59:02.212962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.212897 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-credential-socket\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:59:02.212962 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.212911 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-workload-socket\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:59:02.214553 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.214529 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2afb0d84-3a2a-422b-be96-a0b63684238a" (UID: "2afb0d84-3a2a-422b-be96-a0b63684238a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 08:59:02.214553 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.214535 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2afb0d84-3a2a-422b-be96-a0b63684238a-kube-api-access-gfpwp" (OuterVolumeSpecName: "kube-api-access-gfpwp") pod "2afb0d84-3a2a-422b-be96-a0b63684238a" (UID: "2afb0d84-3a2a-422b-be96-a0b63684238a"). InnerVolumeSpecName "kube-api-access-gfpwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:59:02.214553 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.214545 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2afb0d84-3a2a-422b-be96-a0b63684238a" (UID: "2afb0d84-3a2a-422b-be96-a0b63684238a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 15 08:59:02.214750 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.214551 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-token" (OuterVolumeSpecName: "istio-token") pod "2afb0d84-3a2a-422b-be96-a0b63684238a" (UID: "2afb0d84-3a2a-422b-be96-a0b63684238a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:59:02.314152 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.314124 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfpwp\" (UniqueName: \"kubernetes.io/projected/2afb0d84-3a2a-422b-be96-a0b63684238a-kube-api-access-gfpwp\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:59:02.314152 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.314148 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-token\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:59:02.314330 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.314159 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-envoy\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:59:02.314330 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.314167 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2afb0d84-3a2a-422b-be96-a0b63684238a-istio-podinfo\") on node \"ip-10-0-136-100.ec2.internal\" DevicePath \"\"" Jun 15 08:59:02.617452 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.617417 2561 generic.go:356] "Generic (PLEG): container finished" podID="2afb0d84-3a2a-422b-be96-a0b63684238a" containerID="547f469d5733184870e8f18aa31958f1fc6d857fa488d288d703a96d7580077e" exitCode=0 Jun 15 08:59:02.617620 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.617458 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" event={"ID":"2afb0d84-3a2a-422b-be96-a0b63684238a","Type":"ContainerDied","Data":"547f469d5733184870e8f18aa31958f1fc6d857fa488d288d703a96d7580077e"} Jun 15 08:59:02.617620 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.617476 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" Jun 15 08:59:02.617620 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.617498 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q" event={"ID":"2afb0d84-3a2a-422b-be96-a0b63684238a","Type":"ContainerDied","Data":"a7d4ed5eda2c6809ba1201a78e7d35238394f023437dc47e4835f128b2a0a35e"} Jun 15 08:59:02.617620 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.617520 2561 scope.go:117] "RemoveContainer" containerID="547f469d5733184870e8f18aa31958f1fc6d857fa488d288d703a96d7580077e" Jun 15 08:59:02.626464 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.626445 2561 scope.go:117] "RemoveContainer" containerID="547f469d5733184870e8f18aa31958f1fc6d857fa488d288d703a96d7580077e" Jun 15 08:59:02.626733 ip-10-0-136-100 kubenswrapper[2561]: E0615 08:59:02.626704 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"547f469d5733184870e8f18aa31958f1fc6d857fa488d288d703a96d7580077e\": container with ID starting with 547f469d5733184870e8f18aa31958f1fc6d857fa488d288d703a96d7580077e not found: ID does not exist" containerID="547f469d5733184870e8f18aa31958f1fc6d857fa488d288d703a96d7580077e" Jun 15 08:59:02.626805 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.626740 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547f469d5733184870e8f18aa31958f1fc6d857fa488d288d703a96d7580077e"} err="failed to get container status \"547f469d5733184870e8f18aa31958f1fc6d857fa488d288d703a96d7580077e\": rpc error: code = NotFound desc = could not find container \"547f469d5733184870e8f18aa31958f1fc6d857fa488d288d703a96d7580077e\": container with ID starting with 547f469d5733184870e8f18aa31958f1fc6d857fa488d288d703a96d7580077e not found: ID does not exist" Jun 15 08:59:02.636895 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.636867 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q"] Jun 15 08:59:02.638863 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:02.638841 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-090bfa95-openshift-default-85ffb8ccb6-tc78q"] Jun 15 08:59:04.459178 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:04.459148 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2afb0d84-3a2a-422b-be96-a0b63684238a" path="/var/lib/kubelet/pods/2afb0d84-3a2a-422b-be96-a0b63684238a/volumes" Jun 15 08:59:15.599890 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:15.599861 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5477d47596-tjmjj_f05ae4cd-46c2-4626-b67b-fb8df1d12ae2/nginx/0.log" Jun 15 08:59:15.972867 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:15.972838 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-697554dff8-cdfbn_7bb53651-e475-49a0-ab82-677b0d81bed2/maas-api/0.log" Jun 15 08:59:16.563372 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:16.563346 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6996b7d859-28tfp_0cc8ec7b-806c-4014-ac61-b47a35c68f83/copy-manifests/0.log" Jun 15 08:59:16.571314 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:16.571289 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6996b7d859-28tfp_0cc8ec7b-806c-4014-ac61-b47a35c68f83/manager/0.log" Jun 15 08:59:16.937188 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:16.937103 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-rnmmg_a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86/postgres/0.log" Jun 15 08:59:18.393459 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:18.393418 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9lxzd_73ab13c2-f953-410f-b1e3-36ad342a38d1/manager/0.log" Jun 15 08:59:18.511151 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:18.511114 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-j8q9n_85559a85-6f78-4c83-8d96-028fbf0aac40/manager/0.log" Jun 15 08:59:18.744617 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:18.744588 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rssqp_297af14c-4d83-4799-8d16-40fdd3a89a6a/registry-server/0.log" Jun 15 08:59:19.169604 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:19.169528 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mj5qm_e5d3f70b-6645-48a4-9dd8-af6f5e502463/manager/0.log" Jun 15 08:59:19.526320 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:19.526280 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcgbpqs_a61e7f67-1080-4510-a1f2-1736fcbc3084/istio-proxy/0.log" Jun 15 08:59:20.007365 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:20.007336 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5bbfw_61ba32d4-0f86-42a6-ae3a-3f968ebd4126/istio-proxy/1.log" Jun 15 08:59:20.134729 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:20.134686 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s77kc_ae766e8b-beb5-466b-8c2f-2f9373a7bae5/payload-pre-processing/0.log" Jun 15 08:59:20.271614 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:20.271538 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8b5mb_ab1b1699-6cea-4c1f-ad81-9fde79390542/payload-processing/0.log" Jun 15 08:59:20.756836 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:20.756804 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k_916a45e7-40dd-4e5c-9b45-ddd752fb59e8/storage-initializer/0.log" Jun 15 08:59:20.765156 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:20.765124 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-qn62k_916a45e7-40dd-4e5c-9b45-ddd752fb59e8/main/0.log" Jun 15 08:59:20.881175 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:20.881153 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-bmm42_66f29f66-784d-458b-a52b-27baaaf61ce2/storage-initializer/0.log" Jun 15 08:59:20.891260 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:20.891238 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-bmm42_66f29f66-784d-458b-a52b-27baaaf61ce2/main/0.log" Jun 15 08:59:21.006479 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:21.006457 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt_cc05363e-b70c-4fb3-9fa4-262593293f42/storage-initializer/0.log" Jun 15 08:59:21.016805 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:21.016740 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-vcqdt_cc05363e-b70c-4fb3-9fa4-262593293f42/main/0.log" Jun 15 08:59:28.669680 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:28.669644 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4kzkb_a8e06716-3cd4-48af-95ba-b8ef131b8cbd/global-pull-secret-syncer/0.log" Jun 15 08:59:28.986032 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:28.986004 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jwlm6_45807f4c-3dcb-40ff-9897-e46c5d48fd15/konnectivity-agent/0.log" Jun 15 08:59:29.068055 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:29.068034 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-100.ec2.internal_961c229fb2596d0f0806043e4f238851/haproxy/0.log" Jun 15 08:59:33.484481 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:33.484450 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9lxzd_73ab13c2-f953-410f-b1e3-36ad342a38d1/manager/0.log" Jun 15 08:59:33.511408 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:33.511384 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-j8q9n_85559a85-6f78-4c83-8d96-028fbf0aac40/manager/0.log" Jun 15 08:59:33.581713 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:33.581670 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rssqp_297af14c-4d83-4799-8d16-40fdd3a89a6a/registry-server/0.log" Jun 15 08:59:33.796331 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:33.796251 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mj5qm_e5d3f70b-6645-48a4-9dd8-af6f5e502463/manager/0.log" Jun 15 08:59:35.670892 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:35.670862 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-b6h2z_13e56429-0be8-4d84-8f41-dac0aa356f6e/cluster-monitoring-operator/0.log" Jun 15 08:59:36.082948 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:36.082915 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9th7_9bddb12b-a865-475b-a532-9a338f05fd7a/node-exporter/0.log" Jun 15 08:59:36.126899 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:36.126828 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9th7_9bddb12b-a865-475b-a532-9a338f05fd7a/kube-rbac-proxy/0.log" Jun 15 08:59:36.167525 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:36.167500 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9th7_9bddb12b-a865-475b-a532-9a338f05fd7a/init-textfile/0.log" Jun 15 08:59:36.406633 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:36.406559 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26454ad9-469c-401b-9af2-2f6097e13f49/prometheus/0.log" Jun 15 08:59:36.442436 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:36.442417 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26454ad9-469c-401b-9af2-2f6097e13f49/config-reloader/0.log" Jun 15 08:59:36.507836 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:36.507804 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26454ad9-469c-401b-9af2-2f6097e13f49/thanos-sidecar/0.log" Jun 15 08:59:36.572159 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:36.572133 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26454ad9-469c-401b-9af2-2f6097e13f49/kube-rbac-proxy-web/0.log" Jun 15 08:59:36.636157 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:36.636124 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26454ad9-469c-401b-9af2-2f6097e13f49/kube-rbac-proxy/0.log" Jun 15 08:59:36.758985 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:36.758959 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26454ad9-469c-401b-9af2-2f6097e13f49/kube-rbac-proxy-thanos/0.log" Jun 15 08:59:36.824870 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:36.824832 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26454ad9-469c-401b-9af2-2f6097e13f49/init-config-reloader/0.log" Jun 15 08:59:36.900003 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:36.899962 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-nqqhj_a953eaea-9b77-4055-bbd8-c9391eeb65f6/prometheus-operator/0.log" Jun 15 08:59:36.946877 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:36.946846 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-nqqhj_a953eaea-9b77-4055-bbd8-c9391eeb65f6/kube-rbac-proxy/0.log" Jun 15 08:59:37.000472 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:37.000400 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-97p8c_4908d13e-e52a-42b7-a4bd-07e3505d268e/prometheus-operator-admission-webhook/0.log" Jun 15 08:59:37.041905 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:37.041882 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9b7d69696-s6pbc_ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02/telemeter-client/0.log" Jun 15 08:59:37.091359 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:37.091341 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9b7d69696-s6pbc_ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02/reload/0.log" Jun 15 08:59:37.149453 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:37.149406 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9b7d69696-s6pbc_ee51c0ed-2ca3-4f89-9fb4-b28ad8017e02/kube-rbac-proxy/0.log" Jun 15 08:59:37.219079 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:37.219048 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c75766b75-bcltf_d4c91bf9-75f8-453c-bb3f-a33bc3065f9b/thanos-query/0.log" Jun 15 08:59:37.266464 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:37.266385 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c75766b75-bcltf_d4c91bf9-75f8-453c-bb3f-a33bc3065f9b/kube-rbac-proxy-web/0.log" Jun 15 08:59:37.296824 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:37.296793 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c75766b75-bcltf_d4c91bf9-75f8-453c-bb3f-a33bc3065f9b/kube-rbac-proxy/0.log" Jun 15 08:59:37.329793 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:37.329768 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c75766b75-bcltf_d4c91bf9-75f8-453c-bb3f-a33bc3065f9b/prom-label-proxy/0.log" Jun 15 08:59:37.370713 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:37.370675 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c75766b75-bcltf_d4c91bf9-75f8-453c-bb3f-a33bc3065f9b/kube-rbac-proxy-rules/0.log" Jun 15 08:59:37.404202 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:37.404179 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c75766b75-bcltf_d4c91bf9-75f8-453c-bb3f-a33bc3065f9b/kube-rbac-proxy-metrics/0.log" Jun 15 08:59:38.695470 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:38.695434 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-bclhg_419fdc27-dbf4-4056-9ca9-f30c4d1cc9f2/networking-console-plugin/0.log" Jun 15 08:59:39.462060 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.462032 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/1.log" Jun 15 08:59:39.471476 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.471453 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9jvjp_cff1c23d-f9fa-48d0-829b-e30fc73b579c/console-operator/2.log" Jun 15 08:59:39.896358 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.896275 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms"] Jun 15 08:59:39.896756 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.896740 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2afb0d84-3a2a-422b-be96-a0b63684238a" containerName="istio-proxy" Jun 15 08:59:39.896756 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.896753 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2afb0d84-3a2a-422b-be96-a0b63684238a" containerName="istio-proxy" Jun 15 08:59:39.896845 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.896840 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2afb0d84-3a2a-422b-be96-a0b63684238a" containerName="istio-proxy" Jun 15 08:59:39.900439 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.900419 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:39.902771 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.902748 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88cvp\"/\"kube-root-ca.crt\"" Jun 15 08:59:39.903586 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.903566 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-88cvp\"/\"default-dockercfg-4qtf6\"" Jun 15 08:59:39.903649 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.903587 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88cvp\"/\"openshift-service-ca.crt\"" Jun 15 08:59:39.911216 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.911194 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms"] Jun 15 08:59:39.948713 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.948666 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b52d\" (UniqueName: \"kubernetes.io/projected/2800b4d0-c986-4251-8dce-3a20bc8c4159-kube-api-access-5b52d\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:39.948831 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.948776 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2800b4d0-c986-4251-8dce-3a20bc8c4159-podres\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:39.948831 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.948795 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2800b4d0-c986-4251-8dce-3a20bc8c4159-proc\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:39.948831 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.948822 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2800b4d0-c986-4251-8dce-3a20bc8c4159-sys\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:39.948949 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:39.948855 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2800b4d0-c986-4251-8dce-3a20bc8c4159-lib-modules\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:40.049638 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.049603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b52d\" (UniqueName: \"kubernetes.io/projected/2800b4d0-c986-4251-8dce-3a20bc8c4159-kube-api-access-5b52d\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:40.049821 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.049675 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2800b4d0-c986-4251-8dce-3a20bc8c4159-podres\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:40.049821 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.049743 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2800b4d0-c986-4251-8dce-3a20bc8c4159-proc\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:40.049821 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.049781 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2800b4d0-c986-4251-8dce-3a20bc8c4159-sys\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:40.049990 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.049822 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2800b4d0-c986-4251-8dce-3a20bc8c4159-lib-modules\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:40.049990 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.049841 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2800b4d0-c986-4251-8dce-3a20bc8c4159-podres\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:40.049990 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.049876 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2800b4d0-c986-4251-8dce-3a20bc8c4159-proc\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:40.049990 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.049885 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2800b4d0-c986-4251-8dce-3a20bc8c4159-sys\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:40.049990 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.049965 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2800b4d0-c986-4251-8dce-3a20bc8c4159-lib-modules\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:40.058872 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.058851 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b52d\" (UniqueName: \"kubernetes.io/projected/2800b4d0-c986-4251-8dce-3a20bc8c4159-kube-api-access-5b52d\") pod \"perf-node-gather-daemonset-qgkms\" (UID: \"2800b4d0-c986-4251-8dce-3a20bc8c4159\") " pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:40.061558 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.061538 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f9c674876-66pl9_5307a0e3-c4de-4b49-8f57-52bf37b3a4bc/console/0.log" Jun 15 08:59:40.210630 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.210603 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:40.350674 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.350642 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms"] Jun 15 08:59:40.355013 ip-10-0-136-100 kubenswrapper[2561]: W0615 08:59:40.354978 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2800b4d0_c986_4251_8dce_3a20bc8c4159.slice/crio-df0a7d6142ac7918686c737d7a5c5555531b553dfbaea1bdb89d6e3e5b10ce78 WatchSource:0}: Error finding container df0a7d6142ac7918686c737d7a5c5555531b553dfbaea1bdb89d6e3e5b10ce78: Status 404 returned error can't find the container with id df0a7d6142ac7918686c737d7a5c5555531b553dfbaea1bdb89d6e3e5b10ce78 Jun 15 08:59:40.820502 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.820412 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" event={"ID":"2800b4d0-c986-4251-8dce-3a20bc8c4159","Type":"ContainerStarted","Data":"24e9b9055f8afb613908382eae395f80946c41d589bf7ce7a5eef576fd864a44"} Jun 15 08:59:40.820502 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.820462 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" event={"ID":"2800b4d0-c986-4251-8dce-3a20bc8c4159","Type":"ContainerStarted","Data":"df0a7d6142ac7918686c737d7a5c5555531b553dfbaea1bdb89d6e3e5b10ce78"} Jun 15 08:59:40.820776 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.820581 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:40.821226 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.821202 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-qbqq9_45bdbf70-bffe-4d88-8d13-d8d8ab39aced/volume-data-source-validator/0.log" Jun 15 08:59:40.836990 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:40.836946 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" podStartSLOduration=1.836933037 podStartE2EDuration="1.836933037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:59:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:59:40.836322564 +0000 UTC m=+2472.810321160" watchObservedRunningTime="2026-06-15 08:59:40.836933037 +0000 UTC m=+2472.810931631" Jun 15 08:59:41.937000 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:41.936974 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g586f_dfd67d73-cda0-4c6e-bbd3-7127f2bcef94/dns/0.log" Jun 15 08:59:41.960221 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:41.960197 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g586f_dfd67d73-cda0-4c6e-bbd3-7127f2bcef94/kube-rbac-proxy/0.log" Jun 15 08:59:42.053624 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:42.053592 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mqbqb_4b02eb3e-079d-49a6-9a82-d5b195cde884/dns-node-resolver/0.log" Jun 15 08:59:42.673201 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:42.673162 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h6rmt_eadd1131-282b-4043-9010-55772e805b18/node-ca/0.log" Jun 15 08:59:43.640348 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:43.640316 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcgbpqs_a61e7f67-1080-4510-a1f2-1736fcbc3084/istio-proxy/0.log" Jun 15 08:59:43.862589 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:43.862555 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5bbfw_61ba32d4-0f86-42a6-ae3a-3f968ebd4126/istio-proxy/0.log" Jun 15 08:59:43.923402 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:43.923334 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5bbfw_61ba32d4-0f86-42a6-ae3a-3f968ebd4126/istio-proxy/1.log" Jun 15 08:59:43.966490 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:43.966462 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s77kc_ae766e8b-beb5-466b-8c2f-2f9373a7bae5/payload-pre-processing/0.log" Jun 15 08:59:44.059428 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:44.059386 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8b5mb_ab1b1699-6cea-4c1f-ad81-9fde79390542/payload-processing/0.log" Jun 15 08:59:44.746818 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:44.746786 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7r556_b021cbb3-0e41-4dbf-96d2-5e0302c69db6/serve-healthcheck-canary/0.log" Jun 15 08:59:45.300267 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:45.300235 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-zw5mc_392eda8d-2202-40ef-a382-fb2afe22a5a4/insights-operator/1.log" Jun 15 08:59:45.300923 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:45.300895 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-zw5mc_392eda8d-2202-40ef-a382-fb2afe22a5a4/insights-operator/0.log" Jun 15 08:59:45.398031 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:45.398007 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pq9b7_48c51f83-a382-464c-a8fb-4c3ab02c8358/kube-rbac-proxy/0.log" Jun 15 08:59:45.418879 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:45.418851 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pq9b7_48c51f83-a382-464c-a8fb-4c3ab02c8358/exporter/0.log" Jun 15 08:59:45.439793 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:45.439770 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pq9b7_48c51f83-a382-464c-a8fb-4c3ab02c8358/extractor/0.log" Jun 15 08:59:46.836430 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:46.836363 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-88cvp/perf-node-gather-daemonset-qgkms" Jun 15 08:59:47.952028 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:47.952001 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5477d47596-tjmjj_f05ae4cd-46c2-4626-b67b-fb8df1d12ae2/nginx/0.log" Jun 15 08:59:48.150853 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:48.150810 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-697554dff8-cdfbn_7bb53651-e475-49a0-ab82-677b0d81bed2/maas-api/0.log" Jun 15 08:59:48.418927 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:48.418894 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6996b7d859-28tfp_0cc8ec7b-806c-4014-ac61-b47a35c68f83/manager/0.log" Jun 15 08:59:48.440753 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:48.440727 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6996b7d859-28tfp_0cc8ec7b-806c-4014-ac61-b47a35c68f83/copy-manifests/0.log" Jun 15 08:59:48.696039 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:48.696011 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-rnmmg_a9cdfb82-93e7-4a2f-a0b6-bb7a9d3afc86/postgres/0.log" Jun 15 08:59:50.319012 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:50.318932 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6bd5868f66-wbm9w_79a14df2-b268-4a5a-af2c-745afa53ac83/manager/0.log" Jun 15 08:59:53.635709 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:53.635666 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcgbpqs_a61e7f67-1080-4510-a1f2-1736fcbc3084/istio-proxy/0.log" Jun 15 08:59:53.782177 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:53.782141 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5bbfw_61ba32d4-0f86-42a6-ae3a-3f968ebd4126/istio-proxy/0.log" Jun 15 08:59:53.844626 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:53.844597 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5bbfw_61ba32d4-0f86-42a6-ae3a-3f968ebd4126/istio-proxy/1.log" Jun 15 08:59:53.872031 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:53.872000 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s77kc_ae766e8b-beb5-466b-8c2f-2f9373a7bae5/payload-pre-processing/0.log" Jun 15 08:59:53.958222 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:53.958192 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8b5mb_ab1b1699-6cea-4c1f-ad81-9fde79390542/payload-processing/0.log" Jun 15 08:59:55.078234 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:55.078206 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcgbpqs_a61e7f67-1080-4510-a1f2-1736fcbc3084/istio-proxy/0.log" Jun 15 08:59:55.264537 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:55.264503 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5bbfw_61ba32d4-0f86-42a6-ae3a-3f968ebd4126/istio-proxy/0.log" Jun 15 08:59:55.325094 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:55.325058 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5bbfw_61ba32d4-0f86-42a6-ae3a-3f968ebd4126/istio-proxy/1.log" Jun 15 08:59:55.352644 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:55.352580 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s77kc_ae766e8b-beb5-466b-8c2f-2f9373a7bae5/payload-pre-processing/0.log" Jun 15 08:59:55.413493 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:55.413465 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-nqhcr_d7388284-a705-43c9-a672-304e4931624b/migrator/0.log" Jun 15 08:59:55.435852 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:55.435826 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-nqhcr_d7388284-a705-43c9-a672-304e4931624b/graceful-termination/0.log" Jun 15 08:59:55.442662 ip-10-0-136-100 kubenswrapper[2561]: I0615 08:59:55.442643 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8b5mb_ab1b1699-6cea-4c1f-ad81-9fde79390542/payload-processing/0.log"