Jun 02 15:09:19.584875 ip-10-0-136-77 systemd[1]: Starting Kubernetes Kubelet... Jun 02 15:09:19.964973 ip-10-0-136-77 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:09:19.964973 ip-10-0-136-77 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 15:09:19.964973 ip-10-0-136-77 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:09:19.964973 ip-10-0-136-77 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 15:09:19.964973 ip-10-0-136-77 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:09:19.966224 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.966132 2565 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 15:09:19.968946 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968927 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:09:19.968946 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968946 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968949 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968952 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968955 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968958 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968960 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968963 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968967 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968969 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968972 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968975 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968977 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968980 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968982 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968986 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968988 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968991 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968994 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968997 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.968999 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:09:19.969019 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969002 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969004 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969007 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969010 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969013 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969015 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969018 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969020 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969024 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969027 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969029 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969032 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969035 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969037 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969039 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969042 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969046 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969050 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969052 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:09:19.969499 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969055 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969057 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969061 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969065 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969067 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969070 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969073 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969075 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969078 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969080 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969083 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969085 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969088 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969091 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969093 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969096 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969099 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969102 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969105 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969107 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:09:19.970009 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969110 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969112 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969114 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969117 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969120 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969122 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969125 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969127 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969129 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969132 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969135 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969138 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969140 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969142 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969145 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969148 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969153 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969156 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969158 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969161 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:09:19.970497 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969163 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969166 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969168 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969170 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969173 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969175 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969566 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969586 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969589 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969597 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969600 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969603 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969605 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969608 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969610 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969613 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969616 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969618 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969621 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969624 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:09:19.970993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969626 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969629 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969632 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969635 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969637 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969640 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969642 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969645 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969647 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969649 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969652 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969654 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969656 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969659 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969661 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969664 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969667 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969670 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969672 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969676 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:09:19.971481 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969678 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969682 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969685 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969687 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969690 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969694 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969697 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969700 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969703 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969706 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969708 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969711 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969714 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969717 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969719 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969722 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969725 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969727 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969730 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:09:19.971990 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969732 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969735 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969738 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969740 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969743 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969745 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969747 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969750 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969753 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969756 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969758 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969760 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969763 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969766 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969770 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969772 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969775 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969777 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969780 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969782 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:09:19.972447 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969784 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969787 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969789 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969791 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969794 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969796 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969798 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969801 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969803 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969808 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969810 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969813 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.969815 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970477 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970491 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970499 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970504 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970508 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970512 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970516 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970520 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 15:09:19.972961 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970524 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970526 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970530 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970534 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970537 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970542 2565 flags.go:64] FLAG: --cgroup-root="" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970546 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970550 2565 flags.go:64] FLAG: --client-ca-file="" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970553 2565 flags.go:64] FLAG: --cloud-config="" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970555 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970558 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970563 2565 flags.go:64] FLAG: --cluster-domain="" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970583 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970589 2565 flags.go:64] FLAG: --config-dir="" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970594 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970598 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970602 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970605 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970608 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970611 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970614 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970618 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970622 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970625 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970628 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 15:09:19.973482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970633 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970635 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970638 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970641 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970644 2565 flags.go:64] FLAG: --enable-server="true" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970647 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970652 2565 flags.go:64] FLAG: --event-burst="100" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970655 2565 flags.go:64] FLAG: --event-qps="50" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970658 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970661 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970664 2565 flags.go:64] FLAG: --eviction-hard="" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970668 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970672 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970676 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970679 2565 flags.go:64] FLAG: --eviction-soft="" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970682 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970684 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970687 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970690 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970693 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970696 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970699 2565 flags.go:64] FLAG: --feature-gates="" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970708 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970711 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970714 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 15:09:19.974096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970718 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970721 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970724 2565 flags.go:64] FLAG: --help="false" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970727 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-136-77.ec2.internal" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970730 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970734 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970737 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970740 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970743 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970746 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970749 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970752 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970755 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970758 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970761 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970764 2565 flags.go:64] FLAG: --kube-reserved="" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970767 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970771 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970774 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970778 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970781 2565 flags.go:64] FLAG: --lock-file="" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970784 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970787 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970790 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 15:09:19.974710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970795 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970798 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970801 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970804 2565 flags.go:64] FLAG: --logging-format="text" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970807 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970810 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970813 2565 flags.go:64] FLAG: --manifest-url="" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970816 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970821 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970824 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970828 2565 flags.go:64] FLAG: --max-pods="110" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970831 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970834 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970838 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970841 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970844 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970847 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970850 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970858 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970861 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970864 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970867 2565 flags.go:64] FLAG: --pod-cidr="" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970870 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 15:09:19.975304 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970876 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970879 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970883 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970886 2565 flags.go:64] FLAG: --port="10250" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970889 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970893 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-049f95eb269aa5c29" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970897 2565 flags.go:64] FLAG: --qos-reserved="" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970900 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970903 2565 flags.go:64] FLAG: --register-node="true" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970905 2565 flags.go:64] FLAG: --register-schedulable="true" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970908 2565 flags.go:64] FLAG: --register-with-taints="" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970912 2565 flags.go:64] FLAG: --registry-burst="10" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970915 2565 flags.go:64] FLAG: --registry-qps="5" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970917 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970920 2565 flags.go:64] FLAG: --reserved-memory="" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970924 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970927 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970930 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970933 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970935 2565 flags.go:64] FLAG: --runonce="false" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970938 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970941 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970944 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970947 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970950 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970953 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 15:09:19.975874 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970956 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970959 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970962 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970965 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970968 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970970 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970973 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970976 2565 flags.go:64] FLAG: --system-cgroups="" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970980 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970985 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970988 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970992 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.970997 2565 flags.go:64] FLAG: --tls-min-version="" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.971000 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.971003 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.971006 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.971009 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.971012 2565 flags.go:64] FLAG: --v="2" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.971017 2565 flags.go:64] FLAG: --version="false" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.971021 2565 flags.go:64] FLAG: --vmodule="" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.971025 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.971028 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971128 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971132 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:09:19.976519 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971135 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971138 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971140 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971144 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971146 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971149 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971152 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971155 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971157 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971160 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971163 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971166 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971168 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971170 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971173 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971176 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971179 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971181 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971184 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971187 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:09:19.977126 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971190 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971193 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971195 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971198 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971200 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971202 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971205 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971208 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971210 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971213 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971215 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971218 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971220 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971223 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971225 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971227 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971230 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971232 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971235 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971238 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:09:19.977662 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971240 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971243 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971245 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971248 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971250 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971253 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971255 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971257 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971260 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971263 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971265 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971268 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971271 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971273 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971276 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971278 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971281 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971283 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971286 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971288 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:09:19.978246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971291 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971293 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971296 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971298 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971302 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971306 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971309 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971312 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971315 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971317 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971320 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971322 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971326 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971329 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971333 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971335 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971338 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971340 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971342 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:09:19.979185 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971345 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:09:19.980003 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971348 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:09:19.980003 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971350 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:09:19.980003 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971353 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:09:19.980003 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.971355 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:09:19.980003 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.972015 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:09:19.980228 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.980080 2565 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 15:09:19.980228 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.980102 2565 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 15:09:19.980228 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980178 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:09:19.980228 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980189 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:09:19.980228 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980194 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:09:19.980228 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980199 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:09:19.980228 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980204 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:09:19.980228 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980209 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:09:19.980228 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980213 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:09:19.980228 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980217 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:09:19.980228 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980222 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:09:19.980228 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980226 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:09:19.980228 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980230 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:09:19.980228 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980235 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980239 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980243 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980247 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980251 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980256 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980262 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980267 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980272 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980278 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980285 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980290 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980294 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980299 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980304 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980309 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980314 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980318 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980323 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:09:19.980877 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980327 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980332 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980336 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980340 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980345 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980350 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980354 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980358 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980363 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980367 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980372 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980376 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980380 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980384 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980388 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980393 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980398 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980402 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980408 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:09:19.981541 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980414 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980419 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980423 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980427 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980432 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980436 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980440 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980444 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980448 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980452 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980457 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980461 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980465 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980469 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980474 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980478 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980482 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980486 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980490 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980494 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:09:19.982109 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980499 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980503 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980508 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980511 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980515 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980520 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980524 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980528 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980533 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980538 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980542 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980546 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980550 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980554 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980559 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980564 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:09:19.982788 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980586 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.980596 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980757 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980765 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980769 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980774 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980778 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980782 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980786 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980791 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980795 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980799 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980803 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980807 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980812 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:09:19.983431 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980816 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980820 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980825 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980830 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980834 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980838 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980843 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980847 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980851 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980863 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980868 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980873 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980877 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980881 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980885 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980889 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980895 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980900 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980904 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980908 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:09:19.984044 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980912 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980915 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980920 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980924 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980928 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980932 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980936 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980940 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980944 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980948 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980952 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980956 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980960 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980964 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980969 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980973 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980977 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980981 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980985 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980989 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:09:19.984642 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980993 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.980999 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981004 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981009 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981013 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981017 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981021 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981025 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981028 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981033 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981038 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981042 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981046 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981050 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981055 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981059 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981063 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981067 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981070 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:09:19.985208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981077 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981083 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981088 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981093 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981097 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981101 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981107 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981111 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981115 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981119 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981123 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981127 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981131 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:19.981135 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.981144 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:09:19.985730 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.981837 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 15:09:19.986125 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.984520 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 15:09:19.986125 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.986107 2565 server.go:1019] "Starting client certificate rotation" Jun 02 15:09:19.986222 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.986200 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 15:09:19.987323 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:19.987310 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 15:09:20.008025 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.007995 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 15:09:20.017361 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.013079 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 15:09:20.033291 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.033253 2565 log.go:25] "Validated CRI v1 runtime API" Jun 02 15:09:20.038801 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.038778 2565 log.go:25] "Validated CRI v1 image API" Jun 02 15:09:20.039868 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.039845 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 15:09:20.040102 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.040087 2565 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 15:09:20.043680 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.043659 2565 fs.go:135] Filesystem UUIDs: map[745fa5a1-df37-4169-8616-74f513d2c082:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9b90bddc-16b5-4933-b7ff-8d49b28dc366:/dev/nvme0n1p3] Jun 02 15:09:20.043737 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.043679 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 15:09:20.048123 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.047987 2565 manager.go:217] Machine: {Timestamp:2026-06-02 15:09:20.0474424 +0000 UTC m=+0.359289370 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2500004 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ee7b70d5d7842b76deef9066c8f36 SystemUUID:ec2ee7b7-0d5d-7842-b76d-eef9066c8f36 BootID:155e2c7c-14cd-45f9-9fb3-4bc329235948 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:02:5c:62:6f:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:02:5c:62:6f:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:4b:21:1d:39:b1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 15:09:20.048736 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.048724 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 15:09:20.048831 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.048819 2565 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 15:09:20.049826 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.049799 2565 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 15:09:20.049979 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.049829 2565 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-77.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 15:09:20.050031 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.049989 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 15:09:20.050031 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.049998 2565 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 15:09:20.050031 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.050006 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 15:09:20.051397 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.051385 2565 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 15:09:20.052266 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.052255 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 02 15:09:20.052376 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.052368 2565 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 15:09:20.054854 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.054841 2565 kubelet.go:491] "Attempting to sync node with API server" Jun 02 15:09:20.054917 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.054861 2565 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 15:09:20.054917 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.054878 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 15:09:20.054917 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.054888 2565 kubelet.go:397] "Adding apiserver pod source" Jun 02 15:09:20.054917 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.054896 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 15:09:20.055928 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.055916 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 15:09:20.055974 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.055937 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 15:09:20.058522 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.058501 2565 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 15:09:20.060250 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.060236 2565 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 15:09:20.062199 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.062179 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 15:09:20.062199 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.062197 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 15:09:20.062199 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.062204 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 15:09:20.062340 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.062209 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 15:09:20.062340 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.062219 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 15:09:20.062340 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.062224 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 15:09:20.062340 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.062230 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 15:09:20.062340 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.062236 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 15:09:20.062340 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.062243 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 15:09:20.062340 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.062249 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 15:09:20.062340 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.062258 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 15:09:20.062340 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.062263 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 15:09:20.063609 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.063598 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 15:09:20.063651 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.063611 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 15:09:20.067136 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.067121 2565 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 15:09:20.067205 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.067156 2565 server.go:1295] "Started kubelet" Jun 02 15:09:20.067562 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.067528 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 15:09:20.067969 ip-10-0-136-77 systemd[1]: Started Kubernetes Kubelet. Jun 02 15:09:20.069479 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.069384 2565 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 15:09:20.069600 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.069507 2565 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 15:09:20.070237 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.070198 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 15:09:20.070332 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.070274 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 15:09:20.070825 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.070801 2565 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 15:09:20.072592 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.071506 2565 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 15:09:20.073004 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.072987 2565 server.go:317] "Adding debug handlers to kubelet server" Jun 02 15:09:20.075470 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.075449 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-72k62" Jun 02 15:09:20.077665 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.077650 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 15:09:20.077743 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.077681 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 15:09:20.077743 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.077729 2565 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 15:09:20.077743 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.077738 2565 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 15:09:20.077876 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.077849 2565 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 15:09:20.077971 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.077953 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 02 15:09:20.077971 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.077968 2565 reconciler.go:26] "Reconciler: start to sync state" Jun 02 15:09:20.078440 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.078417 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-77.ec2.internal\" not found" Jun 02 15:09:20.078537 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.077278 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-77.ec2.internal.18b54c27764da766 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-77.ec2.internal,UID:ip-10-0-136-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-77.ec2.internal,},FirstTimestamp:2026-06-02 15:09:20.067135334 +0000 UTC m=+0.378982304,LastTimestamp:2026-06-02 15:09:20.067135334 +0000 UTC m=+0.378982304,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-77.ec2.internal,}" Jun 02 15:09:20.078758 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.078738 2565 factory.go:55] Registering systemd factory Jun 02 15:09:20.078816 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.078763 2565 factory.go:223] Registration of the systemd container factory successfully Jun 02 15:09:20.080383 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.080207 2565 factory.go:153] Registering CRI-O factory Jun 02 15:09:20.080383 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.080227 2565 factory.go:223] Registration of the crio container factory successfully Jun 02 15:09:20.080383 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.080281 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 15:09:20.080383 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.080302 2565 factory.go:103] Registering Raw factory Jun 02 15:09:20.080383 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.080328 2565 manager.go:1196] Started watching for new ooms in manager Jun 02 15:09:20.080800 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.080786 2565 manager.go:319] Starting recovery of all containers Jun 02 15:09:20.083062 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.083037 2565 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 15:09:20.083840 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.083816 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-72k62" Jun 02 15:09:20.084588 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.084545 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 15:09:20.084680 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.084665 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 15:09:20.090191 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.090061 2565 manager.go:324] Recovery completed Jun 02 15:09:20.091613 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.091561 2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 02 15:09:20.094833 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.094820 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:09:20.097058 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.097043 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:09:20.097140 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.097075 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:09:20.097140 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.097089 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:09:20.097678 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.097653 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 15:09:20.097678 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.097666 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 15:09:20.097762 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.097682 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 02 15:09:20.099800 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.099787 2565 policy_none.go:49] "None policy: Start" Jun 02 15:09:20.099871 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.099804 2565 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 15:09:20.099871 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.099814 2565 state_mem.go:35] "Initializing new in-memory state store" Jun 02 15:09:20.143262 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.143242 2565 manager.go:341] "Starting Device Plugin manager" Jun 02 15:09:20.144203 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.143281 2565 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 15:09:20.144203 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.143292 2565 server.go:85] "Starting device plugin registration server" Jun 02 15:09:20.144203 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.143602 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 15:09:20.144203 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.143615 2565 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 15:09:20.144203 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.143742 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 15:09:20.144203 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.143823 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 15:09:20.144203 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.143834 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 15:09:20.144695 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.144677 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 15:09:20.144764 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.144719 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-77.ec2.internal\" not found" Jun 02 15:09:20.200584 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.200535 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 15:09:20.201978 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.201952 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 15:09:20.202094 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.201990 2565 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 15:09:20.202094 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.202023 2565 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 15:09:20.202094 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.202033 2565 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 15:09:20.202094 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.202080 2565 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 15:09:20.204680 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.204662 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:09:20.243928 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.243894 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:09:20.245190 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.245173 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:09:20.245297 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.245204 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:09:20.245297 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.245216 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:09:20.245297 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.245240 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.257288 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.257264 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.257288 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.257290 2565 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-77.ec2.internal\": node \"ip-10-0-136-77.ec2.internal\" not found" Jun 02 15:09:20.276847 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.276809 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-77.ec2.internal\" not found" Jun 02 15:09:20.302856 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.302821 2565 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-77.ec2.internal"] Jun 02 15:09:20.303001 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.302906 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:09:20.304020 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.304000 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:09:20.304139 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.304036 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:09:20.304139 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.304049 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:09:20.305485 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.305468 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:09:20.305650 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.305636 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.305700 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.305666 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:09:20.306867 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.306851 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:09:20.306867 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.306854 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:09:20.307020 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.306890 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:09:20.307020 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.306901 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:09:20.307020 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.306870 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:09:20.307020 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.306949 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:09:20.307887 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.307872 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.307937 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.307899 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:09:20.308629 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.308611 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:09:20.308701 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.308647 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:09:20.308701 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.308662 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:09:20.332453 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.332429 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-77.ec2.internal\" not found" node="ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.337175 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.337159 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-77.ec2.internal\" not found" node="ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.377691 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.377618 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-77.ec2.internal\" not found" Jun 02 15:09:20.379451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.379434 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3178927f9f72a2ba447a9bbf5dcc7a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal\" (UID: \"f3178927f9f72a2ba447a9bbf5dcc7a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.379503 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.379461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3178927f9f72a2ba447a9bbf5dcc7a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal\" (UID: \"f3178927f9f72a2ba447a9bbf5dcc7a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.379503 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.379483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c658f17ddd141ce427e5f4dbd67615e5-config\") pod \"kube-apiserver-proxy-ip-10-0-136-77.ec2.internal\" (UID: \"c658f17ddd141ce427e5f4dbd67615e5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.478003 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.477974 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-77.ec2.internal\" not found" Jun 02 15:09:20.480197 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.480178 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3178927f9f72a2ba447a9bbf5dcc7a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal\" (UID: \"f3178927f9f72a2ba447a9bbf5dcc7a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.480274 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.480206 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3178927f9f72a2ba447a9bbf5dcc7a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal\" (UID: \"f3178927f9f72a2ba447a9bbf5dcc7a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.480274 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.480227 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c658f17ddd141ce427e5f4dbd67615e5-config\") pod \"kube-apiserver-proxy-ip-10-0-136-77.ec2.internal\" (UID: \"c658f17ddd141ce427e5f4dbd67615e5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.480274 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.480256 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c658f17ddd141ce427e5f4dbd67615e5-config\") pod \"kube-apiserver-proxy-ip-10-0-136-77.ec2.internal\" (UID: \"c658f17ddd141ce427e5f4dbd67615e5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.480373 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.480281 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3178927f9f72a2ba447a9bbf5dcc7a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal\" (UID: \"f3178927f9f72a2ba447a9bbf5dcc7a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.480373 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.480281 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3178927f9f72a2ba447a9bbf5dcc7a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal\" (UID: \"f3178927f9f72a2ba447a9bbf5dcc7a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.578903 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.578871 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-77.ec2.internal\" not found" Jun 02 15:09:20.634545 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.634482 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.641091 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.641072 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-77.ec2.internal" Jun 02 15:09:20.679850 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.679820 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-77.ec2.internal\" not found" Jun 02 15:09:20.780334 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.780303 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-77.ec2.internal\" not found" Jun 02 15:09:20.880858 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.880823 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-77.ec2.internal\" not found" Jun 02 15:09:20.981512 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:20.981424 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-77.ec2.internal\" not found" Jun 02 15:09:20.987700 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.987684 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 15:09:20.987861 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:20.987843 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 15:09:21.078388 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.078358 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 15:09:21.082424 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:21.082398 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-77.ec2.internal\" not found" Jun 02 15:09:21.085626 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.085604 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 15:04:20 +0000 UTC" deadline="2027-11-06 04:57:38.444330272 +0000 UTC" Jun 02 15:09:21.085684 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.085628 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12517h48m17.358705818s" Jun 02 15:09:21.091865 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.091837 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 15:09:21.115915 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.115875 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7hlvm" Jun 02 15:09:21.127875 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.127849 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7hlvm" Jun 02 15:09:21.128679 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:21.128649 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3178927f9f72a2ba447a9bbf5dcc7a4.slice/crio-212b3beeff6981a3e2b0d2507c2837059425fbe54acc42595e427ca9c9c875c1 WatchSource:0}: Error finding container 212b3beeff6981a3e2b0d2507c2837059425fbe54acc42595e427ca9c9c875c1: Status 404 returned error can't find the container with id 212b3beeff6981a3e2b0d2507c2837059425fbe54acc42595e427ca9c9c875c1 Jun 02 15:09:21.128993 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:21.128970 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc658f17ddd141ce427e5f4dbd67615e5.slice/crio-de0031add6a88c78dd1efb5a9984253f853296d320b3baac674a12c3ddfafc96 WatchSource:0}: Error finding container de0031add6a88c78dd1efb5a9984253f853296d320b3baac674a12c3ddfafc96: Status 404 returned error can't find the container with id de0031add6a88c78dd1efb5a9984253f853296d320b3baac674a12c3ddfafc96 Jun 02 15:09:21.132372 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.132351 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:09:21.132713 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.132689 2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:09:21.183305 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:21.183266 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-77.ec2.internal\" not found" Jun 02 15:09:21.206387 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.206335 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-77.ec2.internal" event={"ID":"c658f17ddd141ce427e5f4dbd67615e5","Type":"ContainerStarted","Data":"de0031add6a88c78dd1efb5a9984253f853296d320b3baac674a12c3ddfafc96"} Jun 02 15:09:21.207309 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.207283 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal" event={"ID":"f3178927f9f72a2ba447a9bbf5dcc7a4","Type":"ContainerStarted","Data":"212b3beeff6981a3e2b0d2507c2837059425fbe54acc42595e427ca9c9c875c1"} Jun 02 15:09:21.237531 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.237465 2565 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:09:21.277919 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.277879 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal" Jun 02 15:09:21.290332 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.290306 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 15:09:21.291078 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.291063 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-77.ec2.internal" Jun 02 15:09:21.300761 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.300742 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 15:09:21.442800 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:21.442763 2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:09:22.056482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.056348 2565 apiserver.go:52] "Watching apiserver" Jun 02 15:09:22.059909 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.059865 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:09:22.064489 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.064462 2565 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 15:09:22.066315 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.066271 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-kxx6p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal","openshift-multus/multus-additional-cni-plugins-4nzcf","openshift-multus/multus-vwvx6","openshift-multus/network-metrics-daemon-b9dfl","kube-system/kube-apiserver-proxy-ip-10-0-136-77.ec2.internal","openshift-dns/node-resolver-rxpl6","openshift-network-diagnostics/network-check-target-5zchl","openshift-network-operator/iptables-alerter-bhvm8","openshift-ovn-kubernetes/ovnkube-node-6xmhn","kube-system/konnectivity-agent-xlwcz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw","openshift-cluster-node-tuning-operator/tuned-6pktc"] Jun 02 15:09:22.067994 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.067966 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rxpl6" Jun 02 15:09:22.070791 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.070661 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v67zk\"" Jun 02 15:09:22.070791 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.070749 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 15:09:22.070909 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.070883 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 15:09:22.071441 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.071420 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.072711 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.072390 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.074478 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.073873 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 15:09:22.074478 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.073877 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 15:09:22.074478 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.073908 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 15:09:22.074478 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.073889 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9kcp5\"" Jun 02 15:09:22.074478 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.074248 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 15:09:22.074478 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.074269 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 15:09:22.074804 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.074732 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m2g2t\"" Jun 02 15:09:22.074804 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.074738 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 15:09:22.074912 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.074892 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:22.075007 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:22.074978 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:22.075829 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.075809 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kxx6p" Jun 02 15:09:22.075955 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.075935 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:22.076030 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:22.076008 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:22.077222 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.077189 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bhvm8" Jun 02 15:09:22.077754 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.077736 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 15:09:22.078032 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.078014 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 15:09:22.078403 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.078386 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mq47m\"" Jun 02 15:09:22.078485 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.078408 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 15:09:22.079789 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.079769 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:09:22.079936 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.079917 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 15:09:22.080006 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.079771 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 15:09:22.080219 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.080119 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bhbwg\"" Jun 02 15:09:22.081057 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.081037 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xlwcz" Jun 02 15:09:22.083269 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.083249 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.084997 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.084972 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.085898 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.085874 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 15:09:22.086425 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.086387 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 15:09:22.087889 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.086883 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 15:09:22.087889 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.086923 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.087889 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.086984 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 15:09:22.087889 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.087313 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-245nj\"" Jun 02 15:09:22.087889 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.087438 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 15:09:22.088176 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.087989 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 15:09:22.088176 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.088009 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 15:09:22.088176 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.088053 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dttdp\"" Jun 02 15:09:22.088176 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.088091 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 15:09:22.088585 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.088551 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 15:09:22.088980 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.088959 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 15:09:22.089064 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.088961 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 15:09:22.089214 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.089196 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:09:22.089722 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.089689 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-kubelet\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.089814 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.089748 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/87829040-0b55-4e0c-bee5-95b95bc8d9b7-env-overrides\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.089814 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.089781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v687q\" (UniqueName: \"kubernetes.io/projected/87829040-0b55-4e0c-bee5-95b95bc8d9b7-kube-api-access-v687q\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.089814 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.089796 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8n9g6\"" Jun 02 15:09:22.089966 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.089815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/618ed771-f69b-4815-8098-7ea7650b2584-cnibin\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.089966 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.089885 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/618ed771-f69b-4815-8098-7ea7650b2584-cni-binary-copy\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.089966 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.089899 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l7rt4\"" Jun 02 15:09:22.089966 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.089931 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/618ed771-f69b-4815-8098-7ea7650b2584-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.090205 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.089992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbb9t\" (UniqueName: \"kubernetes.io/projected/f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea-kube-api-access-sbb9t\") pod \"iptables-alerter-bhvm8\" (UID: \"f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea\") " pod="openshift-network-operator/iptables-alerter-bhvm8" Jun 02 15:09:22.090205 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090043 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-var-lib-cni-multus\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.090205 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090080 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-run-netns\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.090205 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090140 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-etc-openvswitch\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.090393 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090200 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-cni-bin\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.090393 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090256 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-run-k8s-cni-cncf-io\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.090393 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc2j6\" (UniqueName: \"kubernetes.io/projected/1087c955-eb48-4cf5-90be-2360a5374097-kube-api-access-sc2j6\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.090393 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090339 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 15:09:22.090393 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.090646 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090418 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/618ed771-f69b-4815-8098-7ea7650b2584-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.090646 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090462 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs\") pod \"network-metrics-daemon-b9dfl\" (UID: \"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d\") " pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:22.090646 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090494 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-run-openvswitch\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.090646 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090532 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/87829040-0b55-4e0c-bee5-95b95bc8d9b7-ovn-node-metrics-cert\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.090646 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090593 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/87829040-0b55-4e0c-bee5-95b95bc8d9b7-ovnkube-script-lib\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.090646 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f146772-5c11-4d4a-b181-c3a97f443e05-host\") pod \"node-ca-kxx6p\" (UID: \"8f146772-5c11-4d4a-b181-c3a97f443e05\") " pod="openshift-image-registry/node-ca-kxx6p" Jun 02 15:09:22.090927 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090657 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-os-release\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.090927 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090686 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-slash\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.090927 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090718 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-log-socket\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.090927 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090745 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/618ed771-f69b-4815-8098-7ea7650b2584-system-cni-dir\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.090927 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea-iptables-alerter-script\") pod \"iptables-alerter-bhvm8\" (UID: \"f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea\") " pod="openshift-network-operator/iptables-alerter-bhvm8" Jun 02 15:09:22.090927 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1087c955-eb48-4cf5-90be-2360a5374097-multus-daemon-config\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.090927 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090843 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b850fa03-c11b-4f51-bd9b-fcb48c57c6c4-tmp-dir\") pod \"node-resolver-rxpl6\" (UID: \"b850fa03-c11b-4f51-bd9b-fcb48c57c6c4\") " pod="openshift-dns/node-resolver-rxpl6" Jun 02 15:09:22.090927 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.090876 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-systemd-units\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.091625 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.091603 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-var-lib-openvswitch\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.091708 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.091640 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.091708 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.091669 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-system-cni-dir\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.091708 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.091697 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-var-lib-cni-bin\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.091843 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.091721 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-var-lib-kubelet\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.091843 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.091751 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-cni-netd\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.091843 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.091793 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea-host-slash\") pod \"iptables-alerter-bhvm8\" (UID: \"f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea\") " pod="openshift-network-operator/iptables-alerter-bhvm8" Jun 02 15:09:22.091989 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.091851 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/618ed771-f69b-4815-8098-7ea7650b2584-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.091989 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.091886 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f146772-5c11-4d4a-b181-c3a97f443e05-serviceca\") pod \"node-ca-kxx6p\" (UID: \"8f146772-5c11-4d4a-b181-c3a97f443e05\") " pod="openshift-image-registry/node-ca-kxx6p" Jun 02 15:09:22.091989 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.091910 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-run-systemd\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.091989 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.091938 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbl6h\" (UniqueName: \"kubernetes.io/projected/b850fa03-c11b-4f51-bd9b-fcb48c57c6c4-kube-api-access-hbl6h\") pod \"node-resolver-rxpl6\" (UID: \"b850fa03-c11b-4f51-bd9b-fcb48c57c6c4\") " pod="openshift-dns/node-resolver-rxpl6" Jun 02 15:09:22.091989 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.091960 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j575v\" (UniqueName: \"kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v\") pod \"network-check-target-5zchl\" (UID: \"328e943b-3cb8-4452-9993-cb87775a3698\") " pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:22.091989 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.091978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-run-ovn\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.092267 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092028 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-cnibin\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.092267 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092061 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1087c955-eb48-4cf5-90be-2360a5374097-cni-binary-copy\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.092267 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092087 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-multus-socket-dir-parent\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.092267 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcdql\" (UniqueName: \"kubernetes.io/projected/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-kube-api-access-fcdql\") pod \"network-metrics-daemon-b9dfl\" (UID: \"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d\") " pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:22.092267 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-node-log\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.092267 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092170 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-multus-conf-dir\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.092267 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrndk\" (UniqueName: \"kubernetes.io/projected/8f146772-5c11-4d4a-b181-c3a97f443e05-kube-api-access-qrndk\") pod \"node-ca-kxx6p\" (UID: \"8f146772-5c11-4d4a-b181-c3a97f443e05\") " pod="openshift-image-registry/node-ca-kxx6p" Jun 02 15:09:22.092267 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092218 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-multus-cni-dir\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.092267 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092232 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgvnv\" (UniqueName: \"kubernetes.io/projected/618ed771-f69b-4815-8098-7ea7650b2584-kube-api-access-sgvnv\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.092267 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/87829040-0b55-4e0c-bee5-95b95bc8d9b7-ovnkube-config\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.092267 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092260 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-etc-kubernetes\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.092791 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092275 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-run-multus-certs\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.092791 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092291 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b850fa03-c11b-4f51-bd9b-fcb48c57c6c4-hosts-file\") pod \"node-resolver-rxpl6\" (UID: \"b850fa03-c11b-4f51-bd9b-fcb48c57c6c4\") " pod="openshift-dns/node-resolver-rxpl6" Jun 02 15:09:22.092791 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/618ed771-f69b-4815-8098-7ea7650b2584-os-release\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.092791 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092372 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-run-netns\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.092791 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.092406 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-hostroot\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.128755 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.128678 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 15:04:21 +0000 UTC" deadline="2027-11-05 23:05:57.191051138 +0000 UTC" Jun 02 15:09:22.128755 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.128710 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12511h56m35.062344901s" Jun 02 15:09:22.179427 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.179396 2565 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 15:09:22.192647 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192595 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/618ed771-f69b-4815-8098-7ea7650b2584-os-release\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.192817 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192660 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-run-netns\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.192817 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192681 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-hostroot\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.192817 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192702 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-tuned\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.192817 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192719 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-kubelet\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.192817 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192736 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/87829040-0b55-4e0c-bee5-95b95bc8d9b7-env-overrides\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.192817 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192745 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/618ed771-f69b-4815-8098-7ea7650b2584-os-release\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.192817 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192761 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v687q\" (UniqueName: \"kubernetes.io/projected/87829040-0b55-4e0c-bee5-95b95bc8d9b7-kube-api-access-v687q\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.192817 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192792 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/618ed771-f69b-4815-8098-7ea7650b2584-cnibin\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.193080 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192810 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-run-netns\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.193080 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192821 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/618ed771-f69b-4815-8098-7ea7650b2584-cni-binary-copy\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.193080 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192869 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/618ed771-f69b-4815-8098-7ea7650b2584-cnibin\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.193080 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192823 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-kubelet\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.193080 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192791 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-hostroot\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.193080 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192897 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/618ed771-f69b-4815-8098-7ea7650b2584-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.193080 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192944 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbb9t\" (UniqueName: \"kubernetes.io/projected/f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea-kube-api-access-sbb9t\") pod \"iptables-alerter-bhvm8\" (UID: \"f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea\") " pod="openshift-network-operator/iptables-alerter-bhvm8" Jun 02 15:09:22.193080 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.192976 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-var-lib-cni-multus\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.193080 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193001 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-run-netns\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.193080 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193027 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-etc-openvswitch\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.193080 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193058 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-cni-bin\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.193080 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193076 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/618ed771-f69b-4815-8098-7ea7650b2584-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193093 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-run-k8s-cni-cncf-io\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193139 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-run-k8s-cni-cncf-io\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193134 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-run-netns\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193178 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-etc-openvswitch\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193183 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sc2j6\" (UniqueName: \"kubernetes.io/projected/1087c955-eb48-4cf5-90be-2360a5374097-kube-api-access-sc2j6\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193223 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61aec005-b203-495a-8b3f-010f0d122d22-agent-certs\") pod \"konnectivity-agent-xlwcz\" (UID: \"61aec005-b203-495a-8b3f-010f0d122d22\") " pod="kube-system/konnectivity-agent-xlwcz" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193253 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-cni-bin\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193306 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-var-lib-cni-multus\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193252 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-sysctl-conf\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193344 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-systemd\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193371 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/87829040-0b55-4e0c-bee5-95b95bc8d9b7-env-overrides\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193397 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193459 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/618ed771-f69b-4815-8098-7ea7650b2584-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193466 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.193507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193486 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs\") pod \"network-metrics-daemon-b9dfl\" (UID: \"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d\") " pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:22.194152 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193519 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h9qt\" (UniqueName: \"kubernetes.io/projected/aace9d41-4a30-4a64-b833-7ee1149fbd71-kube-api-access-9h9qt\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.194152 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193527 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/618ed771-f69b-4815-8098-7ea7650b2584-cni-binary-copy\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.194152 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193545 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-run-openvswitch\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.194152 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193591 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/87829040-0b55-4e0c-bee5-95b95bc8d9b7-ovn-node-metrics-cert\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.194152 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193641 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-run-openvswitch\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.194152 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193645 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/87829040-0b55-4e0c-bee5-95b95bc8d9b7-ovnkube-script-lib\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.194152 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:22.193659 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:22.194152 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193678 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f146772-5c11-4d4a-b181-c3a97f443e05-host\") pod \"node-ca-kxx6p\" (UID: \"8f146772-5c11-4d4a-b181-c3a97f443e05\") " pod="openshift-image-registry/node-ca-kxx6p" Jun 02 15:09:22.194152 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193703 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-os-release\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.194152 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:22.193748 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs podName:9b4c9ae9-da6d-4818-ab9e-a67012f72b1d nodeName:}" failed. No retries permitted until 2026-06-02 15:09:22.693702577 +0000 UTC m=+3.005549552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs") pod "network-metrics-daemon-b9dfl" (UID: "9b4c9ae9-da6d-4818-ab9e-a67012f72b1d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:22.194152 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.193795 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f146772-5c11-4d4a-b181-c3a97f443e05-host\") pod \"node-ca-kxx6p\" (UID: \"8f146772-5c11-4d4a-b181-c3a97f443e05\") " pod="openshift-image-registry/node-ca-kxx6p" Jun 02 15:09:22.194152 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194057 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/618ed771-f69b-4815-8098-7ea7650b2584-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194173 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-os-release\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194234 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194296 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-sys-fs\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194312 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/87829040-0b55-4e0c-bee5-95b95bc8d9b7-ovnkube-script-lib\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194335 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-slash\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194380 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-log-socket\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194380 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-slash\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194401 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/618ed771-f69b-4815-8098-7ea7650b2584-system-cni-dir\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194424 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea-iptables-alerter-script\") pod \"iptables-alerter-bhvm8\" (UID: \"f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea\") " pod="openshift-network-operator/iptables-alerter-bhvm8" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194431 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-log-socket\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194463 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1087c955-eb48-4cf5-90be-2360a5374097-multus-daemon-config\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194494 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b850fa03-c11b-4f51-bd9b-fcb48c57c6c4-tmp-dir\") pod \"node-resolver-rxpl6\" (UID: \"b850fa03-c11b-4f51-bd9b-fcb48c57c6c4\") " pod="openshift-dns/node-resolver-rxpl6" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194503 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/618ed771-f69b-4815-8098-7ea7650b2584-system-cni-dir\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194525 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-systemd-units\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194614 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-var-lib-openvswitch\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194661 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194686 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-var-lib-openvswitch\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.194718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194689 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-system-cni-dir\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194713 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-var-lib-cni-bin\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194739 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-system-cni-dir\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194738 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-var-lib-kubelet\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194765 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-var-lib-cni-bin\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194785 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-cni-netd\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194802 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-var-lib-kubelet\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194810 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea-host-slash\") pod \"iptables-alerter-bhvm8\" (UID: \"f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea\") " pod="openshift-network-operator/iptables-alerter-bhvm8" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194663 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-systemd-units\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61aec005-b203-495a-8b3f-010f0d122d22-konnectivity-ca\") pod \"konnectivity-agent-xlwcz\" (UID: \"61aec005-b203-495a-8b3f-010f0d122d22\") " pod="kube-system/konnectivity-agent-xlwcz" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194865 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194872 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-modprobe-d\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194892 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea-host-slash\") pod \"iptables-alerter-bhvm8\" (UID: \"f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea\") " pod="openshift-network-operator/iptables-alerter-bhvm8" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194924 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b850fa03-c11b-4f51-bd9b-fcb48c57c6c4-tmp-dir\") pod \"node-resolver-rxpl6\" (UID: \"b850fa03-c11b-4f51-bd9b-fcb48c57c6c4\") " pod="openshift-dns/node-resolver-rxpl6" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194940 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-host-cni-netd\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-sys\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194969 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnlrp\" (UniqueName: \"kubernetes.io/projected/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-kube-api-access-cnlrp\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.195451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.194988 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/618ed771-f69b-4815-8098-7ea7650b2584-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195028 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea-iptables-alerter-script\") pod \"iptables-alerter-bhvm8\" (UID: \"f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea\") " pod="openshift-network-operator/iptables-alerter-bhvm8" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195044 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f146772-5c11-4d4a-b181-c3a97f443e05-serviceca\") pod \"node-ca-kxx6p\" (UID: \"8f146772-5c11-4d4a-b181-c3a97f443e05\") " pod="openshift-image-registry/node-ca-kxx6p" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195075 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-run-systemd\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195092 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbl6h\" (UniqueName: \"kubernetes.io/projected/b850fa03-c11b-4f51-bd9b-fcb48c57c6c4-kube-api-access-hbl6h\") pod \"node-resolver-rxpl6\" (UID: \"b850fa03-c11b-4f51-bd9b-fcb48c57c6c4\") " pod="openshift-dns/node-resolver-rxpl6" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195109 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-kubernetes\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195122 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-sysctl-d\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195137 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-socket-dir\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195177 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-run-systemd\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195204 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1087c955-eb48-4cf5-90be-2360a5374097-multus-daemon-config\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195273 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-registration-dir\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195338 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j575v\" (UniqueName: \"kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v\") pod \"network-check-target-5zchl\" (UID: \"328e943b-3cb8-4452-9993-cb87775a3698\") " pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195353 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-run-ovn\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195368 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-cnibin\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195357 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/618ed771-f69b-4815-8098-7ea7650b2584-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195415 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f146772-5c11-4d4a-b181-c3a97f443e05-serviceca\") pod \"node-ca-kxx6p\" (UID: \"8f146772-5c11-4d4a-b181-c3a97f443e05\") " pod="openshift-image-registry/node-ca-kxx6p" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195410 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-cnibin\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.196161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195436 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-run-ovn\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195510 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1087c955-eb48-4cf5-90be-2360a5374097-cni-binary-copy\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195534 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-multus-socket-dir-parent\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195554 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcdql\" (UniqueName: \"kubernetes.io/projected/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-kube-api-access-fcdql\") pod \"network-metrics-daemon-b9dfl\" (UID: \"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d\") " pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195600 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-lib-modules\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195624 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-node-log\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195653 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-multus-conf-dir\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195652 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-multus-socket-dir-parent\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195679 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-run\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195715 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-device-dir\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195736 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-multus-conf-dir\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195747 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrndk\" (UniqueName: \"kubernetes.io/projected/8f146772-5c11-4d4a-b181-c3a97f443e05-kube-api-access-qrndk\") pod \"node-ca-kxx6p\" (UID: \"8f146772-5c11-4d4a-b181-c3a97f443e05\") " pod="openshift-image-registry/node-ca-kxx6p" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195771 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87829040-0b55-4e0c-bee5-95b95bc8d9b7-node-log\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195806 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-multus-cni-dir\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195835 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-var-lib-kubelet\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195945 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-host\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195968 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-multus-cni-dir\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.196857 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.195972 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.197408 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.196009 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-etc-selinux\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.197408 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.196050 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgvnv\" (UniqueName: \"kubernetes.io/projected/618ed771-f69b-4815-8098-7ea7650b2584-kube-api-access-sgvnv\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.197408 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.196056 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1087c955-eb48-4cf5-90be-2360a5374097-cni-binary-copy\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.197408 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.196075 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-sysconfig\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.197408 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.196102 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/87829040-0b55-4e0c-bee5-95b95bc8d9b7-ovnkube-config\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.197408 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.196130 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-etc-kubernetes\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.197408 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.196148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-tmp\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.197408 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.196170 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-run-multus-certs\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.197408 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.196212 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-host-run-multus-certs\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.197408 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.196249 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b850fa03-c11b-4f51-bd9b-fcb48c57c6c4-hosts-file\") pod \"node-resolver-rxpl6\" (UID: \"b850fa03-c11b-4f51-bd9b-fcb48c57c6c4\") " pod="openshift-dns/node-resolver-rxpl6" Jun 02 15:09:22.197408 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.196267 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1087c955-eb48-4cf5-90be-2360a5374097-etc-kubernetes\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.197408 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.196432 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b850fa03-c11b-4f51-bd9b-fcb48c57c6c4-hosts-file\") pod \"node-resolver-rxpl6\" (UID: \"b850fa03-c11b-4f51-bd9b-fcb48c57c6c4\") " pod="openshift-dns/node-resolver-rxpl6" Jun 02 15:09:22.197408 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.196629 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/87829040-0b55-4e0c-bee5-95b95bc8d9b7-ovnkube-config\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.199309 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.198860 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/87829040-0b55-4e0c-bee5-95b95bc8d9b7-ovn-node-metrics-cert\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.204907 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.204834 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbb9t\" (UniqueName: \"kubernetes.io/projected/f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea-kube-api-access-sbb9t\") pod \"iptables-alerter-bhvm8\" (UID: \"f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea\") " pod="openshift-network-operator/iptables-alerter-bhvm8" Jun 02 15:09:22.207549 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:22.206382 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:09:22.207549 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:22.206407 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:09:22.207549 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:22.206421 2565 projected.go:194] Error preparing data for projected volume kube-api-access-j575v for pod openshift-network-diagnostics/network-check-target-5zchl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:22.207549 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:22.206503 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v podName:328e943b-3cb8-4452-9993-cb87775a3698 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:22.706485362 +0000 UTC m=+3.018332322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j575v" (UniqueName: "kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v") pod "network-check-target-5zchl" (UID: "328e943b-3cb8-4452-9993-cb87775a3698") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:22.208385 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.208358 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v687q\" (UniqueName: \"kubernetes.io/projected/87829040-0b55-4e0c-bee5-95b95bc8d9b7-kube-api-access-v687q\") pod \"ovnkube-node-6xmhn\" (UID: \"87829040-0b55-4e0c-bee5-95b95bc8d9b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.208981 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.208958 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc2j6\" (UniqueName: \"kubernetes.io/projected/1087c955-eb48-4cf5-90be-2360a5374097-kube-api-access-sc2j6\") pod \"multus-vwvx6\" (UID: \"1087c955-eb48-4cf5-90be-2360a5374097\") " pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.209272 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.209253 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrndk\" (UniqueName: \"kubernetes.io/projected/8f146772-5c11-4d4a-b181-c3a97f443e05-kube-api-access-qrndk\") pod \"node-ca-kxx6p\" (UID: \"8f146772-5c11-4d4a-b181-c3a97f443e05\") " pod="openshift-image-registry/node-ca-kxx6p" Jun 02 15:09:22.209864 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.209848 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcdql\" (UniqueName: \"kubernetes.io/projected/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-kube-api-access-fcdql\") pod \"network-metrics-daemon-b9dfl\" (UID: \"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d\") " pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:22.210016 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.209998 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbl6h\" (UniqueName: \"kubernetes.io/projected/b850fa03-c11b-4f51-bd9b-fcb48c57c6c4-kube-api-access-hbl6h\") pod \"node-resolver-rxpl6\" (UID: \"b850fa03-c11b-4f51-bd9b-fcb48c57c6c4\") " pod="openshift-dns/node-resolver-rxpl6" Jun 02 15:09:22.210492 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.210471 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgvnv\" (UniqueName: \"kubernetes.io/projected/618ed771-f69b-4815-8098-7ea7650b2584-kube-api-access-sgvnv\") pod \"multus-additional-cni-plugins-4nzcf\" (UID: \"618ed771-f69b-4815-8098-7ea7650b2584\") " pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.297562 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297524 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61aec005-b203-495a-8b3f-010f0d122d22-konnectivity-ca\") pod \"konnectivity-agent-xlwcz\" (UID: \"61aec005-b203-495a-8b3f-010f0d122d22\") " pod="kube-system/konnectivity-agent-xlwcz" Jun 02 15:09:22.297562 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297582 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-modprobe-d\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.297796 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297612 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-sys\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.297796 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297640 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnlrp\" (UniqueName: \"kubernetes.io/projected/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-kube-api-access-cnlrp\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.297796 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297668 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-kubernetes\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.297796 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297687 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-sysctl-d\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.297796 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297708 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-socket-dir\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.297796 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297734 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-registration-dir\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.297796 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297769 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-lib-modules\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.297796 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297794 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-run\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.298103 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297819 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-device-dir\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.298103 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297845 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-var-lib-kubelet\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.298103 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297869 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-host\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.298103 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297892 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.298103 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297910 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-etc-selinux\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.298103 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297926 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-sysconfig\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.298103 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297942 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-tmp\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.298103 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.297970 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-tuned\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.298103 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298006 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61aec005-b203-495a-8b3f-010f0d122d22-agent-certs\") pod \"konnectivity-agent-xlwcz\" (UID: \"61aec005-b203-495a-8b3f-010f0d122d22\") " pod="kube-system/konnectivity-agent-xlwcz" Jun 02 15:09:22.298103 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298027 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-sysctl-conf\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.298103 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298046 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-systemd\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.298103 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298082 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9h9qt\" (UniqueName: \"kubernetes.io/projected/aace9d41-4a30-4a64-b833-7ee1149fbd71-kube-api-access-9h9qt\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.298550 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298109 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-sys-fs\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.298550 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298179 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61aec005-b203-495a-8b3f-010f0d122d22-konnectivity-ca\") pod \"konnectivity-agent-xlwcz\" (UID: \"61aec005-b203-495a-8b3f-010f0d122d22\") " pod="kube-system/konnectivity-agent-xlwcz" Jun 02 15:09:22.298550 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298186 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-sys-fs\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.298550 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298282 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-modprobe-d\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.298550 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298284 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-var-lib-kubelet\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.298550 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298340 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-sys\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.298550 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298369 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-etc-selinux\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.298550 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298388 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.298550 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298416 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-sysconfig\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.299064 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298659 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-registration-dir\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.299064 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298759 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-sysctl-d\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.299064 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298769 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-socket-dir\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.299064 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298806 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-lib-modules\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.299064 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298808 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-kubernetes\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.299064 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298841 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-systemd\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.299064 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298870 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-run\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.299064 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298882 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-sysctl-conf\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.299064 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298909 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aace9d41-4a30-4a64-b833-7ee1149fbd71-device-dir\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.299064 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.298950 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-host\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.301037 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.301010 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-tmp\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.301267 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.301195 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-etc-tuned\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.301529 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.301510 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61aec005-b203-495a-8b3f-010f0d122d22-agent-certs\") pod \"konnectivity-agent-xlwcz\" (UID: \"61aec005-b203-495a-8b3f-010f0d122d22\") " pod="kube-system/konnectivity-agent-xlwcz" Jun 02 15:09:22.307564 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.307507 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h9qt\" (UniqueName: \"kubernetes.io/projected/aace9d41-4a30-4a64-b833-7ee1149fbd71-kube-api-access-9h9qt\") pod \"aws-ebs-csi-driver-node-n47hw\" (UID: \"aace9d41-4a30-4a64-b833-7ee1149fbd71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.307564 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.307535 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnlrp\" (UniqueName: \"kubernetes.io/projected/18a7e08f-25c3-4ec7-83c6-b54c06675b0a-kube-api-access-cnlrp\") pod \"tuned-6pktc\" (UID: \"18a7e08f-25c3-4ec7-83c6-b54c06675b0a\") " pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.381492 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.381453 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rxpl6" Jun 02 15:09:22.392351 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.392322 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4nzcf" Jun 02 15:09:22.402257 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.402228 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xlwcz" Jun 02 15:09:22.408259 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.408235 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vwvx6" Jun 02 15:09:22.414848 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.414824 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kxx6p" Jun 02 15:09:22.423466 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.423436 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bhvm8" Jun 02 15:09:22.433241 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.433218 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:22.441081 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.441059 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" Jun 02 15:09:22.445750 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.445723 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6pktc" Jun 02 15:09:22.700993 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.700918 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs\") pod \"network-metrics-daemon-b9dfl\" (UID: \"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d\") " pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:22.701143 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:22.701041 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:22.701200 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:22.701114 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs podName:9b4c9ae9-da6d-4818-ab9e-a67012f72b1d nodeName:}" failed. No retries permitted until 2026-06-02 15:09:23.701094215 +0000 UTC m=+4.012941190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs") pod "network-metrics-daemon-b9dfl" (UID: "9b4c9ae9-da6d-4818-ab9e-a67012f72b1d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:22.801745 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:22.801700 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j575v\" (UniqueName: \"kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v\") pod \"network-check-target-5zchl\" (UID: \"328e943b-3cb8-4452-9993-cb87775a3698\") " pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:22.801932 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:22.801905 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:09:22.801991 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:22.801935 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:09:22.801991 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:22.801950 2565 projected.go:194] Error preparing data for projected volume kube-api-access-j575v for pod openshift-network-diagnostics/network-check-target-5zchl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:22.802056 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:22.802025 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v podName:328e943b-3cb8-4452-9993-cb87775a3698 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:23.802005251 +0000 UTC m=+4.113852208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j575v" (UniqueName: "kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v") pod "network-check-target-5zchl" (UID: "328e943b-3cb8-4452-9993-cb87775a3698") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:22.851346 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:22.851314 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61aec005_b203_495a_8b3f_010f0d122d22.slice/crio-dcdb985766e26142f3cd780734cc8a3d4e2d3098b6564bc9db3ea040bf1fb37d WatchSource:0}: Error finding container dcdb985766e26142f3cd780734cc8a3d4e2d3098b6564bc9db3ea040bf1fb37d: Status 404 returned error can't find the container with id dcdb985766e26142f3cd780734cc8a3d4e2d3098b6564bc9db3ea040bf1fb37d Jun 02 15:09:22.852744 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:22.852697 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod618ed771_f69b_4815_8098_7ea7650b2584.slice/crio-cba923722df4048c798f75b45b1743bb0456f2273d68525ddf17631f46caca66 WatchSource:0}: Error finding container cba923722df4048c798f75b45b1743bb0456f2273d68525ddf17631f46caca66: Status 404 returned error can't find the container with id cba923722df4048c798f75b45b1743bb0456f2273d68525ddf17631f46caca66 Jun 02 15:09:22.858166 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:22.858142 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87829040_0b55_4e0c_bee5_95b95bc8d9b7.slice/crio-1502a892c78cfd1d7e3b7300c35d1d244cc6028b3529b488f45cc2b60097fd67 WatchSource:0}: Error finding container 1502a892c78cfd1d7e3b7300c35d1d244cc6028b3529b488f45cc2b60097fd67: Status 404 returned error can't find the container with id 1502a892c78cfd1d7e3b7300c35d1d244cc6028b3529b488f45cc2b60097fd67 Jun 02 15:09:22.858949 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:22.858928 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a7e08f_25c3_4ec7_83c6_b54c06675b0a.slice/crio-67f057df29a35a2251f48dd765acd6b079898c30c9c1554a33d88d88901a64cd WatchSource:0}: Error finding container 67f057df29a35a2251f48dd765acd6b079898c30c9c1554a33d88d88901a64cd: Status 404 returned error can't find the container with id 67f057df29a35a2251f48dd765acd6b079898c30c9c1554a33d88d88901a64cd Jun 02 15:09:22.860047 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:22.860021 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1087c955_eb48_4cf5_90be_2360a5374097.slice/crio-c02e768d338c2353b0b7cb2f2c9e7a6693236c4c727c01e80a8e92ae349fc6e6 WatchSource:0}: Error finding container c02e768d338c2353b0b7cb2f2c9e7a6693236c4c727c01e80a8e92ae349fc6e6: Status 404 returned error can't find the container with id c02e768d338c2353b0b7cb2f2c9e7a6693236c4c727c01e80a8e92ae349fc6e6 Jun 02 15:09:22.861373 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:22.861346 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1488ed1_7f01_4ac2_bbb3_257b1c85e7ea.slice/crio-5931f7cd3dc543846c3fb45055f74e81adf9e36342b064cb628a81212a960a6c WatchSource:0}: Error finding container 5931f7cd3dc543846c3fb45055f74e81adf9e36342b064cb628a81212a960a6c: Status 404 returned error can't find the container with id 5931f7cd3dc543846c3fb45055f74e81adf9e36342b064cb628a81212a960a6c Jun 02 15:09:22.861999 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:22.861978 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f146772_5c11_4d4a_b181_c3a97f443e05.slice/crio-840726be28436232700b5280f038a1102bff63f338f0fd36b9aa4d9912438009 WatchSource:0}: Error finding container 840726be28436232700b5280f038a1102bff63f338f0fd36b9aa4d9912438009: Status 404 returned error can't find the container with id 840726be28436232700b5280f038a1102bff63f338f0fd36b9aa4d9912438009 Jun 02 15:09:22.864793 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:22.864650 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaace9d41_4a30_4a64_b833_7ee1149fbd71.slice/crio-b96c5e11b2dd9b809be8205c8b0af871233f5efc10cc6db7c61318aeb69e78fd WatchSource:0}: Error finding container b96c5e11b2dd9b809be8205c8b0af871233f5efc10cc6db7c61318aeb69e78fd: Status 404 returned error can't find the container with id b96c5e11b2dd9b809be8205c8b0af871233f5efc10cc6db7c61318aeb69e78fd Jun 02 15:09:23.129803 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.129622 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 15:04:21 +0000 UTC" deadline="2027-12-11 06:55:02.669844728 +0000 UTC" Jun 02 15:09:23.129803 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.129800 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13359h45m39.54004827s" Jun 02 15:09:23.211128 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.211078 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nzcf" event={"ID":"618ed771-f69b-4815-8098-7ea7650b2584","Type":"ContainerStarted","Data":"cba923722df4048c798f75b45b1743bb0456f2273d68525ddf17631f46caca66"} Jun 02 15:09:23.212062 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.212039 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xlwcz" event={"ID":"61aec005-b203-495a-8b3f-010f0d122d22","Type":"ContainerStarted","Data":"dcdb985766e26142f3cd780734cc8a3d4e2d3098b6564bc9db3ea040bf1fb37d"} Jun 02 15:09:23.213478 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.213456 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-77.ec2.internal" event={"ID":"c658f17ddd141ce427e5f4dbd67615e5","Type":"ContainerStarted","Data":"67305ef4c0f3438c455ffb64e63cc087ad08c3ade7d86528eeb03b66a25cf544"} Jun 02 15:09:23.214474 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.214444 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rxpl6" event={"ID":"b850fa03-c11b-4f51-bd9b-fcb48c57c6c4","Type":"ContainerStarted","Data":"b53aaf0ddb8b8856b6f45141ed80a09df213cfaac78ff5ad06e2b015dc4b925d"} Jun 02 15:09:23.215338 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.215320 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6pktc" event={"ID":"18a7e08f-25c3-4ec7-83c6-b54c06675b0a","Type":"ContainerStarted","Data":"67f057df29a35a2251f48dd765acd6b079898c30c9c1554a33d88d88901a64cd"} Jun 02 15:09:23.216220 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.216201 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" event={"ID":"87829040-0b55-4e0c-bee5-95b95bc8d9b7","Type":"ContainerStarted","Data":"1502a892c78cfd1d7e3b7300c35d1d244cc6028b3529b488f45cc2b60097fd67"} Jun 02 15:09:23.217468 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.217445 2565 generic.go:358] "Generic (PLEG): container finished" podID="f3178927f9f72a2ba447a9bbf5dcc7a4" containerID="ab487797a643165c5ea3f3e2258f4a7f1cb57cf7327cbc06a83024614368a277" exitCode=0 Jun 02 15:09:23.217564 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.217512 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal" event={"ID":"f3178927f9f72a2ba447a9bbf5dcc7a4","Type":"ContainerDied","Data":"ab487797a643165c5ea3f3e2258f4a7f1cb57cf7327cbc06a83024614368a277"} Jun 02 15:09:23.218481 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.218464 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" event={"ID":"aace9d41-4a30-4a64-b833-7ee1149fbd71","Type":"ContainerStarted","Data":"b96c5e11b2dd9b809be8205c8b0af871233f5efc10cc6db7c61318aeb69e78fd"} Jun 02 15:09:23.219415 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.219387 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kxx6p" event={"ID":"8f146772-5c11-4d4a-b181-c3a97f443e05","Type":"ContainerStarted","Data":"840726be28436232700b5280f038a1102bff63f338f0fd36b9aa4d9912438009"} Jun 02 15:09:23.220314 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.220296 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bhvm8" event={"ID":"f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea","Type":"ContainerStarted","Data":"5931f7cd3dc543846c3fb45055f74e81adf9e36342b064cb628a81212a960a6c"} Jun 02 15:09:23.221161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.221140 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vwvx6" event={"ID":"1087c955-eb48-4cf5-90be-2360a5374097","Type":"ContainerStarted","Data":"c02e768d338c2353b0b7cb2f2c9e7a6693236c4c727c01e80a8e92ae349fc6e6"} Jun 02 15:09:23.226881 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.226843 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-77.ec2.internal" podStartSLOduration=2.226830267 podStartE2EDuration="2.226830267s" podCreationTimestamp="2026-06-02 15:09:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:09:23.226507374 +0000 UTC m=+3.538354354" watchObservedRunningTime="2026-06-02 15:09:23.226830267 +0000 UTC m=+3.538677245" Jun 02 15:09:23.710269 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.709686 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs\") pod \"network-metrics-daemon-b9dfl\" (UID: \"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d\") " pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:23.710269 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:23.709840 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:23.710269 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:23.709903 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs podName:9b4c9ae9-da6d-4818-ab9e-a67012f72b1d nodeName:}" failed. No retries permitted until 2026-06-02 15:09:25.709884897 +0000 UTC m=+6.021731860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs") pod "network-metrics-daemon-b9dfl" (UID: "9b4c9ae9-da6d-4818-ab9e-a67012f72b1d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:23.811419 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:23.810703 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j575v\" (UniqueName: \"kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v\") pod \"network-check-target-5zchl\" (UID: \"328e943b-3cb8-4452-9993-cb87775a3698\") " pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:23.811419 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:23.810934 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:09:23.811419 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:23.810955 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:09:23.811419 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:23.810968 2565 projected.go:194] Error preparing data for projected volume kube-api-access-j575v for pod openshift-network-diagnostics/network-check-target-5zchl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:23.811419 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:23.811032 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v podName:328e943b-3cb8-4452-9993-cb87775a3698 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:25.811013222 +0000 UTC m=+6.122860179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j575v" (UniqueName: "kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v") pod "network-check-target-5zchl" (UID: "328e943b-3cb8-4452-9993-cb87775a3698") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:24.204393 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:24.203734 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:24.204393 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:24.203869 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:24.204393 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:24.203734 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:24.204393 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:24.204306 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:24.230374 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:24.230332 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal" event={"ID":"f3178927f9f72a2ba447a9bbf5dcc7a4","Type":"ContainerStarted","Data":"a174be5052566db42be7e7f18168c976a344b629975a0cecbc1a72f1956d7488"} Jun 02 15:09:25.727395 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:25.727350 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs\") pod \"network-metrics-daemon-b9dfl\" (UID: \"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d\") " pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:25.727890 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:25.727510 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:25.727890 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:25.727596 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs podName:9b4c9ae9-da6d-4818-ab9e-a67012f72b1d nodeName:}" failed. No retries permitted until 2026-06-02 15:09:29.727557618 +0000 UTC m=+10.039404595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs") pod "network-metrics-daemon-b9dfl" (UID: "9b4c9ae9-da6d-4818-ab9e-a67012f72b1d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:25.827710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:25.827671 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j575v\" (UniqueName: \"kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v\") pod \"network-check-target-5zchl\" (UID: \"328e943b-3cb8-4452-9993-cb87775a3698\") " pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:25.827888 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:25.827839 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:09:25.827888 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:25.827857 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:09:25.827888 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:25.827869 2565 projected.go:194] Error preparing data for projected volume kube-api-access-j575v for pod openshift-network-diagnostics/network-check-target-5zchl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:25.828123 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:25.827927 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v podName:328e943b-3cb8-4452-9993-cb87775a3698 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:29.827908861 +0000 UTC m=+10.139755821 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j575v" (UniqueName: "kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v") pod "network-check-target-5zchl" (UID: "328e943b-3cb8-4452-9993-cb87775a3698") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:25.834823 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:25.834664 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-77.ec2.internal" podStartSLOduration=4.834645193 podStartE2EDuration="4.834645193s" podCreationTimestamp="2026-06-02 15:09:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:09:24.246007128 +0000 UTC m=+4.557854108" watchObservedRunningTime="2026-06-02 15:09:25.834645193 +0000 UTC m=+6.146492174" Jun 02 15:09:25.835067 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:25.835044 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vvmdt"] Jun 02 15:09:25.836914 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:25.836891 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:25.837043 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:25.836981 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:25.928491 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:25.928449 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/45a8a35d-8eca-4e5c-ac40-9752b116226e-kubelet-config\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:25.928693 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:25.928544 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/45a8a35d-8eca-4e5c-ac40-9752b116226e-dbus\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:25.928693 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:25.928611 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:26.029199 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:26.029104 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:26.029199 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:26.029181 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/45a8a35d-8eca-4e5c-ac40-9752b116226e-kubelet-config\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:26.029414 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:26.029236 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/45a8a35d-8eca-4e5c-ac40-9752b116226e-dbus\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:26.029470 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:26.029431 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/45a8a35d-8eca-4e5c-ac40-9752b116226e-dbus\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:26.029586 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:26.029557 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:26.029818 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:26.029794 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret podName:45a8a35d-8eca-4e5c-ac40-9752b116226e nodeName:}" failed. No retries permitted until 2026-06-02 15:09:26.529772004 +0000 UTC m=+6.841618975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret") pod "global-pull-secret-syncer-vvmdt" (UID: "45a8a35d-8eca-4e5c-ac40-9752b116226e") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:26.030032 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:26.029705 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/45a8a35d-8eca-4e5c-ac40-9752b116226e-kubelet-config\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:26.202768 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:26.202733 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:26.203003 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:26.202879 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:26.203209 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:26.202735 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:26.203305 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:26.203286 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:26.534033 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:26.533401 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:26.534033 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:26.533609 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:26.534033 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:26.533669 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret podName:45a8a35d-8eca-4e5c-ac40-9752b116226e nodeName:}" failed. No retries permitted until 2026-06-02 15:09:27.533651405 +0000 UTC m=+7.845498366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret") pod "global-pull-secret-syncer-vvmdt" (UID: "45a8a35d-8eca-4e5c-ac40-9752b116226e") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:27.202680 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:27.202424 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:27.202680 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:27.202558 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:27.539695 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:27.539651 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:27.539868 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:27.539829 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:27.539913 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:27.539904 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret podName:45a8a35d-8eca-4e5c-ac40-9752b116226e nodeName:}" failed. No retries permitted until 2026-06-02 15:09:29.539884194 +0000 UTC m=+9.851731163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret") pod "global-pull-secret-syncer-vvmdt" (UID: "45a8a35d-8eca-4e5c-ac40-9752b116226e") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:28.202994 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:28.202957 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:28.203451 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:28.203098 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:28.203528 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:28.203468 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:28.203601 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:28.203550 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:29.202934 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:29.202897 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:29.203117 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:29.203031 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:29.558058 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:29.558021 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:29.558244 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:29.558184 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:29.558285 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:29.558248 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret podName:45a8a35d-8eca-4e5c-ac40-9752b116226e nodeName:}" failed. No retries permitted until 2026-06-02 15:09:33.558233721 +0000 UTC m=+13.870080678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret") pod "global-pull-secret-syncer-vvmdt" (UID: "45a8a35d-8eca-4e5c-ac40-9752b116226e") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:29.760520 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:29.760480 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs\") pod \"network-metrics-daemon-b9dfl\" (UID: \"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d\") " pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:29.760725 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:29.760645 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:29.760725 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:29.760709 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs podName:9b4c9ae9-da6d-4818-ab9e-a67012f72b1d nodeName:}" failed. No retries permitted until 2026-06-02 15:09:37.76069081 +0000 UTC m=+18.072537767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs") pod "network-metrics-daemon-b9dfl" (UID: "9b4c9ae9-da6d-4818-ab9e-a67012f72b1d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:29.860982 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:29.860881 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j575v\" (UniqueName: \"kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v\") pod \"network-check-target-5zchl\" (UID: \"328e943b-3cb8-4452-9993-cb87775a3698\") " pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:29.861132 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:29.861058 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:09:29.861132 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:29.861075 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:09:29.861132 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:29.861088 2565 projected.go:194] Error preparing data for projected volume kube-api-access-j575v for pod openshift-network-diagnostics/network-check-target-5zchl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:29.861257 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:29.861144 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v podName:328e943b-3cb8-4452-9993-cb87775a3698 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:37.861127325 +0000 UTC m=+18.172974286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j575v" (UniqueName: "kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v") pod "network-check-target-5zchl" (UID: "328e943b-3cb8-4452-9993-cb87775a3698") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:30.203047 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:30.202964 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:30.203201 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:30.203081 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:30.203201 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:30.203137 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:30.203627 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:30.203239 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:31.202534 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:31.202450 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:31.202712 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:31.202610 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:32.204271 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:32.204233 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:32.204827 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:32.204408 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:32.204992 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:32.204971 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:32.205110 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:32.205091 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:33.203014 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:33.202975 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:33.203199 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:33.203089 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:33.591747 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:33.591700 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:33.592223 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:33.591875 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:33.592223 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:33.591971 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret podName:45a8a35d-8eca-4e5c-ac40-9752b116226e nodeName:}" failed. No retries permitted until 2026-06-02 15:09:41.591947852 +0000 UTC m=+21.903794810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret") pod "global-pull-secret-syncer-vvmdt" (UID: "45a8a35d-8eca-4e5c-ac40-9752b116226e") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:34.202756 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:34.202718 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:34.202939 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:34.202736 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:34.202939 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:34.202870 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:34.203052 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:34.202953 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:35.202236 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:35.202193 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:35.202692 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:35.202327 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:36.202788 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:36.202248 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:36.202788 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:36.202262 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:36.202788 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:36.202404 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:36.202788 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:36.202459 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:37.202527 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:37.202490 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:37.202713 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:37.202633 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:37.819399 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:37.819357 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs\") pod \"network-metrics-daemon-b9dfl\" (UID: \"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d\") " pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:37.819825 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:37.819531 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:37.819825 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:37.819618 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs podName:9b4c9ae9-da6d-4818-ab9e-a67012f72b1d nodeName:}" failed. No retries permitted until 2026-06-02 15:09:53.819600872 +0000 UTC m=+34.131447832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs") pod "network-metrics-daemon-b9dfl" (UID: "9b4c9ae9-da6d-4818-ab9e-a67012f72b1d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:37.920325 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:37.920281 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j575v\" (UniqueName: \"kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v\") pod \"network-check-target-5zchl\" (UID: \"328e943b-3cb8-4452-9993-cb87775a3698\") " pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:37.920489 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:37.920462 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:09:37.920489 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:37.920486 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:09:37.920637 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:37.920498 2565 projected.go:194] Error preparing data for projected volume kube-api-access-j575v for pod openshift-network-diagnostics/network-check-target-5zchl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:37.920637 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:37.920566 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v podName:328e943b-3cb8-4452-9993-cb87775a3698 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:53.920546249 +0000 UTC m=+34.232393226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j575v" (UniqueName: "kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v") pod "network-check-target-5zchl" (UID: "328e943b-3cb8-4452-9993-cb87775a3698") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:38.202530 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:38.202444 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:38.202761 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:38.202444 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:38.202761 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:38.202617 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:38.202761 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:38.202681 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:39.203110 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:39.203073 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:39.203642 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:39.203188 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:40.203939 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:40.203373 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:40.203939 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:40.203526 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:40.203939 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:40.203594 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:40.203939 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:40.203684 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:41.202925 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:41.202893 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:41.203064 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:41.203029 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:41.646667 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:41.646312 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:41.647259 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:41.646444 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:41.647259 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:41.646773 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret podName:45a8a35d-8eca-4e5c-ac40-9752b116226e nodeName:}" failed. No retries permitted until 2026-06-02 15:09:57.646756459 +0000 UTC m=+37.958603436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret") pod "global-pull-secret-syncer-vvmdt" (UID: "45a8a35d-8eca-4e5c-ac40-9752b116226e") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:42.202765 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.202727 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:42.202937 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.202727 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:42.202937 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:42.202876 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:42.203059 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:42.202968 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:42.268822 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.268775 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" event={"ID":"aace9d41-4a30-4a64-b833-7ee1149fbd71","Type":"ContainerStarted","Data":"606c74d81dd91ab85f841a155cc7e22924883993003990b17267b9a874cb6172"} Jun 02 15:09:42.270722 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.270684 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kxx6p" event={"ID":"8f146772-5c11-4d4a-b181-c3a97f443e05","Type":"ContainerStarted","Data":"c4ca06c162be83a2097c8a6796f66130548db75354ac7816b89337e587d0849d"} Jun 02 15:09:42.272434 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.272401 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vwvx6" event={"ID":"1087c955-eb48-4cf5-90be-2360a5374097","Type":"ContainerStarted","Data":"d962d47698aa3d8e17d7a6e5079f4744be61bf775e840bc6d63ec2e4ddbc8dae"} Jun 02 15:09:42.275029 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.274989 2565 generic.go:358] "Generic (PLEG): container finished" podID="618ed771-f69b-4815-8098-7ea7650b2584" containerID="a685359b13b4a9a51901bc14ed778c32f538f223d44713f867fc14de65b08762" exitCode=0 Jun 02 15:09:42.275383 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.275354 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nzcf" event={"ID":"618ed771-f69b-4815-8098-7ea7650b2584","Type":"ContainerDied","Data":"a685359b13b4a9a51901bc14ed778c32f538f223d44713f867fc14de65b08762"} Jun 02 15:09:42.277374 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.277349 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xlwcz" event={"ID":"61aec005-b203-495a-8b3f-010f0d122d22","Type":"ContainerStarted","Data":"954846674e5eb5b739ee51b053cdf0e856a372d24066269bac0b091cdae9030d"} Jun 02 15:09:42.278844 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.278813 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rxpl6" event={"ID":"b850fa03-c11b-4f51-bd9b-fcb48c57c6c4","Type":"ContainerStarted","Data":"e9b0006ced57253383eeeb474e8133896f579d17f0e05738853ffbadc9f4332d"} Jun 02 15:09:42.280387 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.280365 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6pktc" event={"ID":"18a7e08f-25c3-4ec7-83c6-b54c06675b0a","Type":"ContainerStarted","Data":"9b5909bd7e9f0993683e1b54e3f99398b5842a630be93548ef84d244f0ac5ac9"} Jun 02 15:09:42.283191 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.283174 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-acl-logging/0.log" Jun 02 15:09:42.283555 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.283525 2565 generic.go:358] "Generic (PLEG): container finished" podID="87829040-0b55-4e0c-bee5-95b95bc8d9b7" containerID="5c5e27a9193719f4cf555ff661c33ee63f9bc3f11c35c73a68eb2176b436d1ff" exitCode=1 Jun 02 15:09:42.283678 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.283561 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" event={"ID":"87829040-0b55-4e0c-bee5-95b95bc8d9b7","Type":"ContainerStarted","Data":"1cf3fe0348a64eee7505c63898b5888dc5e0ee66ab9b0311d0b78dcd62fed486"} Jun 02 15:09:42.283678 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.283600 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" event={"ID":"87829040-0b55-4e0c-bee5-95b95bc8d9b7","Type":"ContainerStarted","Data":"d3ce4f99fb3bc322978279e491d3f7f8754857cfe5b72e2839f5983f5a3acb47"} Jun 02 15:09:42.283678 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.283613 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" event={"ID":"87829040-0b55-4e0c-bee5-95b95bc8d9b7","Type":"ContainerStarted","Data":"094522aac9175d3144ebc88872a9ae14b527743fcc6bf9bec3674f34ddf72c1a"} Jun 02 15:09:42.283678 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.283628 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" event={"ID":"87829040-0b55-4e0c-bee5-95b95bc8d9b7","Type":"ContainerStarted","Data":"92ac72c7b783576ee05197db84238633691952fdd53d6588a59a5cb142d66a07"} Jun 02 15:09:42.283678 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.283641 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" event={"ID":"87829040-0b55-4e0c-bee5-95b95bc8d9b7","Type":"ContainerDied","Data":"5c5e27a9193719f4cf555ff661c33ee63f9bc3f11c35c73a68eb2176b436d1ff"} Jun 02 15:09:42.283678 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.283656 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" event={"ID":"87829040-0b55-4e0c-bee5-95b95bc8d9b7","Type":"ContainerStarted","Data":"2f22f776757c2e90c844b8e779da83b346f4e0fc80ae338305c262c62797ceb6"} Jun 02 15:09:42.287463 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.287415 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kxx6p" podStartSLOduration=4.007616101 podStartE2EDuration="22.287399702s" podCreationTimestamp="2026-06-02 15:09:20 +0000 UTC" firstStartedPulling="2026-06-02 15:09:22.865669081 +0000 UTC m=+3.177516038" lastFinishedPulling="2026-06-02 15:09:41.145452669 +0000 UTC m=+21.457299639" observedRunningTime="2026-06-02 15:09:42.287120185 +0000 UTC m=+22.598967166" watchObservedRunningTime="2026-06-02 15:09:42.287399702 +0000 UTC m=+22.599246683" Jun 02 15:09:42.306887 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.306836 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-vwvx6" podStartSLOduration=4.007188406 podStartE2EDuration="22.30682188s" podCreationTimestamp="2026-06-02 15:09:20 +0000 UTC" firstStartedPulling="2026-06-02 15:09:22.861820907 +0000 UTC m=+3.173667865" lastFinishedPulling="2026-06-02 15:09:41.161454373 +0000 UTC m=+21.473301339" observedRunningTime="2026-06-02 15:09:42.305364795 +0000 UTC m=+22.617211774" watchObservedRunningTime="2026-06-02 15:09:42.30682188 +0000 UTC m=+22.618668859" Jun 02 15:09:42.321527 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.321486 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xlwcz" podStartSLOduration=8.705273071 podStartE2EDuration="22.321473902s" podCreationTimestamp="2026-06-02 15:09:20 +0000 UTC" firstStartedPulling="2026-06-02 15:09:22.855201862 +0000 UTC m=+3.167048835" lastFinishedPulling="2026-06-02 15:09:36.471402703 +0000 UTC m=+16.783249666" observedRunningTime="2026-06-02 15:09:42.321048403 +0000 UTC m=+22.632895381" watchObservedRunningTime="2026-06-02 15:09:42.321473902 +0000 UTC m=+22.633320881" Jun 02 15:09:42.338064 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.338015 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6pktc" podStartSLOduration=4.048139919 podStartE2EDuration="22.337997266s" podCreationTimestamp="2026-06-02 15:09:20 +0000 UTC" firstStartedPulling="2026-06-02 15:09:22.860747203 +0000 UTC m=+3.172594171" lastFinishedPulling="2026-06-02 15:09:41.150604558 +0000 UTC m=+21.462451518" observedRunningTime="2026-06-02 15:09:42.337391862 +0000 UTC m=+22.649238842" watchObservedRunningTime="2026-06-02 15:09:42.337997266 +0000 UTC m=+22.649844247" Jun 02 15:09:42.352868 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.352819 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-rxpl6" podStartSLOduration=8.747758623 podStartE2EDuration="22.352800274s" podCreationTimestamp="2026-06-02 15:09:20 +0000 UTC" firstStartedPulling="2026-06-02 15:09:22.866339826 +0000 UTC m=+3.178186785" lastFinishedPulling="2026-06-02 15:09:36.471381477 +0000 UTC m=+16.783228436" observedRunningTime="2026-06-02 15:09:42.352260167 +0000 UTC m=+22.664107149" watchObservedRunningTime="2026-06-02 15:09:42.352800274 +0000 UTC m=+22.664647255" Jun 02 15:09:42.413094 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:42.413070 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 15:09:43.153365 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:43.153215 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T15:09:42.413087949Z","UUID":"f0b1e5d6-54eb-4eac-9dcd-1d3427286d11","Handler":null,"Name":"","Endpoint":""} Jun 02 15:09:43.155057 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:43.155033 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 15:09:43.155057 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:43.155061 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 15:09:43.203213 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:43.203177 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:43.203404 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:43.203313 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:43.287140 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:43.287102 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" event={"ID":"aace9d41-4a30-4a64-b833-7ee1149fbd71","Type":"ContainerStarted","Data":"1d2817c9839eeecf222ec1d34954f9b9851af3286e002abc6457bd168633e64e"} Jun 02 15:09:43.289653 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:43.289624 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bhvm8" event={"ID":"f1488ed1-7f01-4ac2-bbb3-257b1c85e7ea","Type":"ContainerStarted","Data":"470abfb575ffe0b53afe65f1e7a896ff12da90f6347e4659ee27b8fc4ea6446d"} Jun 02 15:09:43.304932 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:43.304864 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bhvm8" podStartSLOduration=5.022074858 podStartE2EDuration="23.304843169s" podCreationTimestamp="2026-06-02 15:09:20 +0000 UTC" firstStartedPulling="2026-06-02 15:09:22.863072262 +0000 UTC m=+3.174919219" lastFinishedPulling="2026-06-02 15:09:41.145840558 +0000 UTC m=+21.457687530" observedRunningTime="2026-06-02 15:09:43.304335754 +0000 UTC m=+23.616182735" watchObservedRunningTime="2026-06-02 15:09:43.304843169 +0000 UTC m=+23.616690149" Jun 02 15:09:44.202867 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:44.202638 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:44.203290 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:44.202706 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:44.203290 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:44.202989 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:44.203290 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:44.203074 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:44.292653 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:44.292617 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" event={"ID":"aace9d41-4a30-4a64-b833-7ee1149fbd71","Type":"ContainerStarted","Data":"177dfd40fe0c270cb46a5327f29aa67dacce21984b3ad26ab0a7052775a85ecd"} Jun 02 15:09:44.295201 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:44.295176 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-acl-logging/0.log" Jun 02 15:09:44.295487 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:44.295467 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" event={"ID":"87829040-0b55-4e0c-bee5-95b95bc8d9b7","Type":"ContainerStarted","Data":"c0e5c2e623ced14a88178b5a84a04d2eaba43caebbd2c590472c7887281afa9d"} Jun 02 15:09:44.312259 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:44.312202 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n47hw" podStartSLOduration=3.915391866 podStartE2EDuration="24.312188517s" podCreationTimestamp="2026-06-02 15:09:20 +0000 UTC" firstStartedPulling="2026-06-02 15:09:22.865990325 +0000 UTC m=+3.177837286" lastFinishedPulling="2026-06-02 15:09:43.262786978 +0000 UTC m=+23.574633937" observedRunningTime="2026-06-02 15:09:44.310749935 +0000 UTC m=+24.622596940" watchObservedRunningTime="2026-06-02 15:09:44.312188517 +0000 UTC m=+24.624035495" Jun 02 15:09:45.202519 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:45.202482 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:45.202717 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:45.202616 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:46.203051 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:46.202970 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:46.203852 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:46.202977 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:46.203852 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:46.203096 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:46.203852 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:46.203146 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:46.301720 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:46.301686 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-acl-logging/0.log" Jun 02 15:09:46.302041 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:46.302005 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" event={"ID":"87829040-0b55-4e0c-bee5-95b95bc8d9b7","Type":"ContainerStarted","Data":"44d4051c22eb5e88dd6b9eed40916c63cb63bfa1408fa1e1144c1277f4acae68"} Jun 02 15:09:46.302394 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:46.302371 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:46.302504 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:46.302433 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:46.302504 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:46.302449 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:46.302665 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:46.302647 2565 scope.go:117] "RemoveContainer" containerID="5c5e27a9193719f4cf555ff661c33ee63f9bc3f11c35c73a68eb2176b436d1ff" Jun 02 15:09:46.322405 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:46.322174 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:46.325029 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:46.325006 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:09:46.718472 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:46.718421 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xlwcz" Jun 02 15:09:46.719265 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:46.719223 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xlwcz" Jun 02 15:09:47.202358 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:47.202322 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:47.202535 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:47.202451 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:47.309199 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:47.309159 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-acl-logging/0.log" Jun 02 15:09:47.310462 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:47.310430 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" event={"ID":"87829040-0b55-4e0c-bee5-95b95bc8d9b7","Type":"ContainerStarted","Data":"93bf90c987de226e34c9ac74d10785264dc86ab2367c34be8af984fe377323d7"} Jun 02 15:09:47.310645 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:47.310483 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xlwcz" Jun 02 15:09:47.311055 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:47.311021 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xlwcz" Jun 02 15:09:47.358830 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:47.358762 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" podStartSLOduration=9.009185142 podStartE2EDuration="27.358746365s" podCreationTimestamp="2026-06-02 15:09:20 +0000 UTC" firstStartedPulling="2026-06-02 15:09:22.860291293 +0000 UTC m=+3.172138257" lastFinishedPulling="2026-06-02 15:09:41.209852516 +0000 UTC m=+21.521699480" observedRunningTime="2026-06-02 15:09:47.357690751 +0000 UTC m=+27.669537731" watchObservedRunningTime="2026-06-02 15:09:47.358746365 +0000 UTC m=+27.670593344" Jun 02 15:09:48.115965 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:48.115927 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b9dfl"] Jun 02 15:09:48.116180 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:48.116087 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:48.116240 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:48.116207 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:48.116672 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:48.116650 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vvmdt"] Jun 02 15:09:48.116753 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:48.116740 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:48.116860 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:48.116837 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:48.117954 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:48.117917 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5zchl"] Jun 02 15:09:48.118070 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:48.118022 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:48.118128 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:48.118091 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:49.202956 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:49.202859 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:49.203382 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:49.202967 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:49.203382 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:49.203032 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:49.203382 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:49.203160 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:49.314481 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:49.314449 2565 generic.go:358] "Generic (PLEG): container finished" podID="618ed771-f69b-4815-8098-7ea7650b2584" containerID="eea347d027cffc04208f41f7bdbc1ad6e221571a0a3a1b69f8abe7a43af4ccd6" exitCode=0 Jun 02 15:09:49.314681 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:49.314504 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nzcf" event={"ID":"618ed771-f69b-4815-8098-7ea7650b2584","Type":"ContainerDied","Data":"eea347d027cffc04208f41f7bdbc1ad6e221571a0a3a1b69f8abe7a43af4ccd6"} Jun 02 15:09:50.203606 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:50.203371 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:50.203969 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:50.203624 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:51.203017 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:51.202979 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:51.203196 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:51.203094 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:51.203196 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:51.203148 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:51.203269 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:51.203243 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:51.319723 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:51.319691 2565 generic.go:358] "Generic (PLEG): container finished" podID="618ed771-f69b-4815-8098-7ea7650b2584" containerID="f304f679fa76501b1a863e34a4da7090816fd6b972b28d610b30e164bb929c29" exitCode=0 Jun 02 15:09:51.319723 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:51.319731 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nzcf" event={"ID":"618ed771-f69b-4815-8098-7ea7650b2584","Type":"ContainerDied","Data":"f304f679fa76501b1a863e34a4da7090816fd6b972b28d610b30e164bb929c29"} Jun 02 15:09:52.202819 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:52.202777 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:52.202988 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:52.202890 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:53.203090 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:53.203051 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:53.203550 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:53.203051 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:53.203550 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:53.203191 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9dfl" podUID="9b4c9ae9-da6d-4818-ab9e-a67012f72b1d" Jun 02 15:09:53.203550 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:53.203226 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zchl" podUID="328e943b-3cb8-4452-9993-cb87775a3698" Jun 02 15:09:53.326590 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:53.326541 2565 generic.go:358] "Generic (PLEG): container finished" podID="618ed771-f69b-4815-8098-7ea7650b2584" containerID="7464e2a74a905af192310154f46efc423b22654342e4b67e6ab878203d6b730a" exitCode=0 Jun 02 15:09:53.326760 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:53.326622 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nzcf" event={"ID":"618ed771-f69b-4815-8098-7ea7650b2584","Type":"ContainerDied","Data":"7464e2a74a905af192310154f46efc423b22654342e4b67e6ab878203d6b730a"} Jun 02 15:09:53.832434 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:53.832395 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs\") pod \"network-metrics-daemon-b9dfl\" (UID: \"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d\") " pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:53.832632 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:53.832543 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:53.832632 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:53.832628 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs podName:9b4c9ae9-da6d-4818-ab9e-a67012f72b1d nodeName:}" failed. No retries permitted until 2026-06-02 15:10:25.832613304 +0000 UTC m=+66.144460268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs") pod "network-metrics-daemon-b9dfl" (UID: "9b4c9ae9-da6d-4818-ab9e-a67012f72b1d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:53.933686 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:53.933648 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j575v\" (UniqueName: \"kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v\") pod \"network-check-target-5zchl\" (UID: \"328e943b-3cb8-4452-9993-cb87775a3698\") " pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:53.933854 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:53.933838 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:09:53.933915 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:53.933860 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:09:53.933915 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:53.933870 2565 projected.go:194] Error preparing data for projected volume kube-api-access-j575v for pod openshift-network-diagnostics/network-check-target-5zchl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:53.933974 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:53.933931 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v podName:328e943b-3cb8-4452-9993-cb87775a3698 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:25.933911419 +0000 UTC m=+66.245758378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j575v" (UniqueName: "kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v") pod "network-check-target-5zchl" (UID: "328e943b-3cb8-4452-9993-cb87775a3698") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:54.203032 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:54.202950 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:54.203202 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:54.203076 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvmdt" podUID="45a8a35d-8eca-4e5c-ac40-9752b116226e" Jun 02 15:09:55.069814 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.069787 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-77.ec2.internal" event="NodeReady" Jun 02 15:09:55.069982 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.069925 2565 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 15:09:55.152243 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.152206 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-frjk8"] Jun 02 15:09:55.173914 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.173880 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dfdxt"] Jun 02 15:09:55.174091 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.174059 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:55.177632 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.177113 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 15:09:55.177632 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.177173 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4fhjl\"" Jun 02 15:09:55.177632 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.177278 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 15:09:55.190009 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.189966 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dfdxt"] Jun 02 15:09:55.190009 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.190005 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-frjk8"] Jun 02 15:09:55.190219 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.190126 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:09:55.192952 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.192930 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 15:09:55.193741 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.193719 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 15:09:55.193838 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.193806 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 15:09:55.193976 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.193960 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-htsn8\"" Jun 02 15:09:55.202350 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.202328 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:09:55.202446 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.202329 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:09:55.205674 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.205643 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 15:09:55.205674 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.205657 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fnhpd\"" Jun 02 15:09:55.206087 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.205856 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 15:09:55.206536 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.206518 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f4btz\"" Jun 02 15:09:55.206665 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.206519 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 15:09:55.245143 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.245103 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr6kd\" (UniqueName: \"kubernetes.io/projected/33d76fef-113f-48b8-992c-fd381b37c57b-kube-api-access-lr6kd\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:55.245143 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.245144 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert\") pod \"ingress-canary-dfdxt\" (UID: \"9ac0a463-e368-474d-a22b-d8dd24084eb1\") " pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:09:55.245391 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.245220 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vwmv\" (UniqueName: \"kubernetes.io/projected/9ac0a463-e368-474d-a22b-d8dd24084eb1-kube-api-access-7vwmv\") pod \"ingress-canary-dfdxt\" (UID: \"9ac0a463-e368-474d-a22b-d8dd24084eb1\") " pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:09:55.245391 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.245267 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33d76fef-113f-48b8-992c-fd381b37c57b-config-volume\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:55.245391 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.245328 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:55.245391 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.245352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d76fef-113f-48b8-992c-fd381b37c57b-tmp-dir\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:55.347240 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.347031 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33d76fef-113f-48b8-992c-fd381b37c57b-config-volume\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:55.347240 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.347201 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:55.347531 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.347245 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d76fef-113f-48b8-992c-fd381b37c57b-tmp-dir\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:55.347531 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.347381 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lr6kd\" (UniqueName: \"kubernetes.io/projected/33d76fef-113f-48b8-992c-fd381b37c57b-kube-api-access-lr6kd\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:55.347531 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.347424 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert\") pod \"ingress-canary-dfdxt\" (UID: \"9ac0a463-e368-474d-a22b-d8dd24084eb1\") " pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:09:55.347531 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.347466 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vwmv\" (UniqueName: \"kubernetes.io/projected/9ac0a463-e368-474d-a22b-d8dd24084eb1-kube-api-access-7vwmv\") pod \"ingress-canary-dfdxt\" (UID: \"9ac0a463-e368-474d-a22b-d8dd24084eb1\") " pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:09:55.348078 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.348054 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33d76fef-113f-48b8-992c-fd381b37c57b-config-volume\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:55.348178 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:55.348137 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:09:55.348228 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:55.348202 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert podName:9ac0a463-e368-474d-a22b-d8dd24084eb1 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:55.848182404 +0000 UTC m=+36.160029376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert") pod "ingress-canary-dfdxt" (UID: "9ac0a463-e368-474d-a22b-d8dd24084eb1") : secret "canary-serving-cert" not found Jun 02 15:09:55.348512 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:55.348493 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:09:55.348603 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:55.348597 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls podName:33d76fef-113f-48b8-992c-fd381b37c57b nodeName:}" failed. No retries permitted until 2026-06-02 15:09:55.848528925 +0000 UTC m=+36.160375886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls") pod "dns-default-frjk8" (UID: "33d76fef-113f-48b8-992c-fd381b37c57b") : secret "dns-default-metrics-tls" not found Jun 02 15:09:55.348660 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.348623 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d76fef-113f-48b8-992c-fd381b37c57b-tmp-dir\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:55.359585 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.359548 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr6kd\" (UniqueName: \"kubernetes.io/projected/33d76fef-113f-48b8-992c-fd381b37c57b-kube-api-access-lr6kd\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:55.359710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.359647 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vwmv\" (UniqueName: \"kubernetes.io/projected/9ac0a463-e368-474d-a22b-d8dd24084eb1-kube-api-access-7vwmv\") pod \"ingress-canary-dfdxt\" (UID: \"9ac0a463-e368-474d-a22b-d8dd24084eb1\") " pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:09:55.853135 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.853095 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:55.853325 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:55.853164 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert\") pod \"ingress-canary-dfdxt\" (UID: \"9ac0a463-e368-474d-a22b-d8dd24084eb1\") " pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:09:55.853325 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:55.853265 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:09:55.853325 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:55.853268 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:09:55.853443 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:55.853346 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert podName:9ac0a463-e368-474d-a22b-d8dd24084eb1 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:56.853325754 +0000 UTC m=+37.165172713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert") pod "ingress-canary-dfdxt" (UID: "9ac0a463-e368-474d-a22b-d8dd24084eb1") : secret "canary-serving-cert" not found Jun 02 15:09:55.853443 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:55.853367 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls podName:33d76fef-113f-48b8-992c-fd381b37c57b nodeName:}" failed. No retries permitted until 2026-06-02 15:09:56.853357584 +0000 UTC m=+37.165204546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls") pod "dns-default-frjk8" (UID: "33d76fef-113f-48b8-992c-fd381b37c57b") : secret "dns-default-metrics-tls" not found Jun 02 15:09:56.202489 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:56.202411 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:56.205196 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:56.205175 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 15:09:56.861058 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:56.861028 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert\") pod \"ingress-canary-dfdxt\" (UID: \"9ac0a463-e368-474d-a22b-d8dd24084eb1\") " pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:09:56.861529 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:56.861090 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:56.861529 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:56.861211 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:09:56.861529 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:56.861293 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls podName:33d76fef-113f-48b8-992c-fd381b37c57b nodeName:}" failed. No retries permitted until 2026-06-02 15:09:58.861271444 +0000 UTC m=+39.173118403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls") pod "dns-default-frjk8" (UID: "33d76fef-113f-48b8-992c-fd381b37c57b") : secret "dns-default-metrics-tls" not found Jun 02 15:09:56.861529 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:56.861210 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:09:56.861529 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:56.861370 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert podName:9ac0a463-e368-474d-a22b-d8dd24084eb1 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:58.861351877 +0000 UTC m=+39.173198837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert") pod "ingress-canary-dfdxt" (UID: "9ac0a463-e368-474d-a22b-d8dd24084eb1") : secret "canary-serving-cert" not found Jun 02 15:09:57.668855 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:57.668656 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:57.671782 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:57.671755 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45a8a35d-8eca-4e5c-ac40-9752b116226e-original-pull-secret\") pod \"global-pull-secret-syncer-vvmdt\" (UID: \"45a8a35d-8eca-4e5c-ac40-9752b116226e\") " pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:57.712466 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:57.712383 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvmdt" Jun 02 15:09:57.885886 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:57.885857 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vvmdt"] Jun 02 15:09:57.890853 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:09:57.890806 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a8a35d_8eca_4e5c_ac40_9752b116226e.slice/crio-ba40138f380335abbda6b4ba45074acab41c3055867fe34781d05463c70fa6b3 WatchSource:0}: Error finding container ba40138f380335abbda6b4ba45074acab41c3055867fe34781d05463c70fa6b3: Status 404 returned error can't find the container with id ba40138f380335abbda6b4ba45074acab41c3055867fe34781d05463c70fa6b3 Jun 02 15:09:58.337638 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:58.337599 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vvmdt" event={"ID":"45a8a35d-8eca-4e5c-ac40-9752b116226e","Type":"ContainerStarted","Data":"ba40138f380335abbda6b4ba45074acab41c3055867fe34781d05463c70fa6b3"} Jun 02 15:09:58.877520 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:58.877479 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert\") pod \"ingress-canary-dfdxt\" (UID: \"9ac0a463-e368-474d-a22b-d8dd24084eb1\") " pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:09:58.877725 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:09:58.877591 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:09:58.877725 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:58.877679 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:09:58.877725 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:58.877710 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:09:58.877895 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:58.877745 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert podName:9ac0a463-e368-474d-a22b-d8dd24084eb1 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:02.877728915 +0000 UTC m=+43.189575872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert") pod "ingress-canary-dfdxt" (UID: "9ac0a463-e368-474d-a22b-d8dd24084eb1") : secret "canary-serving-cert" not found Jun 02 15:09:58.877895 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:09:58.877759 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls podName:33d76fef-113f-48b8-992c-fd381b37c57b nodeName:}" failed. No retries permitted until 2026-06-02 15:10:02.877753735 +0000 UTC m=+43.189600691 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls") pod "dns-default-frjk8" (UID: "33d76fef-113f-48b8-992c-fd381b37c57b") : secret "dns-default-metrics-tls" not found Jun 02 15:10:02.348933 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:02.348897 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nzcf" event={"ID":"618ed771-f69b-4815-8098-7ea7650b2584","Type":"ContainerStarted","Data":"bee85128df9914d8b85defb0cf20eb159af1a14f1f45e08f6cdbbbe1758facf1"} Jun 02 15:10:02.911763 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:02.911715 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert\") pod \"ingress-canary-dfdxt\" (UID: \"9ac0a463-e368-474d-a22b-d8dd24084eb1\") " pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:10:02.911983 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:02.911806 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:10:02.911983 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:02.911876 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:10:02.911983 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:02.911903 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:10:02.911983 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:02.911944 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls podName:33d76fef-113f-48b8-992c-fd381b37c57b nodeName:}" failed. No retries permitted until 2026-06-02 15:10:10.911923532 +0000 UTC m=+51.223770503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls") pod "dns-default-frjk8" (UID: "33d76fef-113f-48b8-992c-fd381b37c57b") : secret "dns-default-metrics-tls" not found Jun 02 15:10:02.911983 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:02.911970 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert podName:9ac0a463-e368-474d-a22b-d8dd24084eb1 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:10.911959684 +0000 UTC m=+51.223806647 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert") pod "ingress-canary-dfdxt" (UID: "9ac0a463-e368-474d-a22b-d8dd24084eb1") : secret "canary-serving-cert" not found Jun 02 15:10:03.353288 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:03.353255 2565 generic.go:358] "Generic (PLEG): container finished" podID="618ed771-f69b-4815-8098-7ea7650b2584" containerID="bee85128df9914d8b85defb0cf20eb159af1a14f1f45e08f6cdbbbe1758facf1" exitCode=0 Jun 02 15:10:03.353783 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:03.353334 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nzcf" event={"ID":"618ed771-f69b-4815-8098-7ea7650b2584","Type":"ContainerDied","Data":"bee85128df9914d8b85defb0cf20eb159af1a14f1f45e08f6cdbbbe1758facf1"} Jun 02 15:10:03.354755 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:03.354727 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vvmdt" event={"ID":"45a8a35d-8eca-4e5c-ac40-9752b116226e","Type":"ContainerStarted","Data":"d9c8eff23c573ffca76965a8ae0f373acd1b39d29d52a5a39998059aac5ff8b1"} Jun 02 15:10:03.395725 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:03.395662 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vvmdt" podStartSLOduration=33.195904898 podStartE2EDuration="38.395642277s" podCreationTimestamp="2026-06-02 15:09:25 +0000 UTC" firstStartedPulling="2026-06-02 15:09:57.892815521 +0000 UTC m=+38.204662480" lastFinishedPulling="2026-06-02 15:10:03.092552887 +0000 UTC m=+43.404399859" observedRunningTime="2026-06-02 15:10:03.395139556 +0000 UTC m=+43.706986536" watchObservedRunningTime="2026-06-02 15:10:03.395642277 +0000 UTC m=+43.707489256" Jun 02 15:10:04.358774 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:04.358731 2565 generic.go:358] "Generic (PLEG): container finished" podID="618ed771-f69b-4815-8098-7ea7650b2584" containerID="845f0cfc2fffd15d2f8088616873e8aec2b91bea482d42e5f8368dd2872ed7d2" exitCode=0 Jun 02 15:10:04.359200 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:04.358812 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nzcf" event={"ID":"618ed771-f69b-4815-8098-7ea7650b2584","Type":"ContainerDied","Data":"845f0cfc2fffd15d2f8088616873e8aec2b91bea482d42e5f8368dd2872ed7d2"} Jun 02 15:10:05.364038 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:05.364002 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nzcf" event={"ID":"618ed771-f69b-4815-8098-7ea7650b2584","Type":"ContainerStarted","Data":"f7220c3b4573ef766d288a87e8c50561fe4455dcd4ac43353c2ecaf695dbdf01"} Jun 02 15:10:05.387883 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:05.387830 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4nzcf" podStartSLOduration=6.634369375 podStartE2EDuration="45.387815682s" podCreationTimestamp="2026-06-02 15:09:20 +0000 UTC" firstStartedPulling="2026-06-02 15:09:22.855726658 +0000 UTC m=+3.167573615" lastFinishedPulling="2026-06-02 15:10:01.609172961 +0000 UTC m=+41.921019922" observedRunningTime="2026-06-02 15:10:05.386509776 +0000 UTC m=+45.698356755" watchObservedRunningTime="2026-06-02 15:10:05.387815682 +0000 UTC m=+45.699662660" Jun 02 15:10:10.968535 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:10.968493 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:10:10.968942 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:10.968558 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert\") pod \"ingress-canary-dfdxt\" (UID: \"9ac0a463-e368-474d-a22b-d8dd24084eb1\") " pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:10:10.968942 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:10.968670 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:10:10.968942 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:10.968672 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:10:10.968942 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:10.968741 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert podName:9ac0a463-e368-474d-a22b-d8dd24084eb1 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:26.968725381 +0000 UTC m=+67.280572338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert") pod "ingress-canary-dfdxt" (UID: "9ac0a463-e368-474d-a22b-d8dd24084eb1") : secret "canary-serving-cert" not found Jun 02 15:10:10.968942 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:10.968760 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls podName:33d76fef-113f-48b8-992c-fd381b37c57b nodeName:}" failed. No retries permitted until 2026-06-02 15:10:26.968750896 +0000 UTC m=+67.280597856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls") pod "dns-default-frjk8" (UID: "33d76fef-113f-48b8-992c-fd381b37c57b") : secret "dns-default-metrics-tls" not found Jun 02 15:10:18.328802 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:18.328770 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6xmhn" Jun 02 15:10:25.874294 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:25.874250 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs\") pod \"network-metrics-daemon-b9dfl\" (UID: \"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d\") " pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:10:25.877768 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:25.877748 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 15:10:25.885026 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:25.884993 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 15:10:25.885132 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:25.885084 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs podName:9b4c9ae9-da6d-4818-ab9e-a67012f72b1d nodeName:}" failed. No retries permitted until 2026-06-02 15:11:29.885064896 +0000 UTC m=+130.196911853 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs") pod "network-metrics-daemon-b9dfl" (UID: "9b4c9ae9-da6d-4818-ab9e-a67012f72b1d") : secret "metrics-daemon-secret" not found Jun 02 15:10:25.975162 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:25.975119 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j575v\" (UniqueName: \"kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v\") pod \"network-check-target-5zchl\" (UID: \"328e943b-3cb8-4452-9993-cb87775a3698\") " pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:10:25.978257 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:25.978237 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 15:10:25.988209 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:25.988188 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 15:10:25.999587 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:25.999534 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j575v\" (UniqueName: \"kubernetes.io/projected/328e943b-3cb8-4452-9993-cb87775a3698-kube-api-access-j575v\") pod \"network-check-target-5zchl\" (UID: \"328e943b-3cb8-4452-9993-cb87775a3698\") " pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:10:26.116663 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:26.116629 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f4btz\"" Jun 02 15:10:26.124116 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:26.124089 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:10:26.248700 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:26.248664 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5zchl"] Jun 02 15:10:26.251901 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:10:26.251867 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod328e943b_3cb8_4452_9993_cb87775a3698.slice/crio-494b8781c9d84995d72ae3d9acce0f35514d963f0e2b3beaffbaf242e174c253 WatchSource:0}: Error finding container 494b8781c9d84995d72ae3d9acce0f35514d963f0e2b3beaffbaf242e174c253: Status 404 returned error can't find the container with id 494b8781c9d84995d72ae3d9acce0f35514d963f0e2b3beaffbaf242e174c253 Jun 02 15:10:26.403873 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:26.403782 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5zchl" event={"ID":"328e943b-3cb8-4452-9993-cb87775a3698","Type":"ContainerStarted","Data":"494b8781c9d84995d72ae3d9acce0f35514d963f0e2b3beaffbaf242e174c253"} Jun 02 15:10:26.981114 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:26.981070 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:10:26.981597 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:26.981133 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert\") pod \"ingress-canary-dfdxt\" (UID: \"9ac0a463-e368-474d-a22b-d8dd24084eb1\") " pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:10:26.981597 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:26.981234 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:10:26.981597 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:26.981255 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:10:26.981597 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:26.981296 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert podName:9ac0a463-e368-474d-a22b-d8dd24084eb1 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:58.981279729 +0000 UTC m=+99.293126686 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert") pod "ingress-canary-dfdxt" (UID: "9ac0a463-e368-474d-a22b-d8dd24084eb1") : secret "canary-serving-cert" not found Jun 02 15:10:26.981597 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:26.981364 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls podName:33d76fef-113f-48b8-992c-fd381b37c57b nodeName:}" failed. No retries permitted until 2026-06-02 15:10:58.981342174 +0000 UTC m=+99.293189144 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls") pod "dns-default-frjk8" (UID: "33d76fef-113f-48b8-992c-fd381b37c57b") : secret "dns-default-metrics-tls" not found Jun 02 15:10:30.414718 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:30.414682 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5zchl" event={"ID":"328e943b-3cb8-4452-9993-cb87775a3698","Type":"ContainerStarted","Data":"34dde7f77f13579d8ed3cc5316117311a96818bf8559668e3b676b0f1d2e7006"} Jun 02 15:10:30.415137 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:30.414835 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:10:30.435214 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:30.435160 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5zchl" podStartSLOduration=66.830595302 podStartE2EDuration="1m10.435144521s" podCreationTimestamp="2026-06-02 15:09:20 +0000 UTC" firstStartedPulling="2026-06-02 15:10:26.253616691 +0000 UTC m=+66.565463650" lastFinishedPulling="2026-06-02 15:10:29.858165912 +0000 UTC m=+70.170012869" observedRunningTime="2026-06-02 15:10:30.434153042 +0000 UTC m=+70.746000022" watchObservedRunningTime="2026-06-02 15:10:30.435144521 +0000 UTC m=+70.746991499" Jun 02 15:10:58.994260 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:58.994216 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert\") pod \"ingress-canary-dfdxt\" (UID: \"9ac0a463-e368-474d-a22b-d8dd24084eb1\") " pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:10:58.994724 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:10:58.994273 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:10:58.994724 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:58.994366 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:10:58.994724 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:58.994387 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:10:58.994724 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:58.994429 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls podName:33d76fef-113f-48b8-992c-fd381b37c57b nodeName:}" failed. No retries permitted until 2026-06-02 15:12:02.994413671 +0000 UTC m=+163.306260628 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls") pod "dns-default-frjk8" (UID: "33d76fef-113f-48b8-992c-fd381b37c57b") : secret "dns-default-metrics-tls" not found Jun 02 15:10:58.994724 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:10:58.994449 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert podName:9ac0a463-e368-474d-a22b-d8dd24084eb1 nodeName:}" failed. No retries permitted until 2026-06-02 15:12:02.994434387 +0000 UTC m=+163.306281344 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert") pod "ingress-canary-dfdxt" (UID: "9ac0a463-e368-474d-a22b-d8dd24084eb1") : secret "canary-serving-cert" not found Jun 02 15:11:01.418479 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:01.418437 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5zchl" Jun 02 15:11:08.249611 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.249559 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq"] Jun 02 15:11:08.251501 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.251476 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" Jun 02 15:11:08.257607 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.256910 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-szfl2\"" Jun 02 15:11:08.257607 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.256955 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 15:11:08.257607 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.257090 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 15:11:08.257968 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.257949 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:11:08.279811 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.279771 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq"] Jun 02 15:11:08.357375 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.357336 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw4s9\" (UniqueName: \"kubernetes.io/projected/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-kube-api-access-rw4s9\") pod \"cluster-samples-operator-755bbf9bfb-mfwtq\" (UID: \"a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" Jun 02 15:11:08.357553 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.357389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-mfwtq\" (UID: \"a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" Jun 02 15:11:08.395089 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.395055 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-s9rmk"] Jun 02 15:11:08.396952 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.396934 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.405662 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.405638 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 15:11:08.405830 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.405727 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 15:11:08.405830 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.405760 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zxrng\"" Jun 02 15:11:08.405830 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.405775 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 15:11:08.406108 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.406095 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 15:11:08.409654 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.409632 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 15:11:08.418003 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.417974 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6"] Jun 02 15:11:08.419858 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.419838 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zdpcw"] Jun 02 15:11:08.420014 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.419998 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" Jun 02 15:11:08.421433 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.421413 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-s9rmk"] Jun 02 15:11:08.421523 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.421510 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zdpcw" Jun 02 15:11:08.431302 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.431267 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gm5ld\"" Jun 02 15:11:08.431432 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.431412 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:11:08.431551 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.431486 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 15:11:08.431551 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.431514 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-95xwx\"" Jun 02 15:11:08.431551 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.431529 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 15:11:08.431732 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.431693 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:11:08.431829 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.431811 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 15:11:08.433832 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.433816 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 15:11:08.446157 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.446124 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zdpcw"] Jun 02 15:11:08.449059 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.449034 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6"] Jun 02 15:11:08.457934 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.457909 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ab7438d-cd06-4152-8cf7-0f5478311866-serving-cert\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.458066 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.457949 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rw4s9\" (UniqueName: \"kubernetes.io/projected/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-kube-api-access-rw4s9\") pod \"cluster-samples-operator-755bbf9bfb-mfwtq\" (UID: \"a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" Jun 02 15:11:08.458066 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.457971 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce14a81f-869c-4e74-b7e1-40ea53c1e877-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-8tzc6\" (UID: \"ce14a81f-869c-4e74-b7e1-40ea53c1e877\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" Jun 02 15:11:08.458066 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.458025 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ce14a81f-869c-4e74-b7e1-40ea53c1e877-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-8tzc6\" (UID: \"ce14a81f-869c-4e74-b7e1-40ea53c1e877\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" Jun 02 15:11:08.458190 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.458070 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ab7438d-cd06-4152-8cf7-0f5478311866-tmp\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.458190 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.458109 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlfrj\" (UniqueName: \"kubernetes.io/projected/c3affaa5-5d87-4388-8c6f-00f698d7dee1-kube-api-access-tlfrj\") pod \"volume-data-source-validator-7598fd5bd-zdpcw\" (UID: \"c3affaa5-5d87-4388-8c6f-00f698d7dee1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zdpcw" Jun 02 15:11:08.458190 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.458133 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-mfwtq\" (UID: \"a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" Jun 02 15:11:08.458190 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.458155 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ab7438d-cd06-4152-8cf7-0f5478311866-service-ca-bundle\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.458190 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.458177 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzkcx\" (UniqueName: \"kubernetes.io/projected/ce14a81f-869c-4e74-b7e1-40ea53c1e877-kube-api-access-zzkcx\") pod \"kube-storage-version-migrator-operator-96ddc787c-8tzc6\" (UID: \"ce14a81f-869c-4e74-b7e1-40ea53c1e877\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" Jun 02 15:11:08.458392 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.458235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3ab7438d-cd06-4152-8cf7-0f5478311866-snapshots\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.458392 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:08.458257 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:11:08.458392 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.458271 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ab7438d-cd06-4152-8cf7-0f5478311866-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.458392 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:08.458323 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls podName:a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba nodeName:}" failed. No retries permitted until 2026-06-02 15:11:08.958303428 +0000 UTC m=+109.270150399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-mfwtq" (UID: "a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba") : secret "samples-operator-tls" not found Jun 02 15:11:08.458392 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.458340 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vjf7\" (UniqueName: \"kubernetes.io/projected/3ab7438d-cd06-4152-8cf7-0f5478311866-kube-api-access-6vjf7\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.465682 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.465656 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj"] Jun 02 15:11:08.467325 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.467308 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" Jun 02 15:11:08.470136 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.470112 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 15:11:08.470265 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.470152 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 15:11:08.470265 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.470259 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pm9vf\"" Jun 02 15:11:08.470756 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.470740 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:11:08.470821 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.470757 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 15:11:08.482248 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.482218 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj"] Jun 02 15:11:08.485881 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.485855 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw4s9\" (UniqueName: \"kubernetes.io/projected/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-kube-api-access-rw4s9\") pod \"cluster-samples-operator-755bbf9bfb-mfwtq\" (UID: \"a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" Jun 02 15:11:08.559158 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.559121 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ab7438d-cd06-4152-8cf7-0f5478311866-serving-cert\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.559359 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.559175 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce14a81f-869c-4e74-b7e1-40ea53c1e877-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-8tzc6\" (UID: \"ce14a81f-869c-4e74-b7e1-40ea53c1e877\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" Jun 02 15:11:08.559359 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.559298 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ce14a81f-869c-4e74-b7e1-40ea53c1e877-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-8tzc6\" (UID: \"ce14a81f-869c-4e74-b7e1-40ea53c1e877\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" Jun 02 15:11:08.559481 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.559345 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ab7438d-cd06-4152-8cf7-0f5478311866-tmp\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.559481 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.559410 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tlfrj\" (UniqueName: \"kubernetes.io/projected/c3affaa5-5d87-4388-8c6f-00f698d7dee1-kube-api-access-tlfrj\") pod \"volume-data-source-validator-7598fd5bd-zdpcw\" (UID: \"c3affaa5-5d87-4388-8c6f-00f698d7dee1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zdpcw" Jun 02 15:11:08.559481 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.559452 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ab7438d-cd06-4152-8cf7-0f5478311866-service-ca-bundle\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.559481 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.559477 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzkcx\" (UniqueName: \"kubernetes.io/projected/ce14a81f-869c-4e74-b7e1-40ea53c1e877-kube-api-access-zzkcx\") pod \"kube-storage-version-migrator-operator-96ddc787c-8tzc6\" (UID: \"ce14a81f-869c-4e74-b7e1-40ea53c1e877\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" Jun 02 15:11:08.559726 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.559609 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e-config\") pod \"service-ca-operator-69877444c-4zrdj\" (UID: \"f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" Jun 02 15:11:08.559726 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.559647 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3ab7438d-cd06-4152-8cf7-0f5478311866-snapshots\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.559726 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.559677 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ab7438d-cd06-4152-8cf7-0f5478311866-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.559726 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.559718 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vjf7\" (UniqueName: \"kubernetes.io/projected/3ab7438d-cd06-4152-8cf7-0f5478311866-kube-api-access-6vjf7\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.559912 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.559749 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e-serving-cert\") pod \"service-ca-operator-69877444c-4zrdj\" (UID: \"f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" Jun 02 15:11:08.559912 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.559789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22zq9\" (UniqueName: \"kubernetes.io/projected/f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e-kube-api-access-22zq9\") pod \"service-ca-operator-69877444c-4zrdj\" (UID: \"f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" Jun 02 15:11:08.559912 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.559809 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ab7438d-cd06-4152-8cf7-0f5478311866-tmp\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.560221 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.560061 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ab7438d-cd06-4152-8cf7-0f5478311866-service-ca-bundle\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.560383 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.560359 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3ab7438d-cd06-4152-8cf7-0f5478311866-snapshots\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.560444 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.560410 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ce14a81f-869c-4e74-b7e1-40ea53c1e877-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-8tzc6\" (UID: \"ce14a81f-869c-4e74-b7e1-40ea53c1e877\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" Jun 02 15:11:08.561025 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.560983 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ab7438d-cd06-4152-8cf7-0f5478311866-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.561880 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.561858 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce14a81f-869c-4e74-b7e1-40ea53c1e877-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-8tzc6\" (UID: \"ce14a81f-869c-4e74-b7e1-40ea53c1e877\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" Jun 02 15:11:08.561961 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.561908 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ab7438d-cd06-4152-8cf7-0f5478311866-serving-cert\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.569565 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.569537 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vjf7\" (UniqueName: \"kubernetes.io/projected/3ab7438d-cd06-4152-8cf7-0f5478311866-kube-api-access-6vjf7\") pod \"insights-operator-788bf58df5-s9rmk\" (UID: \"3ab7438d-cd06-4152-8cf7-0f5478311866\") " pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.569944 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.569915 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzkcx\" (UniqueName: \"kubernetes.io/projected/ce14a81f-869c-4e74-b7e1-40ea53c1e877-kube-api-access-zzkcx\") pod \"kube-storage-version-migrator-operator-96ddc787c-8tzc6\" (UID: \"ce14a81f-869c-4e74-b7e1-40ea53c1e877\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" Jun 02 15:11:08.570019 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.569942 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlfrj\" (UniqueName: \"kubernetes.io/projected/c3affaa5-5d87-4388-8c6f-00f698d7dee1-kube-api-access-tlfrj\") pod \"volume-data-source-validator-7598fd5bd-zdpcw\" (UID: \"c3affaa5-5d87-4388-8c6f-00f698d7dee1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zdpcw" Jun 02 15:11:08.661074 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.661003 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e-config\") pod \"service-ca-operator-69877444c-4zrdj\" (UID: \"f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" Jun 02 15:11:08.661074 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.661075 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e-serving-cert\") pod \"service-ca-operator-69877444c-4zrdj\" (UID: \"f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" Jun 02 15:11:08.661313 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.661097 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22zq9\" (UniqueName: \"kubernetes.io/projected/f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e-kube-api-access-22zq9\") pod \"service-ca-operator-69877444c-4zrdj\" (UID: \"f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" Jun 02 15:11:08.661616 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.661562 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e-config\") pod \"service-ca-operator-69877444c-4zrdj\" (UID: \"f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" Jun 02 15:11:08.663462 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.663444 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e-serving-cert\") pod \"service-ca-operator-69877444c-4zrdj\" (UID: \"f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" Jun 02 15:11:08.669636 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.669617 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22zq9\" (UniqueName: \"kubernetes.io/projected/f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e-kube-api-access-22zq9\") pod \"service-ca-operator-69877444c-4zrdj\" (UID: \"f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" Jun 02 15:11:08.705840 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.705809 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-s9rmk" Jun 02 15:11:08.728802 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.728768 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" Jun 02 15:11:08.734591 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.734552 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zdpcw" Jun 02 15:11:08.776762 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.776710 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" Jun 02 15:11:08.872805 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.872739 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-s9rmk"] Jun 02 15:11:08.877043 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:11:08.877008 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab7438d_cd06_4152_8cf7_0f5478311866.slice/crio-e766b1f2e0ea0c7f15759a2fa2990b5fe48199196c1e5549d826a2d1739fb30f WatchSource:0}: Error finding container e766b1f2e0ea0c7f15759a2fa2990b5fe48199196c1e5549d826a2d1739fb30f: Status 404 returned error can't find the container with id e766b1f2e0ea0c7f15759a2fa2990b5fe48199196c1e5549d826a2d1739fb30f Jun 02 15:11:08.895876 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.895839 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6"] Jun 02 15:11:08.898935 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:11:08.898891 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce14a81f_869c_4e74_b7e1_40ea53c1e877.slice/crio-17dc08d29feb7f48709a4285a54c69f8138ce92681d059d19b0bee2bcfd191bf WatchSource:0}: Error finding container 17dc08d29feb7f48709a4285a54c69f8138ce92681d059d19b0bee2bcfd191bf: Status 404 returned error can't find the container with id 17dc08d29feb7f48709a4285a54c69f8138ce92681d059d19b0bee2bcfd191bf Jun 02 15:11:08.917921 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.917877 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zdpcw"] Jun 02 15:11:08.921297 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:11:08.921270 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3affaa5_5d87_4388_8c6f_00f698d7dee1.slice/crio-06a34f7e1f1487abf5b6c00d7ec30b652d0b4c86995727c36818a4beabd34861 WatchSource:0}: Error finding container 06a34f7e1f1487abf5b6c00d7ec30b652d0b4c86995727c36818a4beabd34861: Status 404 returned error can't find the container with id 06a34f7e1f1487abf5b6c00d7ec30b652d0b4c86995727c36818a4beabd34861 Jun 02 15:11:08.938150 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.938115 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj"] Jun 02 15:11:08.941357 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:11:08.941326 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf850dd10_8c8c_4ba8_9d49_d20cb7f3a62e.slice/crio-ffa413388644566ab56c94ad33446523b5bdf1c22cf80a6a58a6fbdf17df29e4 WatchSource:0}: Error finding container ffa413388644566ab56c94ad33446523b5bdf1c22cf80a6a58a6fbdf17df29e4: Status 404 returned error can't find the container with id ffa413388644566ab56c94ad33446523b5bdf1c22cf80a6a58a6fbdf17df29e4 Jun 02 15:11:08.963359 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:08.963327 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-mfwtq\" (UID: \"a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" Jun 02 15:11:08.963530 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:08.963434 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:11:08.963530 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:08.963496 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls podName:a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba nodeName:}" failed. No retries permitted until 2026-06-02 15:11:09.963482405 +0000 UTC m=+110.275329362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-mfwtq" (UID: "a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba") : secret "samples-operator-tls" not found Jun 02 15:11:09.487098 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:09.487061 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" event={"ID":"ce14a81f-869c-4e74-b7e1-40ea53c1e877","Type":"ContainerStarted","Data":"17dc08d29feb7f48709a4285a54c69f8138ce92681d059d19b0bee2bcfd191bf"} Jun 02 15:11:09.488050 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:09.488023 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zdpcw" event={"ID":"c3affaa5-5d87-4388-8c6f-00f698d7dee1","Type":"ContainerStarted","Data":"06a34f7e1f1487abf5b6c00d7ec30b652d0b4c86995727c36818a4beabd34861"} Jun 02 15:11:09.489056 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:09.489033 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-s9rmk" event={"ID":"3ab7438d-cd06-4152-8cf7-0f5478311866","Type":"ContainerStarted","Data":"e766b1f2e0ea0c7f15759a2fa2990b5fe48199196c1e5549d826a2d1739fb30f"} Jun 02 15:11:09.489907 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:09.489887 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" event={"ID":"f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e","Type":"ContainerStarted","Data":"ffa413388644566ab56c94ad33446523b5bdf1c22cf80a6a58a6fbdf17df29e4"} Jun 02 15:11:09.972159 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:09.972120 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-mfwtq\" (UID: \"a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" Jun 02 15:11:09.972349 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:09.972278 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:11:09.972349 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:09.972336 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls podName:a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba nodeName:}" failed. No retries permitted until 2026-06-02 15:11:11.972318391 +0000 UTC m=+112.284165347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-mfwtq" (UID: "a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba") : secret "samples-operator-tls" not found Jun 02 15:11:11.988450 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:11.988411 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-mfwtq\" (UID: \"a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" Jun 02 15:11:11.988924 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:11.988598 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:11:11.988924 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:11.988661 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls podName:a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba nodeName:}" failed. No retries permitted until 2026-06-02 15:11:15.988646779 +0000 UTC m=+116.300493736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-mfwtq" (UID: "a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba") : secret "samples-operator-tls" not found Jun 02 15:11:13.500009 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:13.499969 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" event={"ID":"f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e","Type":"ContainerStarted","Data":"6f5cef06c7fdbd082b9e5cbe615339cd136fdce94feae366550a5f83c5c2bbbf"} Jun 02 15:11:13.501586 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:13.501539 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" event={"ID":"ce14a81f-869c-4e74-b7e1-40ea53c1e877","Type":"ContainerStarted","Data":"d877348e7630a785b4e49746d57e904af540ec56e9278e52499830acc484d661"} Jun 02 15:11:13.503321 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:13.502991 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zdpcw" event={"ID":"c3affaa5-5d87-4388-8c6f-00f698d7dee1","Type":"ContainerStarted","Data":"e1b3be9903c3193483e821837a8b724f591189ba7f6f17b9714a6284cdf6a372"} Jun 02 15:11:13.504790 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:13.504754 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-s9rmk" event={"ID":"3ab7438d-cd06-4152-8cf7-0f5478311866","Type":"ContainerStarted","Data":"843d82137a788be805bd0ff7122d6d7318bef3d40de5648b226c4887c975c3f2"} Jun 02 15:11:13.519934 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:13.519885 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" podStartSLOduration=1.7981277599999999 podStartE2EDuration="5.519870879s" podCreationTimestamp="2026-06-02 15:11:08 +0000 UTC" firstStartedPulling="2026-06-02 15:11:08.943151452 +0000 UTC m=+109.254998411" lastFinishedPulling="2026-06-02 15:11:12.664894557 +0000 UTC m=+112.976741530" observedRunningTime="2026-06-02 15:11:13.518732768 +0000 UTC m=+113.830579749" watchObservedRunningTime="2026-06-02 15:11:13.519870879 +0000 UTC m=+113.831717852" Jun 02 15:11:13.538923 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:13.538858 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-s9rmk" podStartSLOduration=1.752985625 podStartE2EDuration="5.538838646s" podCreationTimestamp="2026-06-02 15:11:08 +0000 UTC" firstStartedPulling="2026-06-02 15:11:08.879490918 +0000 UTC m=+109.191337887" lastFinishedPulling="2026-06-02 15:11:12.665343939 +0000 UTC m=+112.977190908" observedRunningTime="2026-06-02 15:11:13.537415808 +0000 UTC m=+113.849262791" watchObservedRunningTime="2026-06-02 15:11:13.538838646 +0000 UTC m=+113.850685626" Jun 02 15:11:13.552205 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:13.552151 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zdpcw" podStartSLOduration=1.812266726 podStartE2EDuration="5.552136558s" podCreationTimestamp="2026-06-02 15:11:08 +0000 UTC" firstStartedPulling="2026-06-02 15:11:08.923068568 +0000 UTC m=+109.234915529" lastFinishedPulling="2026-06-02 15:11:12.662938401 +0000 UTC m=+112.974785361" observedRunningTime="2026-06-02 15:11:13.551696897 +0000 UTC m=+113.863543876" watchObservedRunningTime="2026-06-02 15:11:13.552136558 +0000 UTC m=+113.863983537" Jun 02 15:11:13.568489 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:13.568429 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" podStartSLOduration=1.808586724 podStartE2EDuration="5.568407077s" podCreationTimestamp="2026-06-02 15:11:08 +0000 UTC" firstStartedPulling="2026-06-02 15:11:08.900967823 +0000 UTC m=+109.212814783" lastFinishedPulling="2026-06-02 15:11:12.660788173 +0000 UTC m=+112.972635136" observedRunningTime="2026-06-02 15:11:13.567341784 +0000 UTC m=+113.879188789" watchObservedRunningTime="2026-06-02 15:11:13.568407077 +0000 UTC m=+113.880254057" Jun 02 15:11:14.905905 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:14.905868 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-4skzw"] Jun 02 15:11:14.908187 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:14.908163 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4skzw" Jun 02 15:11:14.910814 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:14.910785 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 02 15:11:14.910937 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:14.910862 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tsf66\"" Jun 02 15:11:14.911897 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:14.911879 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 02 15:11:14.918526 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:14.918507 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-4skzw"] Jun 02 15:11:15.014687 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:15.014652 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l8k9\" (UniqueName: \"kubernetes.io/projected/d9fb428e-1712-485e-9b85-a5db6002b679-kube-api-access-4l8k9\") pod \"migrator-96c6f749-4skzw\" (UID: \"d9fb428e-1712-485e-9b85-a5db6002b679\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4skzw" Jun 02 15:11:15.115240 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:15.115205 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4l8k9\" (UniqueName: \"kubernetes.io/projected/d9fb428e-1712-485e-9b85-a5db6002b679-kube-api-access-4l8k9\") pod \"migrator-96c6f749-4skzw\" (UID: \"d9fb428e-1712-485e-9b85-a5db6002b679\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4skzw" Jun 02 15:11:15.126529 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:15.126491 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l8k9\" (UniqueName: \"kubernetes.io/projected/d9fb428e-1712-485e-9b85-a5db6002b679-kube-api-access-4l8k9\") pod \"migrator-96c6f749-4skzw\" (UID: \"d9fb428e-1712-485e-9b85-a5db6002b679\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4skzw" Jun 02 15:11:15.217887 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:15.217810 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4skzw" Jun 02 15:11:15.349139 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:15.349104 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-4skzw"] Jun 02 15:11:15.352048 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:11:15.352019 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9fb428e_1712_485e_9b85_a5db6002b679.slice/crio-d383d3fe7277828224a49cac8ff54564d43449ec84b545f4a65c4cec6fda8ac3 WatchSource:0}: Error finding container d383d3fe7277828224a49cac8ff54564d43449ec84b545f4a65c4cec6fda8ac3: Status 404 returned error can't find the container with id d383d3fe7277828224a49cac8ff54564d43449ec84b545f4a65c4cec6fda8ac3 Jun 02 15:11:15.512907 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:15.512815 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4skzw" event={"ID":"d9fb428e-1712-485e-9b85-a5db6002b679","Type":"ContainerStarted","Data":"d383d3fe7277828224a49cac8ff54564d43449ec84b545f4a65c4cec6fda8ac3"} Jun 02 15:11:16.023474 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:16.023433 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-mfwtq\" (UID: \"a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" Jun 02 15:11:16.023873 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:16.023557 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:11:16.023873 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:16.023638 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls podName:a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba nodeName:}" failed. No retries permitted until 2026-06-02 15:11:24.02362361 +0000 UTC m=+124.335470567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-mfwtq" (UID: "a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba") : secret "samples-operator-tls" not found Jun 02 15:11:16.102946 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:16.102914 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rxpl6_b850fa03-c11b-4f51-bd9b-fcb48c57c6c4/dns-node-resolver/0.log" Jun 02 15:11:16.701622 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:16.701599 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kxx6p_8f146772-5c11-4d4a-b181-c3a97f443e05/node-ca/0.log" Jun 02 15:11:17.520186 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:17.520153 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4skzw" event={"ID":"d9fb428e-1712-485e-9b85-a5db6002b679","Type":"ContainerStarted","Data":"a483d8a568c0058196f76d32d80e893416799576ecfd0be2e3dfb9431f758e77"} Jun 02 15:11:17.520186 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:17.520188 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4skzw" event={"ID":"d9fb428e-1712-485e-9b85-a5db6002b679","Type":"ContainerStarted","Data":"5f3ac10b3182a02b0631588b62b4b2b71889098a3de40bc8b1104a2d1f48db02"} Jun 02 15:11:17.541445 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:17.541389 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4skzw" podStartSLOduration=1.5862702309999999 podStartE2EDuration="3.541373612s" podCreationTimestamp="2026-06-02 15:11:14 +0000 UTC" firstStartedPulling="2026-06-02 15:11:15.354034543 +0000 UTC m=+115.665881499" lastFinishedPulling="2026-06-02 15:11:17.309137923 +0000 UTC m=+117.620984880" observedRunningTime="2026-06-02 15:11:17.539778589 +0000 UTC m=+117.851625568" watchObservedRunningTime="2026-06-02 15:11:17.541373612 +0000 UTC m=+117.853220591" Jun 02 15:11:24.084050 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:24.084000 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-mfwtq\" (UID: \"a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" Jun 02 15:11:24.086631 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:24.086598 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-mfwtq\" (UID: \"a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" Jun 02 15:11:24.165307 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:24.165276 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-szfl2\"" Jun 02 15:11:24.173447 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:24.173421 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" Jun 02 15:11:24.298743 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:24.298708 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq"] Jun 02 15:11:24.538899 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:24.538865 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" event={"ID":"a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba","Type":"ContainerStarted","Data":"baf4448ed9dc9dd4911bfa94aa632cf10249d2d1eefdeb98caeea4db9e9fdc03"} Jun 02 15:11:27.548937 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:27.548904 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" event={"ID":"a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba","Type":"ContainerStarted","Data":"5bd54e47745604dabafeea648af95473225afefde5fb7414609d3493eef4ba29"} Jun 02 15:11:27.548937 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:27.548940 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" event={"ID":"a2ef1f04-0ce6-4d3f-9ceb-bede7a9f08ba","Type":"ContainerStarted","Data":"b19770dac0ec4f92967b0543ec62d44c092b72e94f0f7910524d18a89aceb5f1"} Jun 02 15:11:27.576071 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:27.576024 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-mfwtq" podStartSLOduration=17.090983951 podStartE2EDuration="19.576005305s" podCreationTimestamp="2026-06-02 15:11:08 +0000 UTC" firstStartedPulling="2026-06-02 15:11:24.341326347 +0000 UTC m=+124.653173304" lastFinishedPulling="2026-06-02 15:11:26.826347686 +0000 UTC m=+127.138194658" observedRunningTime="2026-06-02 15:11:27.575254661 +0000 UTC m=+127.887101640" watchObservedRunningTime="2026-06-02 15:11:27.576005305 +0000 UTC m=+127.887852296" Jun 02 15:11:29.929107 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:29.929069 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs\") pod \"network-metrics-daemon-b9dfl\" (UID: \"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d\") " pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:11:29.931511 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:29.931480 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4c9ae9-da6d-4818-ab9e-a67012f72b1d-metrics-certs\") pod \"network-metrics-daemon-b9dfl\" (UID: \"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d\") " pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:11:30.021658 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:30.021627 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fnhpd\"" Jun 02 15:11:30.029854 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:30.029823 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9dfl" Jun 02 15:11:30.155672 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:30.155636 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b9dfl"] Jun 02 15:11:30.160342 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:11:30.160304 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b4c9ae9_da6d_4818_ab9e_a67012f72b1d.slice/crio-6217a3750d5a37ebe0af3e8dec2f3024cd17ea55ed03ca79e970799c6f37713b WatchSource:0}: Error finding container 6217a3750d5a37ebe0af3e8dec2f3024cd17ea55ed03ca79e970799c6f37713b: Status 404 returned error can't find the container with id 6217a3750d5a37ebe0af3e8dec2f3024cd17ea55ed03ca79e970799c6f37713b Jun 02 15:11:30.559503 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:30.559468 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9dfl" event={"ID":"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d","Type":"ContainerStarted","Data":"6217a3750d5a37ebe0af3e8dec2f3024cd17ea55ed03ca79e970799c6f37713b"} Jun 02 15:11:32.566833 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:32.566793 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9dfl" event={"ID":"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d","Type":"ContainerStarted","Data":"3d72799219eb1d9e92502af15502843ef9beec3857e054d5138b00b732b78f05"} Jun 02 15:11:32.566833 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:32.566828 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9dfl" event={"ID":"9b4c9ae9-da6d-4818-ab9e-a67012f72b1d","Type":"ContainerStarted","Data":"e36b225729e8dd258406bb3a1f10274fbde690cc10b83c0b42277498e3b04a84"} Jun 02 15:11:32.585155 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:32.585091 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b9dfl" podStartSLOduration=131.204176625 podStartE2EDuration="2m12.585074671s" podCreationTimestamp="2026-06-02 15:09:20 +0000 UTC" firstStartedPulling="2026-06-02 15:11:30.162943755 +0000 UTC m=+130.474790712" lastFinishedPulling="2026-06-02 15:11:31.543841801 +0000 UTC m=+131.855688758" observedRunningTime="2026-06-02 15:11:32.584722779 +0000 UTC m=+132.896569759" watchObservedRunningTime="2026-06-02 15:11:32.585074671 +0000 UTC m=+132.896921651" Jun 02 15:11:38.914490 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:38.914450 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w7tjj"] Jun 02 15:11:38.916561 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:38.916543 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:38.920004 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:38.919981 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 15:11:38.921088 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:38.921065 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vrdqv\"" Jun 02 15:11:38.921088 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:38.921079 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 15:11:38.970080 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:38.970045 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w7tjj"] Jun 02 15:11:39.003639 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.003566 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84e8b11e-9d01-4955-bc4e-5bba08f7936a-data-volume\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.003820 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.003708 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q29g8\" (UniqueName: \"kubernetes.io/projected/84e8b11e-9d01-4955-bc4e-5bba08f7936a-kube-api-access-q29g8\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.003820 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.003785 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84e8b11e-9d01-4955-bc4e-5bba08f7936a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.003820 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.003816 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84e8b11e-9d01-4955-bc4e-5bba08f7936a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.003953 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.003844 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84e8b11e-9d01-4955-bc4e-5bba08f7936a-crio-socket\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.104911 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.104871 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q29g8\" (UniqueName: \"kubernetes.io/projected/84e8b11e-9d01-4955-bc4e-5bba08f7936a-kube-api-access-q29g8\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.104911 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.104919 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84e8b11e-9d01-4955-bc4e-5bba08f7936a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.105153 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.104938 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84e8b11e-9d01-4955-bc4e-5bba08f7936a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.105153 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.104957 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84e8b11e-9d01-4955-bc4e-5bba08f7936a-crio-socket\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.105153 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.105026 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84e8b11e-9d01-4955-bc4e-5bba08f7936a-crio-socket\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.105153 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.105053 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84e8b11e-9d01-4955-bc4e-5bba08f7936a-data-volume\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.105381 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.105365 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84e8b11e-9d01-4955-bc4e-5bba08f7936a-data-volume\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.105454 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.105435 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84e8b11e-9d01-4955-bc4e-5bba08f7936a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.107395 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.107371 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84e8b11e-9d01-4955-bc4e-5bba08f7936a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.204001 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.203927 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q29g8\" (UniqueName: \"kubernetes.io/projected/84e8b11e-9d01-4955-bc4e-5bba08f7936a-kube-api-access-q29g8\") pod \"insights-runtime-extractor-w7tjj\" (UID: \"84e8b11e-9d01-4955-bc4e-5bba08f7936a\") " pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.225108 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.225064 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w7tjj" Jun 02 15:11:39.398838 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.398811 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w7tjj"] Jun 02 15:11:39.400540 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:11:39.400505 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e8b11e_9d01_4955_bc4e_5bba08f7936a.slice/crio-5d8d15288a9547b21525227e7a3f32eee51a6a14eb233aaf70e368bbfc935d97 WatchSource:0}: Error finding container 5d8d15288a9547b21525227e7a3f32eee51a6a14eb233aaf70e368bbfc935d97: Status 404 returned error can't find the container with id 5d8d15288a9547b21525227e7a3f32eee51a6a14eb233aaf70e368bbfc935d97 Jun 02 15:11:39.587774 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.587734 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7tjj" event={"ID":"84e8b11e-9d01-4955-bc4e-5bba08f7936a","Type":"ContainerStarted","Data":"22404af3d7f0e40a89966ad32d249d64e21a7d82a6f90ff78682dca9cd794ed0"} Jun 02 15:11:39.587774 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:39.587777 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7tjj" event={"ID":"84e8b11e-9d01-4955-bc4e-5bba08f7936a","Type":"ContainerStarted","Data":"5d8d15288a9547b21525227e7a3f32eee51a6a14eb233aaf70e368bbfc935d97"} Jun 02 15:11:40.592106 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:40.592068 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7tjj" event={"ID":"84e8b11e-9d01-4955-bc4e-5bba08f7936a","Type":"ContainerStarted","Data":"0b73b0ef318cff5271cfc351a40c5cc259b79f3536f91f68a1e717680fd35b84"} Jun 02 15:11:42.599590 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:42.599532 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7tjj" event={"ID":"84e8b11e-9d01-4955-bc4e-5bba08f7936a","Type":"ContainerStarted","Data":"e3ba9f2a133ddcbb636664e4db3cbe0a6df526e27be6893180beaf785a100f78"} Jun 02 15:11:42.620786 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:42.620740 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w7tjj" podStartSLOduration=2.019831971 podStartE2EDuration="4.620725588s" podCreationTimestamp="2026-06-02 15:11:38 +0000 UTC" firstStartedPulling="2026-06-02 15:11:39.458306457 +0000 UTC m=+139.770153415" lastFinishedPulling="2026-06-02 15:11:42.059200061 +0000 UTC m=+142.371047032" observedRunningTime="2026-06-02 15:11:42.619380294 +0000 UTC m=+142.931227273" watchObservedRunningTime="2026-06-02 15:11:42.620725588 +0000 UTC m=+142.932572602" Jun 02 15:11:47.235756 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.235716 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds"] Jun 02 15:11:47.238247 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.238229 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:47.240896 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.240873 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 15:11:47.241815 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.241799 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 15:11:47.241815 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.241808 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ldkjh\"" Jun 02 15:11:47.241959 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.241843 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 15:11:47.241959 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.241914 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 15:11:47.242162 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.242140 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 15:11:47.250463 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.250437 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds"] Jun 02 15:11:47.374671 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.374624 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxrx5\" (UniqueName: \"kubernetes.io/projected/04c3a471-c5f8-495a-bef9-316839649880-kube-api-access-xxrx5\") pod \"prometheus-operator-658bcd8bdf-cpdds\" (UID: \"04c3a471-c5f8-495a-bef9-316839649880\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:47.374838 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.374688 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/04c3a471-c5f8-495a-bef9-316839649880-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-cpdds\" (UID: \"04c3a471-c5f8-495a-bef9-316839649880\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:47.374838 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.374739 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04c3a471-c5f8-495a-bef9-316839649880-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-cpdds\" (UID: \"04c3a471-c5f8-495a-bef9-316839649880\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:47.374916 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.374842 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04c3a471-c5f8-495a-bef9-316839649880-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-cpdds\" (UID: \"04c3a471-c5f8-495a-bef9-316839649880\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:47.475881 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.475842 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04c3a471-c5f8-495a-bef9-316839649880-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-cpdds\" (UID: \"04c3a471-c5f8-495a-bef9-316839649880\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:47.476004 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.475888 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xxrx5\" (UniqueName: \"kubernetes.io/projected/04c3a471-c5f8-495a-bef9-316839649880-kube-api-access-xxrx5\") pod \"prometheus-operator-658bcd8bdf-cpdds\" (UID: \"04c3a471-c5f8-495a-bef9-316839649880\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:47.476004 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.475922 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/04c3a471-c5f8-495a-bef9-316839649880-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-cpdds\" (UID: \"04c3a471-c5f8-495a-bef9-316839649880\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:47.476004 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.475959 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04c3a471-c5f8-495a-bef9-316839649880-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-cpdds\" (UID: \"04c3a471-c5f8-495a-bef9-316839649880\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:47.476110 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:47.476075 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 02 15:11:47.476156 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:47.476144 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04c3a471-c5f8-495a-bef9-316839649880-prometheus-operator-tls podName:04c3a471-c5f8-495a-bef9-316839649880 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:47.976124749 +0000 UTC m=+148.287971723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/04c3a471-c5f8-495a-bef9-316839649880-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-cpdds" (UID: "04c3a471-c5f8-495a-bef9-316839649880") : secret "prometheus-operator-tls" not found Jun 02 15:11:47.476646 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.476619 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04c3a471-c5f8-495a-bef9-316839649880-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-cpdds\" (UID: \"04c3a471-c5f8-495a-bef9-316839649880\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:47.478529 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.478495 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04c3a471-c5f8-495a-bef9-316839649880-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-cpdds\" (UID: \"04c3a471-c5f8-495a-bef9-316839649880\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:47.485218 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.485191 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxrx5\" (UniqueName: \"kubernetes.io/projected/04c3a471-c5f8-495a-bef9-316839649880-kube-api-access-xxrx5\") pod \"prometheus-operator-658bcd8bdf-cpdds\" (UID: \"04c3a471-c5f8-495a-bef9-316839649880\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:47.979434 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.979386 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/04c3a471-c5f8-495a-bef9-316839649880-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-cpdds\" (UID: \"04c3a471-c5f8-495a-bef9-316839649880\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:47.982026 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:47.982003 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/04c3a471-c5f8-495a-bef9-316839649880-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-cpdds\" (UID: \"04c3a471-c5f8-495a-bef9-316839649880\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:48.146858 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:48.146811 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" Jun 02 15:11:48.275765 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:48.275688 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds"] Jun 02 15:11:48.278693 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:11:48.278667 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c3a471_c5f8_495a_bef9_316839649880.slice/crio-ad360548b0ba61d69f657ee48a57c79f6f0de9a01583eecc2474e10f49f3850a WatchSource:0}: Error finding container ad360548b0ba61d69f657ee48a57c79f6f0de9a01583eecc2474e10f49f3850a: Status 404 returned error can't find the container with id ad360548b0ba61d69f657ee48a57c79f6f0de9a01583eecc2474e10f49f3850a Jun 02 15:11:48.619671 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:48.619633 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" event={"ID":"04c3a471-c5f8-495a-bef9-316839649880","Type":"ContainerStarted","Data":"ad360548b0ba61d69f657ee48a57c79f6f0de9a01583eecc2474e10f49f3850a"} Jun 02 15:11:49.185388 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.185351 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6757cb4dd6-9ksw6"] Jun 02 15:11:49.187283 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.187260 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.191298 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.191266 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 15:11:49.191298 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.191281 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 15:11:49.191298 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.191294 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 15:11:49.192306 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.192288 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vzncx\"" Jun 02 15:11:49.192405 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.192373 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 15:11:49.192461 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.192374 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 15:11:49.192815 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.192798 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 15:11:49.193392 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.193367 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 15:11:49.202414 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.202008 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 15:11:49.206239 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.206211 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6757cb4dd6-9ksw6"] Jun 02 15:11:49.288709 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.288671 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-console-config\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.289169 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.288738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-service-ca\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.289169 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.288856 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-oauth-serving-cert\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.289169 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.288917 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37b7e779-6f0b-4673-8a67-341432b6da0d-console-serving-cert\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.289169 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.288943 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-trusted-ca-bundle\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.289169 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.288978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs7d2\" (UniqueName: \"kubernetes.io/projected/37b7e779-6f0b-4673-8a67-341432b6da0d-kube-api-access-hs7d2\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.289169 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.289003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37b7e779-6f0b-4673-8a67-341432b6da0d-console-oauth-config\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.389451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.389402 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-oauth-serving-cert\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.389451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.389454 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37b7e779-6f0b-4673-8a67-341432b6da0d-console-serving-cert\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.389754 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.389476 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-trusted-ca-bundle\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.389754 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.389505 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hs7d2\" (UniqueName: \"kubernetes.io/projected/37b7e779-6f0b-4673-8a67-341432b6da0d-kube-api-access-hs7d2\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.389754 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.389525 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37b7e779-6f0b-4673-8a67-341432b6da0d-console-oauth-config\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.389754 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.389716 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-console-config\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.389934 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.389781 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-service-ca\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.390321 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.390292 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-oauth-serving-cert\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.390482 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.390458 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-trusted-ca-bundle\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.390541 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.390477 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-service-ca\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.390649 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.390629 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-console-config\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.392198 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.392170 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37b7e779-6f0b-4673-8a67-341432b6da0d-console-oauth-config\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.392282 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.392220 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37b7e779-6f0b-4673-8a67-341432b6da0d-console-serving-cert\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.399084 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.399055 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs7d2\" (UniqueName: \"kubernetes.io/projected/37b7e779-6f0b-4673-8a67-341432b6da0d-kube-api-access-hs7d2\") pod \"console-6757cb4dd6-9ksw6\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.496889 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.496803 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:49.899096 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:49.899074 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6757cb4dd6-9ksw6"] Jun 02 15:11:49.901246 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:11:49.901220 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37b7e779_6f0b_4673_8a67_341432b6da0d.slice/crio-0a131fda29e1a30f550f8717ecb0876d2c0bf6b4d07d3e8ae8b9f3e6c645793f WatchSource:0}: Error finding container 0a131fda29e1a30f550f8717ecb0876d2c0bf6b4d07d3e8ae8b9f3e6c645793f: Status 404 returned error can't find the container with id 0a131fda29e1a30f550f8717ecb0876d2c0bf6b4d07d3e8ae8b9f3e6c645793f Jun 02 15:11:50.627209 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:50.627173 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" event={"ID":"04c3a471-c5f8-495a-bef9-316839649880","Type":"ContainerStarted","Data":"9c4b3d8ea90ddb1198fc9a4a49ab412f0b480047b9935761f2228b32353e6656"} Jun 02 15:11:50.627209 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:50.627217 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" event={"ID":"04c3a471-c5f8-495a-bef9-316839649880","Type":"ContainerStarted","Data":"8167c1b854562125361f9f44b866de047568f2eb03c7743784832980421d4198"} Jun 02 15:11:50.628436 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:50.628408 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6757cb4dd6-9ksw6" event={"ID":"37b7e779-6f0b-4673-8a67-341432b6da0d","Type":"ContainerStarted","Data":"0a131fda29e1a30f550f8717ecb0876d2c0bf6b4d07d3e8ae8b9f3e6c645793f"} Jun 02 15:11:50.646958 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:50.646896 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-cpdds" podStartSLOduration=2.139669015 podStartE2EDuration="3.64687741s" podCreationTimestamp="2026-06-02 15:11:47 +0000 UTC" firstStartedPulling="2026-06-02 15:11:48.280583064 +0000 UTC m=+148.592430036" lastFinishedPulling="2026-06-02 15:11:49.787791457 +0000 UTC m=+150.099638431" observedRunningTime="2026-06-02 15:11:50.645718402 +0000 UTC m=+150.957565417" watchObservedRunningTime="2026-06-02 15:11:50.64687741 +0000 UTC m=+150.958724392" Jun 02 15:11:52.572025 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.571991 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-2rs28"] Jun 02 15:11:52.577318 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.577298 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" Jun 02 15:11:52.580563 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.580538 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 15:11:52.580698 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.580546 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-45lx7\"" Jun 02 15:11:52.580698 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.580548 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 15:11:52.588609 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.587636 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-2rs28"] Jun 02 15:11:52.606468 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.606440 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z5qpr"] Jun 02 15:11:52.608584 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.608557 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.611477 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.611455 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 15:11:52.611655 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.611478 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 15:11:52.611712 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.611694 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-89m2r\"" Jun 02 15:11:52.611809 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.611787 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 15:11:52.635206 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.635173 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6757cb4dd6-9ksw6" event={"ID":"37b7e779-6f0b-4673-8a67-341432b6da0d","Type":"ContainerStarted","Data":"b3fee7060eb0c31a2353f6156c21f526d7b6b4d28da989cbd20c434fcbec69ec"} Jun 02 15:11:52.666468 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.666361 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6757cb4dd6-9ksw6" podStartSLOduration=1.155038775 podStartE2EDuration="3.666345849s" podCreationTimestamp="2026-06-02 15:11:49 +0000 UTC" firstStartedPulling="2026-06-02 15:11:49.903391348 +0000 UTC m=+150.215238306" lastFinishedPulling="2026-06-02 15:11:52.41469842 +0000 UTC m=+152.726545380" observedRunningTime="2026-06-02 15:11:52.665257173 +0000 UTC m=+152.977104162" watchObservedRunningTime="2026-06-02 15:11:52.666345849 +0000 UTC m=+152.978192828" Jun 02 15:11:52.716937 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.716898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-wtmp\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.716937 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.716940 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63471a61-0d20-48de-8e1e-56001ab023c9-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-2rs28\" (UID: \"63471a61-0d20-48de-8e1e-56001ab023c9\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" Jun 02 15:11:52.717142 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.716960 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-tls\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.717142 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.717011 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.717142 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.717088 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clwdm\" (UniqueName: \"kubernetes.io/projected/63471a61-0d20-48de-8e1e-56001ab023c9-kube-api-access-clwdm\") pod \"openshift-state-metrics-85658796db-2rs28\" (UID: \"63471a61-0d20-48de-8e1e-56001ab023c9\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" Jun 02 15:11:52.717142 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.717111 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnbgk\" (UniqueName: \"kubernetes.io/projected/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-kube-api-access-dnbgk\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.717284 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.717141 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-root\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.717284 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.717176 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-metrics-client-ca\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.717284 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.717206 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63471a61-0d20-48de-8e1e-56001ab023c9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-2rs28\" (UID: \"63471a61-0d20-48de-8e1e-56001ab023c9\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" Jun 02 15:11:52.717284 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.717236 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-textfile\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.717284 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.717259 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.717449 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.717305 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/63471a61-0d20-48de-8e1e-56001ab023c9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-2rs28\" (UID: \"63471a61-0d20-48de-8e1e-56001ab023c9\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" Jun 02 15:11:52.717449 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.717330 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-sys\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.818271 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818234 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-tls\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.818271 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818270 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.818510 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818296 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clwdm\" (UniqueName: \"kubernetes.io/projected/63471a61-0d20-48de-8e1e-56001ab023c9-kube-api-access-clwdm\") pod \"openshift-state-metrics-85658796db-2rs28\" (UID: \"63471a61-0d20-48de-8e1e-56001ab023c9\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" Jun 02 15:11:52.818510 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818323 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dnbgk\" (UniqueName: \"kubernetes.io/projected/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-kube-api-access-dnbgk\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.818510 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818384 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-root\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.818510 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:52.818402 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 15:11:52.818510 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818415 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-metrics-client-ca\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.818510 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:52.818476 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-tls podName:ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:53.318453469 +0000 UTC m=+153.630300434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-tls") pod "node-exporter-z5qpr" (UID: "ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9") : secret "node-exporter-tls" not found Jun 02 15:11:52.818510 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818503 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63471a61-0d20-48de-8e1e-56001ab023c9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-2rs28\" (UID: \"63471a61-0d20-48de-8e1e-56001ab023c9\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" Jun 02 15:11:52.818881 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818546 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-textfile\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.818881 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818602 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.818881 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818642 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-root\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.818881 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818738 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/63471a61-0d20-48de-8e1e-56001ab023c9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-2rs28\" (UID: \"63471a61-0d20-48de-8e1e-56001ab023c9\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" Jun 02 15:11:52.818881 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818784 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-sys\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.819093 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818883 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-wtmp\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.819093 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818914 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63471a61-0d20-48de-8e1e-56001ab023c9-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-2rs28\" (UID: \"63471a61-0d20-48de-8e1e-56001ab023c9\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" Jun 02 15:11:52.819093 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.818924 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.819233 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.819160 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-sys\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.819281 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.819270 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-wtmp\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.819353 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.819330 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-textfile\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.819891 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.819867 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-metrics-client-ca\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.820151 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.820130 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63471a61-0d20-48de-8e1e-56001ab023c9-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-2rs28\" (UID: \"63471a61-0d20-48de-8e1e-56001ab023c9\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" Jun 02 15:11:52.821778 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.821758 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/63471a61-0d20-48de-8e1e-56001ab023c9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-2rs28\" (UID: \"63471a61-0d20-48de-8e1e-56001ab023c9\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" Jun 02 15:11:52.822061 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.822043 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63471a61-0d20-48de-8e1e-56001ab023c9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-2rs28\" (UID: \"63471a61-0d20-48de-8e1e-56001ab023c9\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" Jun 02 15:11:52.822142 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.822070 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.829199 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.829177 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnbgk\" (UniqueName: \"kubernetes.io/projected/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-kube-api-access-dnbgk\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:52.829366 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.829344 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clwdm\" (UniqueName: \"kubernetes.io/projected/63471a61-0d20-48de-8e1e-56001ab023c9-kube-api-access-clwdm\") pod \"openshift-state-metrics-85658796db-2rs28\" (UID: \"63471a61-0d20-48de-8e1e-56001ab023c9\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" Jun 02 15:11:52.891440 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:52.891401 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" Jun 02 15:11:53.020507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:53.020485 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-2rs28"] Jun 02 15:11:53.022971 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:11:53.022933 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63471a61_0d20_48de_8e1e_56001ab023c9.slice/crio-741d72f40b581b2bedbdf4d06a4425af7c725c75481c3f2f116472b968b9f327 WatchSource:0}: Error finding container 741d72f40b581b2bedbdf4d06a4425af7c725c75481c3f2f116472b968b9f327: Status 404 returned error can't find the container with id 741d72f40b581b2bedbdf4d06a4425af7c725c75481c3f2f116472b968b9f327 Jun 02 15:11:53.323200 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:53.323168 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-tls\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:53.325713 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:53.325694 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9-node-exporter-tls\") pod \"node-exporter-z5qpr\" (UID: \"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9\") " pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:53.517728 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:53.517698 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z5qpr" Jun 02 15:11:53.526931 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:11:53.526888 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb5a94a_8eb3_4481_a742_a3bd5bc3ebd9.slice/crio-359553ef514ec5ed3a5c0ede003ca3418eec75f265abf4fc54c6372ff0745d78 WatchSource:0}: Error finding container 359553ef514ec5ed3a5c0ede003ca3418eec75f265abf4fc54c6372ff0745d78: Status 404 returned error can't find the container with id 359553ef514ec5ed3a5c0ede003ca3418eec75f265abf4fc54c6372ff0745d78 Jun 02 15:11:53.639869 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:53.639773 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" event={"ID":"63471a61-0d20-48de-8e1e-56001ab023c9","Type":"ContainerStarted","Data":"f35830b07a681f33dee11d7f825590ad74cc4ec500e2c392731de9fe6813fab3"} Jun 02 15:11:53.639869 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:53.639821 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" event={"ID":"63471a61-0d20-48de-8e1e-56001ab023c9","Type":"ContainerStarted","Data":"d9f18f04bb1bcb9171161fd491be31d0e06900edb65aaa87c62daeee17fcb1fe"} Jun 02 15:11:53.639869 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:53.639831 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" event={"ID":"63471a61-0d20-48de-8e1e-56001ab023c9","Type":"ContainerStarted","Data":"741d72f40b581b2bedbdf4d06a4425af7c725c75481c3f2f116472b968b9f327"} Jun 02 15:11:53.640852 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:53.640827 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z5qpr" event={"ID":"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9","Type":"ContainerStarted","Data":"359553ef514ec5ed3a5c0ede003ca3418eec75f265abf4fc54c6372ff0745d78"} Jun 02 15:11:54.646674 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:54.646634 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" event={"ID":"63471a61-0d20-48de-8e1e-56001ab023c9","Type":"ContainerStarted","Data":"2dd82a67133043e32c4949de65ae9c3f0523403afe58a4035ace2794b0d4c16a"} Jun 02 15:11:54.668475 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:54.668405 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-2rs28" podStartSLOduration=1.561985501 podStartE2EDuration="2.66836504s" podCreationTimestamp="2026-06-02 15:11:52 +0000 UTC" firstStartedPulling="2026-06-02 15:11:53.130623457 +0000 UTC m=+153.442470414" lastFinishedPulling="2026-06-02 15:11:54.237002993 +0000 UTC m=+154.548849953" observedRunningTime="2026-06-02 15:11:54.666979456 +0000 UTC m=+154.978826437" watchObservedRunningTime="2026-06-02 15:11:54.66836504 +0000 UTC m=+154.980212018" Jun 02 15:11:55.653055 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:55.653010 2565 generic.go:358] "Generic (PLEG): container finished" podID="ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9" containerID="61cfcebedb17b53ed1044fa1628cd728aaaa7e7a312877291fe685a59738a8f7" exitCode=0 Jun 02 15:11:55.653560 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:55.653108 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z5qpr" event={"ID":"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9","Type":"ContainerDied","Data":"61cfcebedb17b53ed1044fa1628cd728aaaa7e7a312877291fe685a59738a8f7"} Jun 02 15:11:56.657298 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:56.657257 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z5qpr" event={"ID":"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9","Type":"ContainerStarted","Data":"745fc4537b8450a57042f64fa934d0d96dc0d9bbd6a69e615b8d2e11ed211537"} Jun 02 15:11:56.657298 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:56.657296 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z5qpr" event={"ID":"ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9","Type":"ContainerStarted","Data":"4fef148a61bf45e4f0fa5d3562675c788fa2ec1a6bf8614720146140fa1e27fc"} Jun 02 15:11:56.677964 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:56.677911 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z5qpr" podStartSLOduration=3.430014128 podStartE2EDuration="4.677896212s" podCreationTimestamp="2026-06-02 15:11:52 +0000 UTC" firstStartedPulling="2026-06-02 15:11:53.528639572 +0000 UTC m=+153.840486529" lastFinishedPulling="2026-06-02 15:11:54.776521656 +0000 UTC m=+155.088368613" observedRunningTime="2026-06-02 15:11:56.675806467 +0000 UTC m=+156.987653445" watchObservedRunningTime="2026-06-02 15:11:56.677896212 +0000 UTC m=+156.989743191" Jun 02 15:11:58.186744 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:58.186689 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-frjk8" podUID="33d76fef-113f-48b8-992c-fd381b37c57b" Jun 02 15:11:58.200892 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:11:58.200846 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-dfdxt" podUID="9ac0a463-e368-474d-a22b-d8dd24084eb1" Jun 02 15:11:58.662675 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:58.662642 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frjk8" Jun 02 15:11:59.497118 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:59.497076 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:59.497516 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:59.497212 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:11:59.498523 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:59.498500 2565 patch_prober.go:28] interesting pod/console-6757cb4dd6-9ksw6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jun 02 15:11:59.498638 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:11:59.498552 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6757cb4dd6-9ksw6" podUID="37b7e779-6f0b-4673-8a67-341432b6da0d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jun 02 15:12:03.009189 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:03.009089 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert\") pod \"ingress-canary-dfdxt\" (UID: \"9ac0a463-e368-474d-a22b-d8dd24084eb1\") " pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:12:03.009189 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:03.009151 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:12:03.011680 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:03.011654 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33d76fef-113f-48b8-992c-fd381b37c57b-metrics-tls\") pod \"dns-default-frjk8\" (UID: \"33d76fef-113f-48b8-992c-fd381b37c57b\") " pod="openshift-dns/dns-default-frjk8" Jun 02 15:12:03.011795 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:03.011708 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ac0a463-e368-474d-a22b-d8dd24084eb1-cert\") pod \"ingress-canary-dfdxt\" (UID: \"9ac0a463-e368-474d-a22b-d8dd24084eb1\") " pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:12:03.177686 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:03.177652 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4fhjl\"" Jun 02 15:12:03.183422 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:03.183405 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frjk8" Jun 02 15:12:03.312417 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:03.312309 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-frjk8"] Jun 02 15:12:03.314939 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:12:03.314907 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33d76fef_113f_48b8_992c_fd381b37c57b.slice/crio-d3ca77024be4af012ef8c74a15c6a6e14f9edf21f4407b7bd9e06f3930427930 WatchSource:0}: Error finding container d3ca77024be4af012ef8c74a15c6a6e14f9edf21f4407b7bd9e06f3930427930: Status 404 returned error can't find the container with id d3ca77024be4af012ef8c74a15c6a6e14f9edf21f4407b7bd9e06f3930427930 Jun 02 15:12:03.678428 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:03.678389 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frjk8" event={"ID":"33d76fef-113f-48b8-992c-fd381b37c57b","Type":"ContainerStarted","Data":"d3ca77024be4af012ef8c74a15c6a6e14f9edf21f4407b7bd9e06f3930427930"} Jun 02 15:12:05.685344 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:05.685306 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frjk8" event={"ID":"33d76fef-113f-48b8-992c-fd381b37c57b","Type":"ContainerStarted","Data":"70fdf93b790658a7f906e72da9d9275e9d44635ddc32a35f4deb288ead595eea"} Jun 02 15:12:05.685344 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:05.685344 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frjk8" event={"ID":"33d76fef-113f-48b8-992c-fd381b37c57b","Type":"ContainerStarted","Data":"204f321577f8998ac956db0fa4566060ef8d35913752a2cf8ccaa3692912a286"} Jun 02 15:12:05.685801 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:05.685441 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-frjk8" Jun 02 15:12:05.706590 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:05.706525 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-frjk8" podStartSLOduration=129.056759132 podStartE2EDuration="2m10.706511894s" podCreationTimestamp="2026-06-02 15:09:55 +0000 UTC" firstStartedPulling="2026-06-02 15:12:03.316749326 +0000 UTC m=+163.628596282" lastFinishedPulling="2026-06-02 15:12:04.966502077 +0000 UTC m=+165.278349044" observedRunningTime="2026-06-02 15:12:05.70602588 +0000 UTC m=+166.017872860" watchObservedRunningTime="2026-06-02 15:12:05.706511894 +0000 UTC m=+166.018358913" Jun 02 15:12:09.498263 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:09.498221 2565 patch_prober.go:28] interesting pod/console-6757cb4dd6-9ksw6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jun 02 15:12:09.498788 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:09.498296 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6757cb4dd6-9ksw6" podUID="37b7e779-6f0b-4673-8a67-341432b6da0d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jun 02 15:12:11.202852 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:11.202814 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:12:11.205846 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:11.205824 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-htsn8\"" Jun 02 15:12:11.213770 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:11.213752 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dfdxt" Jun 02 15:12:11.341931 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:11.341903 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dfdxt"] Jun 02 15:12:11.344652 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:12:11.344626 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac0a463_e368_474d_a22b_d8dd24084eb1.slice/crio-60500ef7040900c6188c3785d34ef9583ac4c676fc26c06d2e46b0f2295c0e22 WatchSource:0}: Error finding container 60500ef7040900c6188c3785d34ef9583ac4c676fc26c06d2e46b0f2295c0e22: Status 404 returned error can't find the container with id 60500ef7040900c6188c3785d34ef9583ac4c676fc26c06d2e46b0f2295c0e22 Jun 02 15:12:11.703129 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:11.703091 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dfdxt" event={"ID":"9ac0a463-e368-474d-a22b-d8dd24084eb1","Type":"ContainerStarted","Data":"60500ef7040900c6188c3785d34ef9583ac4c676fc26c06d2e46b0f2295c0e22"} Jun 02 15:12:13.711288 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:13.711248 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dfdxt" event={"ID":"9ac0a463-e368-474d-a22b-d8dd24084eb1","Type":"ContainerStarted","Data":"04d337675415944e1ec8b1279e0c495c707c80c92e9ab627484cafa4439cbfb9"} Jun 02 15:12:13.728495 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:13.728433 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dfdxt" podStartSLOduration=137.235825733 podStartE2EDuration="2m18.728413336s" podCreationTimestamp="2026-06-02 15:09:55 +0000 UTC" firstStartedPulling="2026-06-02 15:12:11.347100393 +0000 UTC m=+171.658947350" lastFinishedPulling="2026-06-02 15:12:12.839687981 +0000 UTC m=+173.151534953" observedRunningTime="2026-06-02 15:12:13.726814872 +0000 UTC m=+174.038661851" watchObservedRunningTime="2026-06-02 15:12:13.728413336 +0000 UTC m=+174.040260314" Jun 02 15:12:15.690513 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:15.690475 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-frjk8" Jun 02 15:12:19.502088 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:19.502051 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:12:19.506237 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:19.506217 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:12:28.199795 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:28.199755 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6757cb4dd6-9ksw6"] Jun 02 15:12:28.755161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:28.755067 2565 generic.go:358] "Generic (PLEG): container finished" podID="f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e" containerID="6f5cef06c7fdbd082b9e5cbe615339cd136fdce94feae366550a5f83c5c2bbbf" exitCode=0 Jun 02 15:12:28.755340 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:28.755151 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" event={"ID":"f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e","Type":"ContainerDied","Data":"6f5cef06c7fdbd082b9e5cbe615339cd136fdce94feae366550a5f83c5c2bbbf"} Jun 02 15:12:28.755589 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:28.755546 2565 scope.go:117] "RemoveContainer" containerID="6f5cef06c7fdbd082b9e5cbe615339cd136fdce94feae366550a5f83c5c2bbbf" Jun 02 15:12:28.756539 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:28.756520 2565 generic.go:358] "Generic (PLEG): container finished" podID="3ab7438d-cd06-4152-8cf7-0f5478311866" containerID="843d82137a788be805bd0ff7122d6d7318bef3d40de5648b226c4887c975c3f2" exitCode=0 Jun 02 15:12:28.756644 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:28.756549 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-s9rmk" event={"ID":"3ab7438d-cd06-4152-8cf7-0f5478311866","Type":"ContainerDied","Data":"843d82137a788be805bd0ff7122d6d7318bef3d40de5648b226c4887c975c3f2"} Jun 02 15:12:28.756832 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:28.756816 2565 scope.go:117] "RemoveContainer" containerID="843d82137a788be805bd0ff7122d6d7318bef3d40de5648b226c4887c975c3f2" Jun 02 15:12:29.393740 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:29.393707 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-frjk8_33d76fef-113f-48b8-992c-fd381b37c57b/dns/0.log" Jun 02 15:12:29.399753 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:29.399727 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-frjk8_33d76fef-113f-48b8-992c-fd381b37c57b/kube-rbac-proxy/0.log" Jun 02 15:12:29.761107 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:29.761012 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-s9rmk" event={"ID":"3ab7438d-cd06-4152-8cf7-0f5478311866","Type":"ContainerStarted","Data":"1e26b3c356eb925a696e6f4641ccf6d018cadbf288049c45ad013e49f4ad50b0"} Jun 02 15:12:29.762631 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:29.762603 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-4zrdj" event={"ID":"f850dd10-8c8c-4ba8-9d49-d20cb7f3a62e","Type":"ContainerStarted","Data":"968268fee3babb3c327f296db5123327423f531dabbd51658deb486d0150ab26"} Jun 02 15:12:29.956369 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:29.956340 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rxpl6_b850fa03-c11b-4f51-bd9b-fcb48c57c6c4/dns-node-resolver/0.log" Jun 02 15:12:38.788740 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:38.788702 2565 generic.go:358] "Generic (PLEG): container finished" podID="ce14a81f-869c-4e74-b7e1-40ea53c1e877" containerID="d877348e7630a785b4e49746d57e904af540ec56e9278e52499830acc484d661" exitCode=0 Jun 02 15:12:38.789164 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:38.788783 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" event={"ID":"ce14a81f-869c-4e74-b7e1-40ea53c1e877","Type":"ContainerDied","Data":"d877348e7630a785b4e49746d57e904af540ec56e9278e52499830acc484d661"} Jun 02 15:12:38.789214 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:38.789172 2565 scope.go:117] "RemoveContainer" containerID="d877348e7630a785b4e49746d57e904af540ec56e9278e52499830acc484d661" Jun 02 15:12:39.793779 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:39.793743 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8tzc6" event={"ID":"ce14a81f-869c-4e74-b7e1-40ea53c1e877","Type":"ContainerStarted","Data":"c697237389dc754fb2db030076703a223403035e8ba2a4b4a491447e02fdef9f"} Jun 02 15:12:53.219984 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.219921 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6757cb4dd6-9ksw6" podUID="37b7e779-6f0b-4673-8a67-341432b6da0d" containerName="console" containerID="cri-o://b3fee7060eb0c31a2353f6156c21f526d7b6b4d28da989cbd20c434fcbec69ec" gracePeriod=15 Jun 02 15:12:53.458854 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.458832 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6757cb4dd6-9ksw6_37b7e779-6f0b-4673-8a67-341432b6da0d/console/0.log" Jun 02 15:12:53.458991 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.458902 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:12:53.507376 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.507289 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37b7e779-6f0b-4673-8a67-341432b6da0d-console-serving-cert\") pod \"37b7e779-6f0b-4673-8a67-341432b6da0d\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " Jun 02 15:12:53.507376 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.507329 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-trusted-ca-bundle\") pod \"37b7e779-6f0b-4673-8a67-341432b6da0d\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " Jun 02 15:12:53.507625 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.507383 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37b7e779-6f0b-4673-8a67-341432b6da0d-console-oauth-config\") pod \"37b7e779-6f0b-4673-8a67-341432b6da0d\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " Jun 02 15:12:53.507625 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.507493 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs7d2\" (UniqueName: \"kubernetes.io/projected/37b7e779-6f0b-4673-8a67-341432b6da0d-kube-api-access-hs7d2\") pod \"37b7e779-6f0b-4673-8a67-341432b6da0d\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " Jun 02 15:12:53.507625 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.507551 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-service-ca\") pod \"37b7e779-6f0b-4673-8a67-341432b6da0d\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " Jun 02 15:12:53.507625 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.507606 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-console-config\") pod \"37b7e779-6f0b-4673-8a67-341432b6da0d\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " Jun 02 15:12:53.507826 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.507715 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-oauth-serving-cert\") pod \"37b7e779-6f0b-4673-8a67-341432b6da0d\" (UID: \"37b7e779-6f0b-4673-8a67-341432b6da0d\") " Jun 02 15:12:53.508037 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.507833 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "37b7e779-6f0b-4673-8a67-341432b6da0d" (UID: "37b7e779-6f0b-4673-8a67-341432b6da0d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:12:53.508037 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.507943 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-service-ca" (OuterVolumeSpecName: "service-ca") pod "37b7e779-6f0b-4673-8a67-341432b6da0d" (UID: "37b7e779-6f0b-4673-8a67-341432b6da0d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:12:53.508037 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.507991 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-console-config" (OuterVolumeSpecName: "console-config") pod "37b7e779-6f0b-4673-8a67-341432b6da0d" (UID: "37b7e779-6f0b-4673-8a67-341432b6da0d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:12:53.508335 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.508233 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37b7e779-6f0b-4673-8a67-341432b6da0d" (UID: "37b7e779-6f0b-4673-8a67-341432b6da0d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:12:53.509774 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.509751 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37b7e779-6f0b-4673-8a67-341432b6da0d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37b7e779-6f0b-4673-8a67-341432b6da0d" (UID: "37b7e779-6f0b-4673-8a67-341432b6da0d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:12:53.510259 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.510237 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37b7e779-6f0b-4673-8a67-341432b6da0d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37b7e779-6f0b-4673-8a67-341432b6da0d" (UID: "37b7e779-6f0b-4673-8a67-341432b6da0d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:12:53.510259 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.510247 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37b7e779-6f0b-4673-8a67-341432b6da0d-kube-api-access-hs7d2" (OuterVolumeSpecName: "kube-api-access-hs7d2") pod "37b7e779-6f0b-4673-8a67-341432b6da0d" (UID: "37b7e779-6f0b-4673-8a67-341432b6da0d"). InnerVolumeSpecName "kube-api-access-hs7d2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:12:53.608989 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.608941 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-trusted-ca-bundle\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:12:53.608989 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.608984 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37b7e779-6f0b-4673-8a67-341432b6da0d-console-oauth-config\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:12:53.608989 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.608995 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs7d2\" (UniqueName: \"kubernetes.io/projected/37b7e779-6f0b-4673-8a67-341432b6da0d-kube-api-access-hs7d2\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:12:53.608989 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.609004 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-service-ca\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:12:53.609261 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.609013 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-console-config\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:12:53.609261 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.609021 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37b7e779-6f0b-4673-8a67-341432b6da0d-oauth-serving-cert\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:12:53.609261 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.609030 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37b7e779-6f0b-4673-8a67-341432b6da0d-console-serving-cert\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:12:53.841557 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.841526 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6757cb4dd6-9ksw6_37b7e779-6f0b-4673-8a67-341432b6da0d/console/0.log" Jun 02 15:12:53.841755 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.841594 2565 generic.go:358] "Generic (PLEG): container finished" podID="37b7e779-6f0b-4673-8a67-341432b6da0d" containerID="b3fee7060eb0c31a2353f6156c21f526d7b6b4d28da989cbd20c434fcbec69ec" exitCode=2 Jun 02 15:12:53.841755 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.841676 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6757cb4dd6-9ksw6" Jun 02 15:12:53.841755 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.841676 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6757cb4dd6-9ksw6" event={"ID":"37b7e779-6f0b-4673-8a67-341432b6da0d","Type":"ContainerDied","Data":"b3fee7060eb0c31a2353f6156c21f526d7b6b4d28da989cbd20c434fcbec69ec"} Jun 02 15:12:53.841755 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.841716 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6757cb4dd6-9ksw6" event={"ID":"37b7e779-6f0b-4673-8a67-341432b6da0d","Type":"ContainerDied","Data":"0a131fda29e1a30f550f8717ecb0876d2c0bf6b4d07d3e8ae8b9f3e6c645793f"} Jun 02 15:12:53.841755 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.841732 2565 scope.go:117] "RemoveContainer" containerID="b3fee7060eb0c31a2353f6156c21f526d7b6b4d28da989cbd20c434fcbec69ec" Jun 02 15:12:53.850296 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.850279 2565 scope.go:117] "RemoveContainer" containerID="b3fee7060eb0c31a2353f6156c21f526d7b6b4d28da989cbd20c434fcbec69ec" Jun 02 15:12:53.850604 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:12:53.850583 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3fee7060eb0c31a2353f6156c21f526d7b6b4d28da989cbd20c434fcbec69ec\": container with ID starting with b3fee7060eb0c31a2353f6156c21f526d7b6b4d28da989cbd20c434fcbec69ec not found: ID does not exist" containerID="b3fee7060eb0c31a2353f6156c21f526d7b6b4d28da989cbd20c434fcbec69ec" Jun 02 15:12:53.850667 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.850615 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fee7060eb0c31a2353f6156c21f526d7b6b4d28da989cbd20c434fcbec69ec"} err="failed to get container status \"b3fee7060eb0c31a2353f6156c21f526d7b6b4d28da989cbd20c434fcbec69ec\": rpc error: code = NotFound desc = could not find container \"b3fee7060eb0c31a2353f6156c21f526d7b6b4d28da989cbd20c434fcbec69ec\": container with ID starting with b3fee7060eb0c31a2353f6156c21f526d7b6b4d28da989cbd20c434fcbec69ec not found: ID does not exist" Jun 02 15:12:53.866203 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.866169 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6757cb4dd6-9ksw6"] Jun 02 15:12:53.870845 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:53.870821 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6757cb4dd6-9ksw6"] Jun 02 15:12:54.206391 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:12:54.206316 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37b7e779-6f0b-4673-8a67-341432b6da0d" path="/var/lib/kubelet/pods/37b7e779-6f0b-4673-8a67-341432b6da0d/volumes" Jun 02 15:13:22.027523 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.027485 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5668b5db57-69gr5"] Jun 02 15:13:22.028279 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.028252 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37b7e779-6f0b-4673-8a67-341432b6da0d" containerName="console" Jun 02 15:13:22.028279 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.028279 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="37b7e779-6f0b-4673-8a67-341432b6da0d" containerName="console" Jun 02 15:13:22.028460 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.028348 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="37b7e779-6f0b-4673-8a67-341432b6da0d" containerName="console" Jun 02 15:13:22.032523 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.032497 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.035614 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.035545 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 15:13:22.036703 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.036683 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 15:13:22.036828 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.036683 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 15:13:22.036828 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.036741 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 15:13:22.036967 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.036890 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 15:13:22.037068 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.037051 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vzncx\"" Jun 02 15:13:22.037142 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.037111 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 15:13:22.038395 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.038373 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 15:13:22.043853 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.043831 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 15:13:22.048423 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.048394 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5668b5db57-69gr5"] Jun 02 15:13:22.125977 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.125934 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-service-ca\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.126167 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.125981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/140e3027-face-4498-98a1-488a8d78fb9a-console-serving-cert\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.126167 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.126049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-trusted-ca-bundle\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.126167 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.126102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-console-config\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.126167 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.126126 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/140e3027-face-4498-98a1-488a8d78fb9a-console-oauth-config\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.126328 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.126178 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpvh9\" (UniqueName: \"kubernetes.io/projected/140e3027-face-4498-98a1-488a8d78fb9a-kube-api-access-qpvh9\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.126328 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.126199 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-oauth-serving-cert\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.226817 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.226779 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/140e3027-face-4498-98a1-488a8d78fb9a-console-oauth-config\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.227002 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.226835 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qpvh9\" (UniqueName: \"kubernetes.io/projected/140e3027-face-4498-98a1-488a8d78fb9a-kube-api-access-qpvh9\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.227002 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.226859 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-oauth-serving-cert\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.227002 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.226903 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-service-ca\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.227002 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.226924 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/140e3027-face-4498-98a1-488a8d78fb9a-console-serving-cert\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.227002 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.226944 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-trusted-ca-bundle\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.227002 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.226976 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-console-config\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.227720 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.227691 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-console-config\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.227867 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.227756 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-oauth-serving-cert\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.227867 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.227766 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-service-ca\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.228111 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.228086 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-trusted-ca-bundle\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.229686 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.229656 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/140e3027-face-4498-98a1-488a8d78fb9a-console-serving-cert\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.229686 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.229677 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/140e3027-face-4498-98a1-488a8d78fb9a-console-oauth-config\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.236528 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.236491 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpvh9\" (UniqueName: \"kubernetes.io/projected/140e3027-face-4498-98a1-488a8d78fb9a-kube-api-access-qpvh9\") pod \"console-5668b5db57-69gr5\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.349719 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.349683 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:22.481692 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.481599 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5668b5db57-69gr5"] Jun 02 15:13:22.483955 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:13:22.483916 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod140e3027_face_4498_98a1_488a8d78fb9a.slice/crio-df11c8ad11e023d26c8b514a2082051ec0f9b84b1dda6eb91ba9c051a7ea2012 WatchSource:0}: Error finding container df11c8ad11e023d26c8b514a2082051ec0f9b84b1dda6eb91ba9c051a7ea2012: Status 404 returned error can't find the container with id df11c8ad11e023d26c8b514a2082051ec0f9b84b1dda6eb91ba9c051a7ea2012 Jun 02 15:13:22.925211 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.925172 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668b5db57-69gr5" event={"ID":"140e3027-face-4498-98a1-488a8d78fb9a","Type":"ContainerStarted","Data":"d4c5049579f447e871404feca35d828fe1d314f977f8e1ff1cc838cdfd7448ba"} Jun 02 15:13:22.925211 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.925210 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668b5db57-69gr5" event={"ID":"140e3027-face-4498-98a1-488a8d78fb9a","Type":"ContainerStarted","Data":"df11c8ad11e023d26c8b514a2082051ec0f9b84b1dda6eb91ba9c051a7ea2012"} Jun 02 15:13:22.943253 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:22.943190 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5668b5db57-69gr5" podStartSLOduration=0.943173057 podStartE2EDuration="943.173057ms" podCreationTimestamp="2026-06-02 15:13:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:13:22.941457334 +0000 UTC m=+243.253304312" watchObservedRunningTime="2026-06-02 15:13:22.943173057 +0000 UTC m=+243.255020037" Jun 02 15:13:32.350841 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:32.350735 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:32.350841 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:32.350797 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:32.355613 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:32.355589 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:13:32.959713 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:13:32.959678 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:14:20.098592 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:20.098538 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-acl-logging/0.log" Jun 02 15:14:20.099113 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:20.098965 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-acl-logging/0.log" Jun 02 15:14:20.104299 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:20.104273 2565 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 15:14:32.276851 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.276818 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-569bfc8846-xrtjx"] Jun 02 15:14:32.280098 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.280081 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.292697 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.292670 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-569bfc8846-xrtjx"] Jun 02 15:14:32.376957 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.376906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d34683b-3dcf-447c-9402-cc8238bd9976-oauth-serving-cert\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.377148 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.376974 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d34683b-3dcf-447c-9402-cc8238bd9976-console-oauth-config\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.377148 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.377012 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d34683b-3dcf-447c-9402-cc8238bd9976-console-serving-cert\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.377148 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.377041 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fngl\" (UniqueName: \"kubernetes.io/projected/3d34683b-3dcf-447c-9402-cc8238bd9976-kube-api-access-2fngl\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.377148 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.377124 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d34683b-3dcf-447c-9402-cc8238bd9976-console-config\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.377306 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.377156 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d34683b-3dcf-447c-9402-cc8238bd9976-trusted-ca-bundle\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.377306 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.377188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d34683b-3dcf-447c-9402-cc8238bd9976-service-ca\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.478355 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.478311 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d34683b-3dcf-447c-9402-cc8238bd9976-console-oauth-config\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.478537 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.478368 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d34683b-3dcf-447c-9402-cc8238bd9976-console-serving-cert\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.478537 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.478400 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fngl\" (UniqueName: \"kubernetes.io/projected/3d34683b-3dcf-447c-9402-cc8238bd9976-kube-api-access-2fngl\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.478537 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.478459 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d34683b-3dcf-447c-9402-cc8238bd9976-console-config\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.478806 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.478597 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d34683b-3dcf-447c-9402-cc8238bd9976-trusted-ca-bundle\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.478806 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.478633 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d34683b-3dcf-447c-9402-cc8238bd9976-service-ca\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.478806 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.478674 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d34683b-3dcf-447c-9402-cc8238bd9976-oauth-serving-cert\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.479298 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.479273 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d34683b-3dcf-447c-9402-cc8238bd9976-console-config\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.479373 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.479333 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d34683b-3dcf-447c-9402-cc8238bd9976-service-ca\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.479545 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.479524 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d34683b-3dcf-447c-9402-cc8238bd9976-oauth-serving-cert\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.479871 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.479847 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d34683b-3dcf-447c-9402-cc8238bd9976-trusted-ca-bundle\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.481062 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.481041 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d34683b-3dcf-447c-9402-cc8238bd9976-console-oauth-config\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.481200 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.481184 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d34683b-3dcf-447c-9402-cc8238bd9976-console-serving-cert\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.488214 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.488191 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fngl\" (UniqueName: \"kubernetes.io/projected/3d34683b-3dcf-447c-9402-cc8238bd9976-kube-api-access-2fngl\") pod \"console-569bfc8846-xrtjx\" (UID: \"3d34683b-3dcf-447c-9402-cc8238bd9976\") " pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.588967 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.588926 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:32.728878 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.728822 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-569bfc8846-xrtjx"] Jun 02 15:14:32.731718 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:14:32.731688 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d34683b_3dcf_447c_9402_cc8238bd9976.slice/crio-382b17b47b5b332307363be7db5377d4bca7f3afc9cf12dc4d66fdc5504a4409 WatchSource:0}: Error finding container 382b17b47b5b332307363be7db5377d4bca7f3afc9cf12dc4d66fdc5504a4409: Status 404 returned error can't find the container with id 382b17b47b5b332307363be7db5377d4bca7f3afc9cf12dc4d66fdc5504a4409 Jun 02 15:14:32.733586 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:32.733550 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:14:33.122459 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:33.122422 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569bfc8846-xrtjx" event={"ID":"3d34683b-3dcf-447c-9402-cc8238bd9976","Type":"ContainerStarted","Data":"f2c7ea7fac032048a1eb28621865960030e9c2a597e802ac69706e5126b02c1b"} Jun 02 15:14:33.122459 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:33.122459 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569bfc8846-xrtjx" event={"ID":"3d34683b-3dcf-447c-9402-cc8238bd9976","Type":"ContainerStarted","Data":"382b17b47b5b332307363be7db5377d4bca7f3afc9cf12dc4d66fdc5504a4409"} Jun 02 15:14:33.142334 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:33.142125 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-569bfc8846-xrtjx" podStartSLOduration=1.142105532 podStartE2EDuration="1.142105532s" podCreationTimestamp="2026-06-02 15:14:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:14:33.141606274 +0000 UTC m=+313.453453247" watchObservedRunningTime="2026-06-02 15:14:33.142105532 +0000 UTC m=+313.453952508" Jun 02 15:14:42.589421 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:42.589366 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:42.589421 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:42.589423 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:42.594258 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:42.594232 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:43.155688 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:43.155659 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-569bfc8846-xrtjx" Jun 02 15:14:43.200797 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:14:43.200763 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5668b5db57-69gr5"] Jun 02 15:15:08.225825 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.225759 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5668b5db57-69gr5" podUID="140e3027-face-4498-98a1-488a8d78fb9a" containerName="console" containerID="cri-o://d4c5049579f447e871404feca35d828fe1d314f977f8e1ff1cc838cdfd7448ba" gracePeriod=15 Jun 02 15:15:08.472675 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.472652 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5668b5db57-69gr5_140e3027-face-4498-98a1-488a8d78fb9a/console/0.log" Jun 02 15:15:08.472809 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.472714 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:15:08.569452 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.569417 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-console-config\") pod \"140e3027-face-4498-98a1-488a8d78fb9a\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " Jun 02 15:15:08.569665 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.569470 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/140e3027-face-4498-98a1-488a8d78fb9a-console-serving-cert\") pod \"140e3027-face-4498-98a1-488a8d78fb9a\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " Jun 02 15:15:08.569665 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.569502 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-trusted-ca-bundle\") pod \"140e3027-face-4498-98a1-488a8d78fb9a\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " Jun 02 15:15:08.569665 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.569519 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-service-ca\") pod \"140e3027-face-4498-98a1-488a8d78fb9a\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " Jun 02 15:15:08.569665 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.569535 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-oauth-serving-cert\") pod \"140e3027-face-4498-98a1-488a8d78fb9a\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " Jun 02 15:15:08.569665 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.569551 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpvh9\" (UniqueName: \"kubernetes.io/projected/140e3027-face-4498-98a1-488a8d78fb9a-kube-api-access-qpvh9\") pod \"140e3027-face-4498-98a1-488a8d78fb9a\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " Jun 02 15:15:08.569944 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.569750 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/140e3027-face-4498-98a1-488a8d78fb9a-console-oauth-config\") pod \"140e3027-face-4498-98a1-488a8d78fb9a\" (UID: \"140e3027-face-4498-98a1-488a8d78fb9a\") " Jun 02 15:15:08.570130 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.570076 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-console-config" (OuterVolumeSpecName: "console-config") pod "140e3027-face-4498-98a1-488a8d78fb9a" (UID: "140e3027-face-4498-98a1-488a8d78fb9a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:15:08.570222 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.570144 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "140e3027-face-4498-98a1-488a8d78fb9a" (UID: "140e3027-face-4498-98a1-488a8d78fb9a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:15:08.570222 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.570175 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-service-ca" (OuterVolumeSpecName: "service-ca") pod "140e3027-face-4498-98a1-488a8d78fb9a" (UID: "140e3027-face-4498-98a1-488a8d78fb9a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:15:08.570222 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.570173 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "140e3027-face-4498-98a1-488a8d78fb9a" (UID: "140e3027-face-4498-98a1-488a8d78fb9a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:15:08.572112 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.572075 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/140e3027-face-4498-98a1-488a8d78fb9a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "140e3027-face-4498-98a1-488a8d78fb9a" (UID: "140e3027-face-4498-98a1-488a8d78fb9a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:15:08.572112 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.572083 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/140e3027-face-4498-98a1-488a8d78fb9a-kube-api-access-qpvh9" (OuterVolumeSpecName: "kube-api-access-qpvh9") pod "140e3027-face-4498-98a1-488a8d78fb9a" (UID: "140e3027-face-4498-98a1-488a8d78fb9a"). InnerVolumeSpecName "kube-api-access-qpvh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:15:08.572262 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.572149 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/140e3027-face-4498-98a1-488a8d78fb9a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "140e3027-face-4498-98a1-488a8d78fb9a" (UID: "140e3027-face-4498-98a1-488a8d78fb9a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:15:08.670796 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.670752 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/140e3027-face-4498-98a1-488a8d78fb9a-console-serving-cert\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:15:08.670796 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.670789 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-trusted-ca-bundle\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:15:08.670796 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.670804 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-service-ca\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:15:08.671045 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.670818 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-oauth-serving-cert\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:15:08.671045 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.670831 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpvh9\" (UniqueName: \"kubernetes.io/projected/140e3027-face-4498-98a1-488a8d78fb9a-kube-api-access-qpvh9\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:15:08.671045 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.670846 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/140e3027-face-4498-98a1-488a8d78fb9a-console-oauth-config\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:15:08.671045 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:08.670860 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/140e3027-face-4498-98a1-488a8d78fb9a-console-config\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:15:09.225944 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:09.225918 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5668b5db57-69gr5_140e3027-face-4498-98a1-488a8d78fb9a/console/0.log" Jun 02 15:15:09.226375 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:09.225959 2565 generic.go:358] "Generic (PLEG): container finished" podID="140e3027-face-4498-98a1-488a8d78fb9a" containerID="d4c5049579f447e871404feca35d828fe1d314f977f8e1ff1cc838cdfd7448ba" exitCode=2 Jun 02 15:15:09.226375 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:09.225999 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668b5db57-69gr5" event={"ID":"140e3027-face-4498-98a1-488a8d78fb9a","Type":"ContainerDied","Data":"d4c5049579f447e871404feca35d828fe1d314f977f8e1ff1cc838cdfd7448ba"} Jun 02 15:15:09.226375 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:09.226029 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668b5db57-69gr5" event={"ID":"140e3027-face-4498-98a1-488a8d78fb9a","Type":"ContainerDied","Data":"df11c8ad11e023d26c8b514a2082051ec0f9b84b1dda6eb91ba9c051a7ea2012"} Jun 02 15:15:09.226375 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:09.226046 2565 scope.go:117] "RemoveContainer" containerID="d4c5049579f447e871404feca35d828fe1d314f977f8e1ff1cc838cdfd7448ba" Jun 02 15:15:09.226375 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:09.226219 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668b5db57-69gr5" Jun 02 15:15:09.234894 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:09.234871 2565 scope.go:117] "RemoveContainer" containerID="d4c5049579f447e871404feca35d828fe1d314f977f8e1ff1cc838cdfd7448ba" Jun 02 15:15:09.235338 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:15:09.235306 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4c5049579f447e871404feca35d828fe1d314f977f8e1ff1cc838cdfd7448ba\": container with ID starting with d4c5049579f447e871404feca35d828fe1d314f977f8e1ff1cc838cdfd7448ba not found: ID does not exist" containerID="d4c5049579f447e871404feca35d828fe1d314f977f8e1ff1cc838cdfd7448ba" Jun 02 15:15:09.235408 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:09.235351 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4c5049579f447e871404feca35d828fe1d314f977f8e1ff1cc838cdfd7448ba"} err="failed to get container status \"d4c5049579f447e871404feca35d828fe1d314f977f8e1ff1cc838cdfd7448ba\": rpc error: code = NotFound desc = could not find container \"d4c5049579f447e871404feca35d828fe1d314f977f8e1ff1cc838cdfd7448ba\": container with ID starting with d4c5049579f447e871404feca35d828fe1d314f977f8e1ff1cc838cdfd7448ba not found: ID does not exist" Jun 02 15:15:09.251299 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:09.251270 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5668b5db57-69gr5"] Jun 02 15:15:09.256654 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:09.256627 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5668b5db57-69gr5"] Jun 02 15:15:10.206830 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:10.206794 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="140e3027-face-4498-98a1-488a8d78fb9a" path="/var/lib/kubelet/pods/140e3027-face-4498-98a1-488a8d78fb9a/volumes" Jun 02 15:15:32.483391 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.483348 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2"] Jun 02 15:15:32.483802 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.483674 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="140e3027-face-4498-98a1-488a8d78fb9a" containerName="console" Jun 02 15:15:32.483802 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.483686 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="140e3027-face-4498-98a1-488a8d78fb9a" containerName="console" Jun 02 15:15:32.483802 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.483737 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="140e3027-face-4498-98a1-488a8d78fb9a" containerName="console" Jun 02 15:15:32.486628 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.486608 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2" Jun 02 15:15:32.494597 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.490522 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 02 15:15:32.494597 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.490785 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 15:15:32.494597 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.490987 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 15:15:32.494597 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.491331 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 15:15:32.494597 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.491763 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wmjjx\"" Jun 02 15:15:32.496394 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.496366 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2"] Jun 02 15:15:32.529663 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.529627 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqmkv\" (UniqueName: \"kubernetes.io/projected/aa184b9f-10e9-4410-851f-35e992c2666f-kube-api-access-lqmkv\") pod \"managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2\" (UID: \"aa184b9f-10e9-4410-851f-35e992c2666f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2" Jun 02 15:15:32.529835 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.529690 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa184b9f-10e9-4410-851f-35e992c2666f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2\" (UID: \"aa184b9f-10e9-4410-851f-35e992c2666f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2" Jun 02 15:15:32.577367 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.577328 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl"] Jun 02 15:15:32.580659 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.580635 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.584044 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.584015 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 02 15:15:32.585033 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.585018 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 02 15:15:32.585123 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.585102 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 02 15:15:32.585226 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.585196 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 02 15:15:32.593880 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.593857 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl"] Jun 02 15:15:32.630277 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.630245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/4abad823-c598-492a-bc16-6e1d940449f9-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.630277 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.630288 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4abad823-c598-492a-bc16-6e1d940449f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.630501 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.630319 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqmkv\" (UniqueName: \"kubernetes.io/projected/aa184b9f-10e9-4410-851f-35e992c2666f-kube-api-access-lqmkv\") pod \"managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2\" (UID: \"aa184b9f-10e9-4410-851f-35e992c2666f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2" Jun 02 15:15:32.630501 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.630366 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4abad823-c598-492a-bc16-6e1d940449f9-ca\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.630501 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.630479 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4abad823-c598-492a-bc16-6e1d940449f9-hub\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.630641 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.630510 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bh5l\" (UniqueName: \"kubernetes.io/projected/4abad823-c598-492a-bc16-6e1d940449f9-kube-api-access-8bh5l\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.630641 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.630539 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4abad823-c598-492a-bc16-6e1d940449f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.630641 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.630602 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa184b9f-10e9-4410-851f-35e992c2666f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2\" (UID: \"aa184b9f-10e9-4410-851f-35e992c2666f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2" Jun 02 15:15:32.633207 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.633184 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa184b9f-10e9-4410-851f-35e992c2666f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2\" (UID: \"aa184b9f-10e9-4410-851f-35e992c2666f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2" Jun 02 15:15:32.640149 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.640122 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqmkv\" (UniqueName: \"kubernetes.io/projected/aa184b9f-10e9-4410-851f-35e992c2666f-kube-api-access-lqmkv\") pod \"managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2\" (UID: \"aa184b9f-10e9-4410-851f-35e992c2666f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2" Jun 02 15:15:32.731828 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.731786 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4abad823-c598-492a-bc16-6e1d940449f9-ca\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.732006 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.731837 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4abad823-c598-492a-bc16-6e1d940449f9-hub\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.732006 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.731861 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8bh5l\" (UniqueName: \"kubernetes.io/projected/4abad823-c598-492a-bc16-6e1d940449f9-kube-api-access-8bh5l\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.732006 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.731889 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4abad823-c598-492a-bc16-6e1d940449f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.732006 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.731948 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/4abad823-c598-492a-bc16-6e1d940449f9-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.732006 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.731991 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4abad823-c598-492a-bc16-6e1d940449f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.732737 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.732712 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/4abad823-c598-492a-bc16-6e1d940449f9-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.734637 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.734551 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4abad823-c598-492a-bc16-6e1d940449f9-hub\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.734637 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.734602 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4abad823-c598-492a-bc16-6e1d940449f9-ca\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.735066 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.735046 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4abad823-c598-492a-bc16-6e1d940449f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.735200 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.735182 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4abad823-c598-492a-bc16-6e1d940449f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.742344 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.742321 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bh5l\" (UniqueName: \"kubernetes.io/projected/4abad823-c598-492a-bc16-6e1d940449f9-kube-api-access-8bh5l\") pod \"cluster-proxy-proxy-agent-c96cd888c-xftkl\" (UID: \"4abad823-c598-492a-bc16-6e1d940449f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.809228 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.809191 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2" Jun 02 15:15:32.890291 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.890262 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" Jun 02 15:15:32.944551 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:32.944518 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2"] Jun 02 15:15:32.949297 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:15:32.948612 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa184b9f_10e9_4410_851f_35e992c2666f.slice/crio-d45b7566b2f1c4fed1f8117dd7e3a074e936ab510e975205c02d39d29efcc8d8 WatchSource:0}: Error finding container d45b7566b2f1c4fed1f8117dd7e3a074e936ab510e975205c02d39d29efcc8d8: Status 404 returned error can't find the container with id d45b7566b2f1c4fed1f8117dd7e3a074e936ab510e975205c02d39d29efcc8d8 Jun 02 15:15:33.026711 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:33.026686 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl"] Jun 02 15:15:33.029296 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:15:33.029264 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4abad823_c598_492a_bc16_6e1d940449f9.slice/crio-6156fc5c1fdc5ab53801ddb72c301b33dbee159e8a8d56a526309e8c3500bc91 WatchSource:0}: Error finding container 6156fc5c1fdc5ab53801ddb72c301b33dbee159e8a8d56a526309e8c3500bc91: Status 404 returned error can't find the container with id 6156fc5c1fdc5ab53801ddb72c301b33dbee159e8a8d56a526309e8c3500bc91 Jun 02 15:15:33.293326 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:33.293294 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" event={"ID":"4abad823-c598-492a-bc16-6e1d940449f9","Type":"ContainerStarted","Data":"6156fc5c1fdc5ab53801ddb72c301b33dbee159e8a8d56a526309e8c3500bc91"} Jun 02 15:15:33.294299 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:33.294270 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2" event={"ID":"aa184b9f-10e9-4410-851f-35e992c2666f","Type":"ContainerStarted","Data":"d45b7566b2f1c4fed1f8117dd7e3a074e936ab510e975205c02d39d29efcc8d8"} Jun 02 15:15:38.315076 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:38.315038 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" event={"ID":"4abad823-c598-492a-bc16-6e1d940449f9","Type":"ContainerStarted","Data":"30377aca04c2a4d974d1564389531214bbd97580fa07d6f233e892c12a13242f"} Jun 02 15:15:38.316242 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:38.316216 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2" event={"ID":"aa184b9f-10e9-4410-851f-35e992c2666f","Type":"ContainerStarted","Data":"7afa40ff480a39a966a6b91abb45780ef6fec3a90598b56aacb1a78ac73aada6"} Jun 02 15:15:38.331726 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:38.331664 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d7fbd76b-mhcl2" podStartSLOduration=1.717101317 podStartE2EDuration="6.33164618s" podCreationTimestamp="2026-06-02 15:15:32 +0000 UTC" firstStartedPulling="2026-06-02 15:15:32.95087479 +0000 UTC m=+373.262721752" lastFinishedPulling="2026-06-02 15:15:37.565419648 +0000 UTC m=+377.877266615" observedRunningTime="2026-06-02 15:15:38.331077323 +0000 UTC m=+378.642924315" watchObservedRunningTime="2026-06-02 15:15:38.33164618 +0000 UTC m=+378.643493163" Jun 02 15:15:41.326656 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:41.326621 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" event={"ID":"4abad823-c598-492a-bc16-6e1d940449f9","Type":"ContainerStarted","Data":"5098c5b7f5eccf86da272367c1574ea98a1d2ef7dd27919e73d5e17be1b89673"} Jun 02 15:15:41.326656 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:41.326658 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" event={"ID":"4abad823-c598-492a-bc16-6e1d940449f9","Type":"ContainerStarted","Data":"7faded3fcbfbf2b5fd303e8180569d5cc6cb9d86f7f77dc141b8dc97c98474bf"} Jun 02 15:15:41.345843 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:15:41.345791 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c96cd888c-xftkl" podStartSLOduration=1.515540613 podStartE2EDuration="9.345774501s" podCreationTimestamp="2026-06-02 15:15:32 +0000 UTC" firstStartedPulling="2026-06-02 15:15:33.031025964 +0000 UTC m=+373.342872924" lastFinishedPulling="2026-06-02 15:15:40.861259855 +0000 UTC m=+381.173106812" observedRunningTime="2026-06-02 15:15:41.344741906 +0000 UTC m=+381.656588885" watchObservedRunningTime="2026-06-02 15:15:41.345774501 +0000 UTC m=+381.657621522" Jun 02 15:16:53.565532 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.565445 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h"] Jun 02 15:16:53.567890 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.567867 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.570640 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.570616 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 15:16:53.570812 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.570795 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 15:16:53.570868 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.570845 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hpv82\"" Jun 02 15:16:53.571139 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.571124 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 15:16:53.576618 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.576600 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 15:16:53.585506 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.585479 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h"] Jun 02 15:16:53.704515 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.704473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-manifests\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.704712 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.704520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.704712 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.704626 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-tmp\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.704712 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.704660 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.704826 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.704752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-824hl\" (UniqueName: \"kubernetes.io/projected/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-kube-api-access-824hl\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.806092 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.806054 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.806257 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.806120 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-824hl\" (UniqueName: \"kubernetes.io/projected/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-kube-api-access-824hl\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.806257 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.806153 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-manifests\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.806257 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.806182 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.806257 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.806224 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-tmp\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.806642 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.806613 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-manifests\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.808775 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.808749 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-tmp\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.808881 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.808845 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.809018 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.808995 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.820018 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.819948 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-824hl\" (UniqueName: \"kubernetes.io/projected/e7ca39fb-ff88-490c-8d0b-828a531bbe0f-kube-api-access-824hl\") pod \"opendatahub-operator-controller-manager-5889c5df7b-5fh7h\" (UID: \"e7ca39fb-ff88-490c-8d0b-828a531bbe0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:53.878716 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:53.878675 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:54.028097 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:54.028074 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h"] Jun 02 15:16:54.029557 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:16:54.029523 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ca39fb_ff88_490c_8d0b_828a531bbe0f.slice/crio-443e835530452a5c569e38c7c7cbe6d417144384eaf50e4e2e01f9490db77981 WatchSource:0}: Error finding container 443e835530452a5c569e38c7c7cbe6d417144384eaf50e4e2e01f9490db77981: Status 404 returned error can't find the container with id 443e835530452a5c569e38c7c7cbe6d417144384eaf50e4e2e01f9490db77981 Jun 02 15:16:54.536339 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:54.536301 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" event={"ID":"e7ca39fb-ff88-490c-8d0b-828a531bbe0f","Type":"ContainerStarted","Data":"443e835530452a5c569e38c7c7cbe6d417144384eaf50e4e2e01f9490db77981"} Jun 02 15:16:57.548361 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:57.548321 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" event={"ID":"e7ca39fb-ff88-490c-8d0b-828a531bbe0f","Type":"ContainerStarted","Data":"f012aa930fcce28f0f08bfe850c95703f61edb5069d8c89a595403207afdad94"} Jun 02 15:16:58.554559 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:58.554522 2565 generic.go:358] "Generic (PLEG): container finished" podID="e7ca39fb-ff88-490c-8d0b-828a531bbe0f" containerID="f012aa930fcce28f0f08bfe850c95703f61edb5069d8c89a595403207afdad94" exitCode=0 Jun 02 15:16:58.554970 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:58.554613 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" event={"ID":"e7ca39fb-ff88-490c-8d0b-828a531bbe0f","Type":"ContainerDied","Data":"f012aa930fcce28f0f08bfe850c95703f61edb5069d8c89a595403207afdad94"} Jun 02 15:16:59.560147 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:59.560108 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" event={"ID":"e7ca39fb-ff88-490c-8d0b-828a531bbe0f","Type":"ContainerStarted","Data":"24fb59416d0500c93601b2ddff963375053c8e9a810890452df1d425b39b3378"} Jun 02 15:16:59.560638 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:59.560215 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:16:59.584793 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:16:59.584729 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" podStartSLOduration=1.75120673 podStartE2EDuration="6.584707745s" podCreationTimestamp="2026-06-02 15:16:53 +0000 UTC" firstStartedPulling="2026-06-02 15:16:54.033222716 +0000 UTC m=+454.345069673" lastFinishedPulling="2026-06-02 15:16:58.866723732 +0000 UTC m=+459.178570688" observedRunningTime="2026-06-02 15:16:59.582603186 +0000 UTC m=+459.894450165" watchObservedRunningTime="2026-06-02 15:16:59.584707745 +0000 UTC m=+459.896554726" Jun 02 15:17:10.565175 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:10.565144 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-5fh7h" Jun 02 15:17:13.771239 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.771201 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97"] Jun 02 15:17:13.777666 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.777641 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97" Jun 02 15:17:13.780813 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.780790 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 15:17:13.780998 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.780985 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 15:17:13.781069 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.781049 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 15:17:13.781241 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.781226 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 15:17:13.803522 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.803494 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97"] Jun 02 15:17:13.875801 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.875750 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bae4275c-6874-416e-b748-6520993540c3-tls-certs\") pod \"kube-auth-proxy-85c6f598cb-wnh97\" (UID: \"bae4275c-6874-416e-b748-6520993540c3\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97" Jun 02 15:17:13.875965 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.875806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bae4275c-6874-416e-b748-6520993540c3-tmp\") pod \"kube-auth-proxy-85c6f598cb-wnh97\" (UID: \"bae4275c-6874-416e-b748-6520993540c3\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97" Jun 02 15:17:13.875965 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.875884 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc775\" (UniqueName: \"kubernetes.io/projected/bae4275c-6874-416e-b748-6520993540c3-kube-api-access-tc775\") pod \"kube-auth-proxy-85c6f598cb-wnh97\" (UID: \"bae4275c-6874-416e-b748-6520993540c3\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97" Jun 02 15:17:13.976978 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.976939 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tc775\" (UniqueName: \"kubernetes.io/projected/bae4275c-6874-416e-b748-6520993540c3-kube-api-access-tc775\") pod \"kube-auth-proxy-85c6f598cb-wnh97\" (UID: \"bae4275c-6874-416e-b748-6520993540c3\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97" Jun 02 15:17:13.977160 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.977030 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bae4275c-6874-416e-b748-6520993540c3-tls-certs\") pod \"kube-auth-proxy-85c6f598cb-wnh97\" (UID: \"bae4275c-6874-416e-b748-6520993540c3\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97" Jun 02 15:17:13.977160 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.977062 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bae4275c-6874-416e-b748-6520993540c3-tmp\") pod \"kube-auth-proxy-85c6f598cb-wnh97\" (UID: \"bae4275c-6874-416e-b748-6520993540c3\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97" Jun 02 15:17:13.979635 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.979602 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bae4275c-6874-416e-b748-6520993540c3-tmp\") pod \"kube-auth-proxy-85c6f598cb-wnh97\" (UID: \"bae4275c-6874-416e-b748-6520993540c3\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97" Jun 02 15:17:13.979755 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:13.979724 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bae4275c-6874-416e-b748-6520993540c3-tls-certs\") pod \"kube-auth-proxy-85c6f598cb-wnh97\" (UID: \"bae4275c-6874-416e-b748-6520993540c3\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97" Jun 02 15:17:14.011504 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.011465 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc775\" (UniqueName: \"kubernetes.io/projected/bae4275c-6874-416e-b748-6520993540c3-kube-api-access-tc775\") pod \"kube-auth-proxy-85c6f598cb-wnh97\" (UID: \"bae4275c-6874-416e-b748-6520993540c3\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97" Jun 02 15:17:14.068258 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.068220 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-ks2zx"] Jun 02 15:17:14.070320 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.070302 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-ks2zx" Jun 02 15:17:14.073193 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.073171 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 02 15:17:14.073320 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.073172 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rtzvn\"" Jun 02 15:17:14.077549 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.077516 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/530fb8ca-172f-409a-a3e6-f588114b7adb-cert\") pod \"odh-model-controller-76588b95-ks2zx\" (UID: \"530fb8ca-172f-409a-a3e6-f588114b7adb\") " pod="opendatahub/odh-model-controller-76588b95-ks2zx" Jun 02 15:17:14.077708 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.077687 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spcdc\" (UniqueName: \"kubernetes.io/projected/530fb8ca-172f-409a-a3e6-f588114b7adb-kube-api-access-spcdc\") pod \"odh-model-controller-76588b95-ks2zx\" (UID: \"530fb8ca-172f-409a-a3e6-f588114b7adb\") " pod="opendatahub/odh-model-controller-76588b95-ks2zx" Jun 02 15:17:14.087864 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.087840 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97" Jun 02 15:17:14.103031 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.102485 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-ks2zx"] Jun 02 15:17:14.178368 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.178327 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/530fb8ca-172f-409a-a3e6-f588114b7adb-cert\") pod \"odh-model-controller-76588b95-ks2zx\" (UID: \"530fb8ca-172f-409a-a3e6-f588114b7adb\") " pod="opendatahub/odh-model-controller-76588b95-ks2zx" Jun 02 15:17:14.178533 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.178489 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-spcdc\" (UniqueName: \"kubernetes.io/projected/530fb8ca-172f-409a-a3e6-f588114b7adb-kube-api-access-spcdc\") pod \"odh-model-controller-76588b95-ks2zx\" (UID: \"530fb8ca-172f-409a-a3e6-f588114b7adb\") " pod="opendatahub/odh-model-controller-76588b95-ks2zx" Jun 02 15:17:14.179015 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:17:14.178992 2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 02 15:17:14.179118 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:17:14.179104 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/530fb8ca-172f-409a-a3e6-f588114b7adb-cert podName:530fb8ca-172f-409a-a3e6-f588114b7adb nodeName:}" failed. No retries permitted until 2026-06-02 15:17:14.679078307 +0000 UTC m=+474.990925268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/530fb8ca-172f-409a-a3e6-f588114b7adb-cert") pod "odh-model-controller-76588b95-ks2zx" (UID: "530fb8ca-172f-409a-a3e6-f588114b7adb") : secret "odh-model-controller-webhook-cert" not found Jun 02 15:17:14.210383 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.210350 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spcdc\" (UniqueName: \"kubernetes.io/projected/530fb8ca-172f-409a-a3e6-f588114b7adb-kube-api-access-spcdc\") pod \"odh-model-controller-76588b95-ks2zx\" (UID: \"530fb8ca-172f-409a-a3e6-f588114b7adb\") " pod="opendatahub/odh-model-controller-76588b95-ks2zx" Jun 02 15:17:14.282733 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.282708 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97"] Jun 02 15:17:14.285963 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:17:14.285932 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae4275c_6874_416e_b748_6520993540c3.slice/crio-eab4c14bc08b86e13921c46ca25bd475ecce517535c872c144b8201057cb67f5 WatchSource:0}: Error finding container eab4c14bc08b86e13921c46ca25bd475ecce517535c872c144b8201057cb67f5: Status 404 returned error can't find the container with id eab4c14bc08b86e13921c46ca25bd475ecce517535c872c144b8201057cb67f5 Jun 02 15:17:14.610760 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.610727 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97" event={"ID":"bae4275c-6874-416e-b748-6520993540c3","Type":"ContainerStarted","Data":"eab4c14bc08b86e13921c46ca25bd475ecce517535c872c144b8201057cb67f5"} Jun 02 15:17:14.682628 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:14.682554 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/530fb8ca-172f-409a-a3e6-f588114b7adb-cert\") pod \"odh-model-controller-76588b95-ks2zx\" (UID: \"530fb8ca-172f-409a-a3e6-f588114b7adb\") " pod="opendatahub/odh-model-controller-76588b95-ks2zx" Jun 02 15:17:14.682840 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:17:14.682697 2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 02 15:17:14.682840 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:17:14.682757 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/530fb8ca-172f-409a-a3e6-f588114b7adb-cert podName:530fb8ca-172f-409a-a3e6-f588114b7adb nodeName:}" failed. No retries permitted until 2026-06-02 15:17:15.68274237 +0000 UTC m=+475.994589332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/530fb8ca-172f-409a-a3e6-f588114b7adb-cert") pod "odh-model-controller-76588b95-ks2zx" (UID: "530fb8ca-172f-409a-a3e6-f588114b7adb") : secret "odh-model-controller-webhook-cert" not found Jun 02 15:17:15.675741 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:15.675697 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-7cdhz"] Jun 02 15:17:15.678490 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:15.678462 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-7cdhz" Jun 02 15:17:15.686895 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:15.686493 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 15:17:15.694660 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:15.694629 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9lrs\" (UniqueName: \"kubernetes.io/projected/b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f-kube-api-access-w9lrs\") pod \"model-serving-api-6577596cd5-7cdhz\" (UID: \"b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f\") " pod="opendatahub/model-serving-api-6577596cd5-7cdhz" Jun 02 15:17:15.694797 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:15.694732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f-tls-certs\") pod \"model-serving-api-6577596cd5-7cdhz\" (UID: \"b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f\") " pod="opendatahub/model-serving-api-6577596cd5-7cdhz" Jun 02 15:17:15.694797 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:15.694775 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/530fb8ca-172f-409a-a3e6-f588114b7adb-cert\") pod \"odh-model-controller-76588b95-ks2zx\" (UID: \"530fb8ca-172f-409a-a3e6-f588114b7adb\") " pod="opendatahub/odh-model-controller-76588b95-ks2zx" Jun 02 15:17:15.697811 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:15.697780 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/530fb8ca-172f-409a-a3e6-f588114b7adb-cert\") pod \"odh-model-controller-76588b95-ks2zx\" (UID: \"530fb8ca-172f-409a-a3e6-f588114b7adb\") " pod="opendatahub/odh-model-controller-76588b95-ks2zx" Jun 02 15:17:15.725230 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:15.725156 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-7cdhz"] Jun 02 15:17:15.795999 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:15.795956 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w9lrs\" (UniqueName: \"kubernetes.io/projected/b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f-kube-api-access-w9lrs\") pod \"model-serving-api-6577596cd5-7cdhz\" (UID: \"b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f\") " pod="opendatahub/model-serving-api-6577596cd5-7cdhz" Jun 02 15:17:15.796183 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:15.796067 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f-tls-certs\") pod \"model-serving-api-6577596cd5-7cdhz\" (UID: \"b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f\") " pod="opendatahub/model-serving-api-6577596cd5-7cdhz" Jun 02 15:17:15.796257 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:17:15.796200 2565 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 02 15:17:15.796312 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:17:15.796267 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f-tls-certs podName:b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f nodeName:}" failed. No retries permitted until 2026-06-02 15:17:16.296246862 +0000 UTC m=+476.608093836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f-tls-certs") pod "model-serving-api-6577596cd5-7cdhz" (UID: "b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f") : secret "model-serving-api-tls" not found Jun 02 15:17:15.818628 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:15.818565 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9lrs\" (UniqueName: \"kubernetes.io/projected/b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f-kube-api-access-w9lrs\") pod \"model-serving-api-6577596cd5-7cdhz\" (UID: \"b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f\") " pod="opendatahub/model-serving-api-6577596cd5-7cdhz" Jun 02 15:17:15.881289 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:15.881246 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-ks2zx" Jun 02 15:17:16.301801 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:16.301712 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f-tls-certs\") pod \"model-serving-api-6577596cd5-7cdhz\" (UID: \"b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f\") " pod="opendatahub/model-serving-api-6577596cd5-7cdhz" Jun 02 15:17:16.305394 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:16.305357 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f-tls-certs\") pod \"model-serving-api-6577596cd5-7cdhz\" (UID: \"b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f\") " pod="opendatahub/model-serving-api-6577596cd5-7cdhz" Jun 02 15:17:16.592200 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:16.592108 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-7cdhz" Jun 02 15:17:16.631978 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:16.631924 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-ks2zx"] Jun 02 15:17:16.632824 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:17:16.632784 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530fb8ca_172f_409a_a3e6_f588114b7adb.slice/crio-7ef441261559ef3e6e46204bc8eff926fb2a6c5e144e4e2759796294dd4e0351 WatchSource:0}: Error finding container 7ef441261559ef3e6e46204bc8eff926fb2a6c5e144e4e2759796294dd4e0351: Status 404 returned error can't find the container with id 7ef441261559ef3e6e46204bc8eff926fb2a6c5e144e4e2759796294dd4e0351 Jun 02 15:17:16.753353 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:16.753274 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-7cdhz"] Jun 02 15:17:16.756464 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:17:16.756435 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1dd9ae3_815b_48c3_9fc5_9af9755a3b1f.slice/crio-77c8838554eef7479983307ccf94c71a4a9cdd00b798245fae50cb37dadd691f WatchSource:0}: Error finding container 77c8838554eef7479983307ccf94c71a4a9cdd00b798245fae50cb37dadd691f: Status 404 returned error can't find the container with id 77c8838554eef7479983307ccf94c71a4a9cdd00b798245fae50cb37dadd691f Jun 02 15:17:17.627233 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:17.627155 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-ks2zx" event={"ID":"530fb8ca-172f-409a-a3e6-f588114b7adb","Type":"ContainerStarted","Data":"7ef441261559ef3e6e46204bc8eff926fb2a6c5e144e4e2759796294dd4e0351"} Jun 02 15:17:17.629254 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:17.629217 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-7cdhz" event={"ID":"b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f","Type":"ContainerStarted","Data":"77c8838554eef7479983307ccf94c71a4a9cdd00b798245fae50cb37dadd691f"} Jun 02 15:17:20.642061 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:20.642022 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-7cdhz" event={"ID":"b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f","Type":"ContainerStarted","Data":"4d68fee2d3b25f0c0c51ccfd04ec3c70eb162d3c16c8218c4cee004d5a0a1a89"} Jun 02 15:17:20.642532 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:20.642134 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-7cdhz" Jun 02 15:17:20.643461 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:20.643434 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97" event={"ID":"bae4275c-6874-416e-b748-6520993540c3","Type":"ContainerStarted","Data":"3b6f3d50804170c4ad9b967ece658d6a11fff597d62345ca52cca4790b0bdc59"} Jun 02 15:17:20.644788 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:20.644768 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-ks2zx" event={"ID":"530fb8ca-172f-409a-a3e6-f588114b7adb","Type":"ContainerStarted","Data":"9234ca94c4826600a2952202e07973948453af46d0904e08d9fcc8e638125baa"} Jun 02 15:17:20.644887 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:20.644874 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-ks2zx" Jun 02 15:17:20.665603 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:20.663940 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-7cdhz" podStartSLOduration=2.810282946 podStartE2EDuration="5.663922872s" podCreationTimestamp="2026-06-02 15:17:15 +0000 UTC" firstStartedPulling="2026-06-02 15:17:16.758307808 +0000 UTC m=+477.070154768" lastFinishedPulling="2026-06-02 15:17:19.611947736 +0000 UTC m=+479.923794694" observedRunningTime="2026-06-02 15:17:20.660267743 +0000 UTC m=+480.972114721" watchObservedRunningTime="2026-06-02 15:17:20.663922872 +0000 UTC m=+480.975769854" Jun 02 15:17:20.681674 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:20.681562 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-ks2zx" podStartSLOduration=3.081234113 podStartE2EDuration="6.681539955s" podCreationTimestamp="2026-06-02 15:17:14 +0000 UTC" firstStartedPulling="2026-06-02 15:17:16.635179496 +0000 UTC m=+476.947026452" lastFinishedPulling="2026-06-02 15:17:20.235485337 +0000 UTC m=+480.547332294" observedRunningTime="2026-06-02 15:17:20.680883643 +0000 UTC m=+480.992730623" watchObservedRunningTime="2026-06-02 15:17:20.681539955 +0000 UTC m=+480.993386936" Jun 02 15:17:20.701876 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:20.701819 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85c6f598cb-wnh97" podStartSLOduration=2.381242182 podStartE2EDuration="7.701804332s" podCreationTimestamp="2026-06-02 15:17:13 +0000 UTC" firstStartedPulling="2026-06-02 15:17:14.28767552 +0000 UTC m=+474.599522480" lastFinishedPulling="2026-06-02 15:17:19.608237665 +0000 UTC m=+479.920084630" observedRunningTime="2026-06-02 15:17:20.699669857 +0000 UTC m=+481.011516835" watchObservedRunningTime="2026-06-02 15:17:20.701804332 +0000 UTC m=+481.013651332" Jun 02 15:17:26.058699 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.058662 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g"] Jun 02 15:17:26.060780 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.060762 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g" Jun 02 15:17:26.063779 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.063756 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5wflr\"" Jun 02 15:17:26.064151 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.064128 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 15:17:26.074704 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.074678 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g"] Jun 02 15:17:26.088603 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.088541 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l"] Jun 02 15:17:26.091407 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.091371 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwnpg\" (UniqueName: \"kubernetes.io/projected/6e3faa46-1b20-4b03-9eb5-d9db1eb7982c-kube-api-access-kwnpg\") pod \"kserve-controller-manager-7c99ffcdcd-nck5g\" (UID: \"6e3faa46-1b20-4b03-9eb5-d9db1eb7982c\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g" Jun 02 15:17:26.093111 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.093020 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e3faa46-1b20-4b03-9eb5-d9db1eb7982c-cert\") pod \"kserve-controller-manager-7c99ffcdcd-nck5g\" (UID: \"6e3faa46-1b20-4b03-9eb5-d9db1eb7982c\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g" Jun 02 15:17:26.095635 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.095611 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l" Jun 02 15:17:26.099687 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.099663 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 15:17:26.100051 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.100024 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hxrg6\"" Jun 02 15:17:26.104773 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.104748 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l"] Jun 02 15:17:26.195932 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.195894 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbrmh\" (UniqueName: \"kubernetes.io/projected/72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2-kube-api-access-cbrmh\") pod \"llmisvc-controller-manager-c6b9847d7-zwk5l\" (UID: \"72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l" Jun 02 15:17:26.196141 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.195955 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e3faa46-1b20-4b03-9eb5-d9db1eb7982c-cert\") pod \"kserve-controller-manager-7c99ffcdcd-nck5g\" (UID: \"6e3faa46-1b20-4b03-9eb5-d9db1eb7982c\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g" Jun 02 15:17:26.196141 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.196025 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwnpg\" (UniqueName: \"kubernetes.io/projected/6e3faa46-1b20-4b03-9eb5-d9db1eb7982c-kube-api-access-kwnpg\") pod \"kserve-controller-manager-7c99ffcdcd-nck5g\" (UID: \"6e3faa46-1b20-4b03-9eb5-d9db1eb7982c\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g" Jun 02 15:17:26.196141 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:17:26.196063 2565 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 02 15:17:26.196141 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.196074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2-cert\") pod \"llmisvc-controller-manager-c6b9847d7-zwk5l\" (UID: \"72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l" Jun 02 15:17:26.196141 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:17:26.196137 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3faa46-1b20-4b03-9eb5-d9db1eb7982c-cert podName:6e3faa46-1b20-4b03-9eb5-d9db1eb7982c nodeName:}" failed. No retries permitted until 2026-06-02 15:17:26.696115234 +0000 UTC m=+487.007962205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6e3faa46-1b20-4b03-9eb5-d9db1eb7982c-cert") pod "kserve-controller-manager-7c99ffcdcd-nck5g" (UID: "6e3faa46-1b20-4b03-9eb5-d9db1eb7982c") : secret "kserve-webhook-server-cert" not found Jun 02 15:17:26.208699 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.208674 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwnpg\" (UniqueName: \"kubernetes.io/projected/6e3faa46-1b20-4b03-9eb5-d9db1eb7982c-kube-api-access-kwnpg\") pod \"kserve-controller-manager-7c99ffcdcd-nck5g\" (UID: \"6e3faa46-1b20-4b03-9eb5-d9db1eb7982c\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g" Jun 02 15:17:26.296684 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.296638 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2-cert\") pod \"llmisvc-controller-manager-c6b9847d7-zwk5l\" (UID: \"72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l" Jun 02 15:17:26.296869 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.296731 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbrmh\" (UniqueName: \"kubernetes.io/projected/72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2-kube-api-access-cbrmh\") pod \"llmisvc-controller-manager-c6b9847d7-zwk5l\" (UID: \"72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l" Jun 02 15:17:26.299372 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.299337 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2-cert\") pod \"llmisvc-controller-manager-c6b9847d7-zwk5l\" (UID: \"72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l" Jun 02 15:17:26.321699 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.321556 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbrmh\" (UniqueName: \"kubernetes.io/projected/72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2-kube-api-access-cbrmh\") pod \"llmisvc-controller-manager-c6b9847d7-zwk5l\" (UID: \"72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l" Jun 02 15:17:26.406882 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.406843 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l" Jun 02 15:17:26.541552 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.541526 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l"] Jun 02 15:17:26.544638 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:17:26.544606 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod72ca08fa_7ac1_42e6_9fd2_1362ae7fa7a2.slice/crio-2e2176c0ace8179311ad31398236dc0b2d6927015978749ce7f10323ecad9477 WatchSource:0}: Error finding container 2e2176c0ace8179311ad31398236dc0b2d6927015978749ce7f10323ecad9477: Status 404 returned error can't find the container with id 2e2176c0ace8179311ad31398236dc0b2d6927015978749ce7f10323ecad9477 Jun 02 15:17:26.664615 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.664514 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l" event={"ID":"72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2","Type":"ContainerStarted","Data":"2e2176c0ace8179311ad31398236dc0b2d6927015978749ce7f10323ecad9477"} Jun 02 15:17:26.700971 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.700939 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e3faa46-1b20-4b03-9eb5-d9db1eb7982c-cert\") pod \"kserve-controller-manager-7c99ffcdcd-nck5g\" (UID: \"6e3faa46-1b20-4b03-9eb5-d9db1eb7982c\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g" Jun 02 15:17:26.703451 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.703431 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e3faa46-1b20-4b03-9eb5-d9db1eb7982c-cert\") pod \"kserve-controller-manager-7c99ffcdcd-nck5g\" (UID: \"6e3faa46-1b20-4b03-9eb5-d9db1eb7982c\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g" Jun 02 15:17:26.971870 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:26.971781 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g" Jun 02 15:17:27.112049 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:27.112022 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g"] Jun 02 15:17:27.114059 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:17:27.114031 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3faa46_1b20_4b03_9eb5_d9db1eb7982c.slice/crio-b98bbc0b3864a74667a8dd94b39dd1f617775b1671cc6b386a0a224d7e1897ac WatchSource:0}: Error finding container b98bbc0b3864a74667a8dd94b39dd1f617775b1671cc6b386a0a224d7e1897ac: Status 404 returned error can't find the container with id b98bbc0b3864a74667a8dd94b39dd1f617775b1671cc6b386a0a224d7e1897ac Jun 02 15:17:27.670222 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:27.670182 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g" event={"ID":"6e3faa46-1b20-4b03-9eb5-d9db1eb7982c","Type":"ContainerStarted","Data":"b98bbc0b3864a74667a8dd94b39dd1f617775b1671cc6b386a0a224d7e1897ac"} Jun 02 15:17:30.686539 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:30.686485 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l" event={"ID":"72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2","Type":"ContainerStarted","Data":"59e878b0f06cc3ba12b8ad57b30364e7ef343d5991fe020b1c243139fb04ffc5"} Jun 02 15:17:30.687047 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:30.686654 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l" Jun 02 15:17:30.727041 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:30.726978 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l" podStartSLOduration=1.178685616 podStartE2EDuration="4.72695827s" podCreationTimestamp="2026-06-02 15:17:26 +0000 UTC" firstStartedPulling="2026-06-02 15:17:26.545959274 +0000 UTC m=+486.857806244" lastFinishedPulling="2026-06-02 15:17:30.094231926 +0000 UTC m=+490.406078898" observedRunningTime="2026-06-02 15:17:30.72260657 +0000 UTC m=+491.034453546" watchObservedRunningTime="2026-06-02 15:17:30.72695827 +0000 UTC m=+491.038805250" Jun 02 15:17:31.650386 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:31.650352 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-ks2zx" Jun 02 15:17:31.652526 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:31.652504 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-7cdhz" Jun 02 15:17:31.692161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:31.692116 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g" event={"ID":"6e3faa46-1b20-4b03-9eb5-d9db1eb7982c","Type":"ContainerStarted","Data":"98d4ef2dbdae430e0552e1dfd9c2217df56823a8a921bb2d4062405d3f79db38"} Jun 02 15:17:31.692672 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:31.692169 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g" Jun 02 15:17:33.956650 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:33.956595 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g" podStartSLOduration=4.213666251 podStartE2EDuration="7.956551339s" podCreationTimestamp="2026-06-02 15:17:26 +0000 UTC" firstStartedPulling="2026-06-02 15:17:27.115381794 +0000 UTC m=+487.427228751" lastFinishedPulling="2026-06-02 15:17:30.858266867 +0000 UTC m=+491.170113839" observedRunningTime="2026-06-02 15:17:31.857269132 +0000 UTC m=+492.169116110" watchObservedRunningTime="2026-06-02 15:17:33.956551339 +0000 UTC m=+494.268398319" Jun 02 15:17:33.958067 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:33.958041 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k"] Jun 02 15:17:33.961443 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:33.961425 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k" Jun 02 15:17:33.964496 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:33.964475 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 15:17:33.964654 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:33.964508 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 15:17:33.964654 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:33.964535 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-59dk7\"" Jun 02 15:17:33.975021 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:33.974993 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k"] Jun 02 15:17:34.067198 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:34.067159 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/86abc241-8ead-4bb9-a225-886afb54efe1-operator-config\") pod \"servicemesh-operator3-55f49c5f94-tmc5k\" (UID: \"86abc241-8ead-4bb9-a225-886afb54efe1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k" Jun 02 15:17:34.067198 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:34.067210 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwzdb\" (UniqueName: \"kubernetes.io/projected/86abc241-8ead-4bb9-a225-886afb54efe1-kube-api-access-zwzdb\") pod \"servicemesh-operator3-55f49c5f94-tmc5k\" (UID: \"86abc241-8ead-4bb9-a225-886afb54efe1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k" Jun 02 15:17:34.168077 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:34.168031 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/86abc241-8ead-4bb9-a225-886afb54efe1-operator-config\") pod \"servicemesh-operator3-55f49c5f94-tmc5k\" (UID: \"86abc241-8ead-4bb9-a225-886afb54efe1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k" Jun 02 15:17:34.168077 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:34.168078 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwzdb\" (UniqueName: \"kubernetes.io/projected/86abc241-8ead-4bb9-a225-886afb54efe1-kube-api-access-zwzdb\") pod \"servicemesh-operator3-55f49c5f94-tmc5k\" (UID: \"86abc241-8ead-4bb9-a225-886afb54efe1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k" Jun 02 15:17:34.170973 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:34.170947 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/86abc241-8ead-4bb9-a225-886afb54efe1-operator-config\") pod \"servicemesh-operator3-55f49c5f94-tmc5k\" (UID: \"86abc241-8ead-4bb9-a225-886afb54efe1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k" Jun 02 15:17:34.187374 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:34.187343 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwzdb\" (UniqueName: \"kubernetes.io/projected/86abc241-8ead-4bb9-a225-886afb54efe1-kube-api-access-zwzdb\") pod \"servicemesh-operator3-55f49c5f94-tmc5k\" (UID: \"86abc241-8ead-4bb9-a225-886afb54efe1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k" Jun 02 15:17:34.271325 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:34.271228 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k" Jun 02 15:17:34.439682 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:34.439647 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k"] Jun 02 15:17:34.443101 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:17:34.443070 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86abc241_8ead_4bb9_a225_886afb54efe1.slice/crio-eb62b338c0126413a5e332951af2d882c08f22590fa1cdf16d35f3b730d05cf9 WatchSource:0}: Error finding container eb62b338c0126413a5e332951af2d882c08f22590fa1cdf16d35f3b730d05cf9: Status 404 returned error can't find the container with id eb62b338c0126413a5e332951af2d882c08f22590fa1cdf16d35f3b730d05cf9 Jun 02 15:17:34.703458 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:34.703419 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k" event={"ID":"86abc241-8ead-4bb9-a225-886afb54efe1","Type":"ContainerStarted","Data":"eb62b338c0126413a5e332951af2d882c08f22590fa1cdf16d35f3b730d05cf9"} Jun 02 15:17:38.719147 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:38.719110 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k" event={"ID":"86abc241-8ead-4bb9-a225-886afb54efe1","Type":"ContainerStarted","Data":"1062e467e881606fae0e5b7e31388aadb04e6d05ada5a60c71ea4e37f63ddbcb"} Jun 02 15:17:38.719522 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:38.719171 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k" Jun 02 15:17:38.740464 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:38.740403 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k" podStartSLOduration=1.927217473 podStartE2EDuration="5.740385243s" podCreationTimestamp="2026-06-02 15:17:33 +0000 UTC" firstStartedPulling="2026-06-02 15:17:34.445712194 +0000 UTC m=+494.757559151" lastFinishedPulling="2026-06-02 15:17:38.258879946 +0000 UTC m=+498.570726921" observedRunningTime="2026-06-02 15:17:38.738807289 +0000 UTC m=+499.050654267" watchObservedRunningTime="2026-06-02 15:17:38.740385243 +0000 UTC m=+499.052232223" Jun 02 15:17:44.159105 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.159068 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5678dd97d5-2cvqw"] Jun 02 15:17:44.162983 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.162960 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5678dd97d5-2cvqw" Jun 02 15:17:44.168227 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.168204 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 15:17:44.168373 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.168305 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4b2vj\"" Jun 02 15:17:44.187279 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.187245 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5678dd97d5-2cvqw"] Jun 02 15:17:44.259869 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.259823 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0de93934-910c-4c6e-9311-9efd4c4e6910-redirect-config\") pod \"dashboard-redirect-5678dd97d5-2cvqw\" (UID: \"0de93934-910c-4c6e-9311-9efd4c4e6910\") " pod="opendatahub/dashboard-redirect-5678dd97d5-2cvqw" Jun 02 15:17:44.260051 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.259911 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5vg4\" (UniqueName: \"kubernetes.io/projected/0de93934-910c-4c6e-9311-9efd4c4e6910-kube-api-access-n5vg4\") pod \"dashboard-redirect-5678dd97d5-2cvqw\" (UID: \"0de93934-910c-4c6e-9311-9efd4c4e6910\") " pod="opendatahub/dashboard-redirect-5678dd97d5-2cvqw" Jun 02 15:17:44.360926 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.360889 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0de93934-910c-4c6e-9311-9efd4c4e6910-redirect-config\") pod \"dashboard-redirect-5678dd97d5-2cvqw\" (UID: \"0de93934-910c-4c6e-9311-9efd4c4e6910\") " pod="opendatahub/dashboard-redirect-5678dd97d5-2cvqw" Jun 02 15:17:44.361133 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.360934 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5vg4\" (UniqueName: \"kubernetes.io/projected/0de93934-910c-4c6e-9311-9efd4c4e6910-kube-api-access-n5vg4\") pod \"dashboard-redirect-5678dd97d5-2cvqw\" (UID: \"0de93934-910c-4c6e-9311-9efd4c4e6910\") " pod="opendatahub/dashboard-redirect-5678dd97d5-2cvqw" Jun 02 15:17:44.361733 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.361706 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0de93934-910c-4c6e-9311-9efd4c4e6910-redirect-config\") pod \"dashboard-redirect-5678dd97d5-2cvqw\" (UID: \"0de93934-910c-4c6e-9311-9efd4c4e6910\") " pod="opendatahub/dashboard-redirect-5678dd97d5-2cvqw" Jun 02 15:17:44.372070 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.372034 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5vg4\" (UniqueName: \"kubernetes.io/projected/0de93934-910c-4c6e-9311-9efd4c4e6910-kube-api-access-n5vg4\") pod \"dashboard-redirect-5678dd97d5-2cvqw\" (UID: \"0de93934-910c-4c6e-9311-9efd4c4e6910\") " pod="opendatahub/dashboard-redirect-5678dd97d5-2cvqw" Jun 02 15:17:44.475237 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.475143 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5678dd97d5-2cvqw" Jun 02 15:17:44.636723 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.636680 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5678dd97d5-2cvqw"] Jun 02 15:17:44.638105 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.638080 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p"] Jun 02 15:17:44.639612 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:17:44.639587 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0de93934_910c_4c6e_9311_9efd4c4e6910.slice/crio-dd98b764dd73b593f5704176dbe99476e77184873225c07ecf2c486962723acf WatchSource:0}: Error finding container dd98b764dd73b593f5704176dbe99476e77184873225c07ecf2c486962723acf: Status 404 returned error can't find the container with id dd98b764dd73b593f5704176dbe99476e77184873225c07ecf2c486962723acf Jun 02 15:17:44.642912 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.642893 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.648547 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.648526 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 15:17:44.648676 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.648529 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 15:17:44.648676 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.648664 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h7g9r\"" Jun 02 15:17:44.648951 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.648931 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 15:17:44.649007 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.648975 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 15:17:44.654162 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.654137 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p"] Jun 02 15:17:44.739819 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.739711 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5678dd97d5-2cvqw" event={"ID":"0de93934-910c-4c6e-9311-9efd4c4e6910","Type":"ContainerStarted","Data":"dd98b764dd73b593f5704176dbe99476e77184873225c07ecf2c486962723acf"} Jun 02 15:17:44.765849 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.765818 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f1592546-934d-440b-a9ff-fb296f685641-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.765849 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.765854 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f1592546-934d-440b-a9ff-fb296f685641-cacerts\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.766060 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.765883 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1592546-934d-440b-a9ff-fb296f685641-local-certs\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.766060 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.765946 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kjm6\" (UniqueName: \"kubernetes.io/projected/f1592546-934d-440b-a9ff-fb296f685641-kube-api-access-6kjm6\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.766060 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.766035 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1592546-934d-440b-a9ff-fb296f685641-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.766201 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.766092 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f1592546-934d-440b-a9ff-fb296f685641-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.766201 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.766163 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1592546-934d-440b-a9ff-fb296f685641-istio-token\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.867234 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.867198 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1592546-934d-440b-a9ff-fb296f685641-local-certs\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.867441 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.867252 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6kjm6\" (UniqueName: \"kubernetes.io/projected/f1592546-934d-440b-a9ff-fb296f685641-kube-api-access-6kjm6\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.867441 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.867294 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1592546-934d-440b-a9ff-fb296f685641-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.867441 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.867313 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f1592546-934d-440b-a9ff-fb296f685641-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.867441 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.867352 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1592546-934d-440b-a9ff-fb296f685641-istio-token\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.867441 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.867393 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f1592546-934d-440b-a9ff-fb296f685641-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.867441 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.867420 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f1592546-934d-440b-a9ff-fb296f685641-cacerts\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.868300 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.868275 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f1592546-934d-440b-a9ff-fb296f685641-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.870076 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.870051 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1592546-934d-440b-a9ff-fb296f685641-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.870443 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.870414 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1592546-934d-440b-a9ff-fb296f685641-local-certs\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.870659 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.870638 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f1592546-934d-440b-a9ff-fb296f685641-cacerts\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.870824 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.870804 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f1592546-934d-440b-a9ff-fb296f685641-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.878518 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.878490 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kjm6\" (UniqueName: \"kubernetes.io/projected/f1592546-934d-440b-a9ff-fb296f685641-kube-api-access-6kjm6\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.878671 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.878546 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1592546-934d-440b-a9ff-fb296f685641-istio-token\") pod \"istiod-openshift-gateway-798958bb55-qk59p\" (UID: \"f1592546-934d-440b-a9ff-fb296f685641\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:44.955551 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:44.955519 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:45.105038 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:45.105010 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p"] Jun 02 15:17:45.107483 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:17:45.107451 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1592546_934d_440b_a9ff_fb296f685641.slice/crio-7d36336a07cc3903ba2386178f682d60da51464dec1cf52bfc8b4ad1bbbe036a WatchSource:0}: Error finding container 7d36336a07cc3903ba2386178f682d60da51464dec1cf52bfc8b4ad1bbbe036a: Status 404 returned error can't find the container with id 7d36336a07cc3903ba2386178f682d60da51464dec1cf52bfc8b4ad1bbbe036a Jun 02 15:17:45.746759 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:45.746715 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" event={"ID":"f1592546-934d-440b-a9ff-fb296f685641","Type":"ContainerStarted","Data":"7d36336a07cc3903ba2386178f682d60da51464dec1cf52bfc8b4ad1bbbe036a"} Jun 02 15:17:47.750460 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:47.750411 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 15:17:47.750830 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:47.750501 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 15:17:48.759992 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:48.759944 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5678dd97d5-2cvqw" event={"ID":"0de93934-910c-4c6e-9311-9efd4c4e6910","Type":"ContainerStarted","Data":"e2f510739baf21837bd2bd9858fb6539148bdccd1277a7ad803b4d32b271d587"} Jun 02 15:17:48.761811 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:48.761726 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" event={"ID":"f1592546-934d-440b-a9ff-fb296f685641","Type":"ContainerStarted","Data":"e045c5f81b8b5b5323d6fed44c08f166aea591f64184428b765e917aa57c615e"} Jun 02 15:17:48.761967 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:48.761948 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:17:48.763798 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:48.763771 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-qk59p container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 02 15:17:48.763938 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:48.763817 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" podUID="f1592546-934d-440b-a9ff-fb296f685641" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 15:17:48.776470 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:48.776422 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5678dd97d5-2cvqw" podStartSLOduration=1.671514511 podStartE2EDuration="4.776408457s" podCreationTimestamp="2026-06-02 15:17:44 +0000 UTC" firstStartedPulling="2026-06-02 15:17:44.641010809 +0000 UTC m=+504.952857767" lastFinishedPulling="2026-06-02 15:17:47.745904742 +0000 UTC m=+508.057751713" observedRunningTime="2026-06-02 15:17:48.774614901 +0000 UTC m=+509.086461879" watchObservedRunningTime="2026-06-02 15:17:48.776408457 +0000 UTC m=+509.088255436" Jun 02 15:17:48.793962 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:48.793905 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" podStartSLOduration=2.153542241 podStartE2EDuration="4.79388868s" podCreationTimestamp="2026-06-02 15:17:44 +0000 UTC" firstStartedPulling="2026-06-02 15:17:45.109763172 +0000 UTC m=+505.421610133" lastFinishedPulling="2026-06-02 15:17:47.750109599 +0000 UTC m=+508.061956572" observedRunningTime="2026-06-02 15:17:48.793664081 +0000 UTC m=+509.105511065" watchObservedRunningTime="2026-06-02 15:17:48.79388868 +0000 UTC m=+509.105735660" Jun 02 15:17:49.724650 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:49.724614 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tmc5k" Jun 02 15:17:49.766589 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:17:49.766542 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-qk59p" Jun 02 15:18:01.694633 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:01.694597 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zwk5l" Jun 02 15:18:02.701221 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:02.701184 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-nck5g" Jun 02 15:18:45.541826 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:45.541779 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d"] Jun 02 15:18:45.545529 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:45.545503 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" Jun 02 15:18:45.548223 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:45.548202 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 15:18:45.549197 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:45.549179 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-sbd7h\"" Jun 02 15:18:45.549255 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:45.549180 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 15:18:45.554293 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:45.554270 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d"] Jun 02 15:18:45.613774 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:45.613732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw9rd\" (UniqueName: \"kubernetes.io/projected/1a4d129a-b318-4312-891a-c412e7b12a47-kube-api-access-hw9rd\") pod \"limitador-operator-controller-manager-85c4996f8c-8sw8d\" (UID: \"1a4d129a-b318-4312-891a-c412e7b12a47\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" Jun 02 15:18:45.714640 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:45.714600 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hw9rd\" (UniqueName: \"kubernetes.io/projected/1a4d129a-b318-4312-891a-c412e7b12a47-kube-api-access-hw9rd\") pod \"limitador-operator-controller-manager-85c4996f8c-8sw8d\" (UID: \"1a4d129a-b318-4312-891a-c412e7b12a47\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" Jun 02 15:18:45.724833 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:45.724798 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw9rd\" (UniqueName: \"kubernetes.io/projected/1a4d129a-b318-4312-891a-c412e7b12a47-kube-api-access-hw9rd\") pod \"limitador-operator-controller-manager-85c4996f8c-8sw8d\" (UID: \"1a4d129a-b318-4312-891a-c412e7b12a47\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" Jun 02 15:18:45.856812 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:45.856726 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" Jun 02 15:18:46.003372 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:46.003348 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d"] Jun 02 15:18:46.006328 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:18:46.006295 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4d129a_b318_4312_891a_c412e7b12a47.slice/crio-727d7784a1575f2be91ca23352dd038334561f3c5df56696cf97e0d85ce02621 WatchSource:0}: Error finding container 727d7784a1575f2be91ca23352dd038334561f3c5df56696cf97e0d85ce02621: Status 404 returned error can't find the container with id 727d7784a1575f2be91ca23352dd038334561f3c5df56696cf97e0d85ce02621 Jun 02 15:18:46.968935 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:46.968889 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" event={"ID":"1a4d129a-b318-4312-891a-c412e7b12a47","Type":"ContainerStarted","Data":"727d7784a1575f2be91ca23352dd038334561f3c5df56696cf97e0d85ce02621"} Jun 02 15:18:48.978054 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:48.978009 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" event={"ID":"1a4d129a-b318-4312-891a-c412e7b12a47","Type":"ContainerStarted","Data":"103ac5e82d25aa576318371cd58b5761b2f4496266f3e5edf6a653aad869d75a"} Jun 02 15:18:48.978542 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:48.978158 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" Jun 02 15:18:49.000077 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:49.000022 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" podStartSLOduration=1.655157934 podStartE2EDuration="4.000004052s" podCreationTimestamp="2026-06-02 15:18:45 +0000 UTC" firstStartedPulling="2026-06-02 15:18:46.008662357 +0000 UTC m=+566.320509315" lastFinishedPulling="2026-06-02 15:18:48.353508474 +0000 UTC m=+568.665355433" observedRunningTime="2026-06-02 15:18:48.998799803 +0000 UTC m=+569.310646783" watchObservedRunningTime="2026-06-02 15:18:49.000004052 +0000 UTC m=+569.311851055" Jun 02 15:18:51.641987 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:51.641945 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-4w55m"] Jun 02 15:18:51.645428 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:51.645407 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-4w55m" Jun 02 15:18:51.648370 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:51.648342 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xth6x\"" Jun 02 15:18:51.648594 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:51.648483 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 02 15:18:51.656072 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:51.656047 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-4w55m"] Jun 02 15:18:51.769997 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:51.769954 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj5nr\" (UniqueName: \"kubernetes.io/projected/44c6a4bb-5c67-4b93-8d88-ecc9eca96b2e-kube-api-access-gj5nr\") pod \"dns-operator-controller-manager-648d5c98bc-4w55m\" (UID: \"44c6a4bb-5c67-4b93-8d88-ecc9eca96b2e\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-4w55m" Jun 02 15:18:51.871120 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:51.871080 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gj5nr\" (UniqueName: \"kubernetes.io/projected/44c6a4bb-5c67-4b93-8d88-ecc9eca96b2e-kube-api-access-gj5nr\") pod \"dns-operator-controller-manager-648d5c98bc-4w55m\" (UID: \"44c6a4bb-5c67-4b93-8d88-ecc9eca96b2e\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-4w55m" Jun 02 15:18:51.889389 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:51.889361 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj5nr\" (UniqueName: \"kubernetes.io/projected/44c6a4bb-5c67-4b93-8d88-ecc9eca96b2e-kube-api-access-gj5nr\") pod \"dns-operator-controller-manager-648d5c98bc-4w55m\" (UID: \"44c6a4bb-5c67-4b93-8d88-ecc9eca96b2e\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-4w55m" Jun 02 15:18:51.958503 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:51.958411 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-4w55m" Jun 02 15:18:52.101647 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:52.101618 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-4w55m"] Jun 02 15:18:52.104208 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:18:52.104178 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c6a4bb_5c67_4b93_8d88_ecc9eca96b2e.slice/crio-4d446fcfecf70ad9b88d631c83bb862506dc6812c8d67d6105c0af59979141e2 WatchSource:0}: Error finding container 4d446fcfecf70ad9b88d631c83bb862506dc6812c8d67d6105c0af59979141e2: Status 404 returned error can't find the container with id 4d446fcfecf70ad9b88d631c83bb862506dc6812c8d67d6105c0af59979141e2 Jun 02 15:18:52.996642 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:52.996605 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-4w55m" event={"ID":"44c6a4bb-5c67-4b93-8d88-ecc9eca96b2e","Type":"ContainerStarted","Data":"4d446fcfecf70ad9b88d631c83bb862506dc6812c8d67d6105c0af59979141e2"} Jun 02 15:18:55.004930 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:55.004828 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-4w55m" event={"ID":"44c6a4bb-5c67-4b93-8d88-ecc9eca96b2e","Type":"ContainerStarted","Data":"a7581dedf36d1f0cdbd207e87bcbd597fc3d38cf1d30c8d48c74f6d59763bd0b"} Jun 02 15:18:55.005299 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:55.004958 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-4w55m" Jun 02 15:18:55.023023 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:55.022974 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-4w55m" podStartSLOduration=1.5051785020000001 podStartE2EDuration="4.022959875s" podCreationTimestamp="2026-06-02 15:18:51 +0000 UTC" firstStartedPulling="2026-06-02 15:18:52.106321501 +0000 UTC m=+572.418168458" lastFinishedPulling="2026-06-02 15:18:54.624102871 +0000 UTC m=+574.935949831" observedRunningTime="2026-06-02 15:18:55.02186281 +0000 UTC m=+575.333709789" watchObservedRunningTime="2026-06-02 15:18:55.022959875 +0000 UTC m=+575.334806854" Jun 02 15:18:59.987010 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:18:59.986980 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" Jun 02 15:19:06.011099 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:06.011057 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-4w55m" Jun 02 15:19:07.193322 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.193289 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d"] Jun 02 15:19:07.193805 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.193518 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" podUID="1a4d129a-b318-4312-891a-c412e7b12a47" containerName="manager" containerID="cri-o://103ac5e82d25aa576318371cd58b5761b2f4496266f3e5edf6a653aad869d75a" gracePeriod=2 Jun 02 15:19:07.206719 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.204625 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d"] Jun 02 15:19:07.221927 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.221894 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xqjb8"] Jun 02 15:19:07.222299 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.222286 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a4d129a-b318-4312-891a-c412e7b12a47" containerName="manager" Jun 02 15:19:07.222342 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.222301 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a4d129a-b318-4312-891a-c412e7b12a47" containerName="manager" Jun 02 15:19:07.222375 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.222358 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a4d129a-b318-4312-891a-c412e7b12a47" containerName="manager" Jun 02 15:19:07.225288 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.225271 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xqjb8" Jun 02 15:19:07.227875 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.227839 2565 status_manager.go:895] "Failed to get status for pod" podUID="1a4d129a-b318-4312-891a-c412e7b12a47" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" err="pods \"limitador-operator-controller-manager-85c4996f8c-8sw8d\" is forbidden: User \"system:node:ip-10-0-136-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-77.ec2.internal' and this object" Jun 02 15:19:07.235780 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.235751 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xqjb8"] Jun 02 15:19:07.312319 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.312271 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghhb2\" (UniqueName: \"kubernetes.io/projected/3d803013-7a84-4b70-8782-33521db9b555-kube-api-access-ghhb2\") pod \"limitador-operator-controller-manager-85c4996f8c-xqjb8\" (UID: \"3d803013-7a84-4b70-8782-33521db9b555\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xqjb8" Jun 02 15:19:07.413169 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.413114 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghhb2\" (UniqueName: \"kubernetes.io/projected/3d803013-7a84-4b70-8782-33521db9b555-kube-api-access-ghhb2\") pod \"limitador-operator-controller-manager-85c4996f8c-xqjb8\" (UID: \"3d803013-7a84-4b70-8782-33521db9b555\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xqjb8" Jun 02 15:19:07.424362 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.424332 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghhb2\" (UniqueName: \"kubernetes.io/projected/3d803013-7a84-4b70-8782-33521db9b555-kube-api-access-ghhb2\") pod \"limitador-operator-controller-manager-85c4996f8c-xqjb8\" (UID: \"3d803013-7a84-4b70-8782-33521db9b555\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xqjb8" Jun 02 15:19:07.441201 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.441176 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" Jun 02 15:19:07.443630 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.443552 2565 status_manager.go:895] "Failed to get status for pod" podUID="1a4d129a-b318-4312-891a-c412e7b12a47" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" err="pods \"limitador-operator-controller-manager-85c4996f8c-8sw8d\" is forbidden: User \"system:node:ip-10-0-136-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-77.ec2.internal' and this object" Jun 02 15:19:07.514156 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.514119 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hw9rd\" (UniqueName: \"kubernetes.io/projected/1a4d129a-b318-4312-891a-c412e7b12a47-kube-api-access-hw9rd\") pod \"1a4d129a-b318-4312-891a-c412e7b12a47\" (UID: \"1a4d129a-b318-4312-891a-c412e7b12a47\") " Jun 02 15:19:07.516538 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.516508 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a4d129a-b318-4312-891a-c412e7b12a47-kube-api-access-hw9rd" (OuterVolumeSpecName: "kube-api-access-hw9rd") pod "1a4d129a-b318-4312-891a-c412e7b12a47" (UID: "1a4d129a-b318-4312-891a-c412e7b12a47"). InnerVolumeSpecName "kube-api-access-hw9rd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:19:07.568075 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.568020 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xqjb8" Jun 02 15:19:07.615069 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.615031 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw9rd\" (UniqueName: \"kubernetes.io/projected/1a4d129a-b318-4312-891a-c412e7b12a47-kube-api-access-hw9rd\") on node \"ip-10-0-136-77.ec2.internal\" DevicePath \"\"" Jun 02 15:19:07.710086 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:07.710051 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xqjb8"] Jun 02 15:19:07.712599 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:19:07.712549 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d803013_7a84_4b70_8782_33521db9b555.slice/crio-b2bdb97c7cb83f71cc10a3a48b6280b0c5d3a7b3c79bc7d6d10b5e3a39c6a451 WatchSource:0}: Error finding container b2bdb97c7cb83f71cc10a3a48b6280b0c5d3a7b3c79bc7d6d10b5e3a39c6a451: Status 404 returned error can't find the container with id b2bdb97c7cb83f71cc10a3a48b6280b0c5d3a7b3c79bc7d6d10b5e3a39c6a451 Jun 02 15:19:08.049087 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:08.049039 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xqjb8" event={"ID":"3d803013-7a84-4b70-8782-33521db9b555","Type":"ContainerStarted","Data":"8b3089301a8adae33695a61ea486640f295fbe028669dd7a7cc026fbaf26698b"} Jun 02 15:19:08.049087 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:08.049082 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xqjb8" event={"ID":"3d803013-7a84-4b70-8782-33521db9b555","Type":"ContainerStarted","Data":"b2bdb97c7cb83f71cc10a3a48b6280b0c5d3a7b3c79bc7d6d10b5e3a39c6a451"} Jun 02 15:19:08.049357 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:08.049138 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xqjb8" Jun 02 15:19:08.050145 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:08.050119 2565 generic.go:358] "Generic (PLEG): container finished" podID="1a4d129a-b318-4312-891a-c412e7b12a47" containerID="103ac5e82d25aa576318371cd58b5761b2f4496266f3e5edf6a653aad869d75a" exitCode=0 Jun 02 15:19:08.050282 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:08.050157 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" Jun 02 15:19:08.050282 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:08.050195 2565 scope.go:117] "RemoveContainer" containerID="103ac5e82d25aa576318371cd58b5761b2f4496266f3e5edf6a653aad869d75a" Jun 02 15:19:08.051977 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:08.051950 2565 status_manager.go:895] "Failed to get status for pod" podUID="1a4d129a-b318-4312-891a-c412e7b12a47" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" err="pods \"limitador-operator-controller-manager-85c4996f8c-8sw8d\" is forbidden: User \"system:node:ip-10-0-136-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-77.ec2.internal' and this object" Jun 02 15:19:08.058547 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:08.058531 2565 scope.go:117] "RemoveContainer" containerID="103ac5e82d25aa576318371cd58b5761b2f4496266f3e5edf6a653aad869d75a" Jun 02 15:19:08.058819 ip-10-0-136-77 kubenswrapper[2565]: E0602 15:19:08.058803 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"103ac5e82d25aa576318371cd58b5761b2f4496266f3e5edf6a653aad869d75a\": container with ID starting with 103ac5e82d25aa576318371cd58b5761b2f4496266f3e5edf6a653aad869d75a not found: ID does not exist" containerID="103ac5e82d25aa576318371cd58b5761b2f4496266f3e5edf6a653aad869d75a" Jun 02 15:19:08.058860 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:08.058826 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"103ac5e82d25aa576318371cd58b5761b2f4496266f3e5edf6a653aad869d75a"} err="failed to get container status \"103ac5e82d25aa576318371cd58b5761b2f4496266f3e5edf6a653aad869d75a\": rpc error: code = NotFound desc = could not find container \"103ac5e82d25aa576318371cd58b5761b2f4496266f3e5edf6a653aad869d75a\": container with ID starting with 103ac5e82d25aa576318371cd58b5761b2f4496266f3e5edf6a653aad869d75a not found: ID does not exist" Jun 02 15:19:08.072204 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:08.072156 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xqjb8" podStartSLOduration=1.072139247 podStartE2EDuration="1.072139247s" podCreationTimestamp="2026-06-02 15:19:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:19:08.069818142 +0000 UTC m=+588.381665120" watchObservedRunningTime="2026-06-02 15:19:08.072139247 +0000 UTC m=+588.383986226" Jun 02 15:19:08.072338 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:08.072216 2565 status_manager.go:895] "Failed to get status for pod" podUID="1a4d129a-b318-4312-891a-c412e7b12a47" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sw8d" err="pods \"limitador-operator-controller-manager-85c4996f8c-8sw8d\" is forbidden: User \"system:node:ip-10-0-136-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-77.ec2.internal' and this object" Jun 02 15:19:08.208712 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:08.208675 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a4d129a-b318-4312-891a-c412e7b12a47" path="/var/lib/kubelet/pods/1a4d129a-b318-4312-891a-c412e7b12a47/volumes" Jun 02 15:19:19.056566 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:19.056526 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xqjb8" Jun 02 15:19:20.124239 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:20.124203 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-acl-logging/0.log" Jun 02 15:19:20.125910 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:20.125889 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-acl-logging/0.log" Jun 02 15:19:49.767165 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:49.767125 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4q7lc"] Jun 02 15:19:49.770261 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:49.770233 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-4q7lc" Jun 02 15:19:49.772881 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:49.772855 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 15:19:49.773032 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:49.772946 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-b2wlh\"" Jun 02 15:19:49.779171 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:49.779147 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4q7lc"] Jun 02 15:19:49.806237 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:49.806201 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4q7lc"] Jun 02 15:19:49.891153 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:49.891115 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5znd\" (UniqueName: \"kubernetes.io/projected/31c8f4ee-a296-478e-9ccc-7f21794b0009-kube-api-access-w5znd\") pod \"limitador-limitador-78c99df468-4q7lc\" (UID: \"31c8f4ee-a296-478e-9ccc-7f21794b0009\") " pod="kuadrant-system/limitador-limitador-78c99df468-4q7lc" Jun 02 15:19:49.891334 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:49.891176 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31c8f4ee-a296-478e-9ccc-7f21794b0009-config-file\") pod \"limitador-limitador-78c99df468-4q7lc\" (UID: \"31c8f4ee-a296-478e-9ccc-7f21794b0009\") " pod="kuadrant-system/limitador-limitador-78c99df468-4q7lc" Jun 02 15:19:49.991837 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:49.991792 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31c8f4ee-a296-478e-9ccc-7f21794b0009-config-file\") pod \"limitador-limitador-78c99df468-4q7lc\" (UID: \"31c8f4ee-a296-478e-9ccc-7f21794b0009\") " pod="kuadrant-system/limitador-limitador-78c99df468-4q7lc" Jun 02 15:19:49.992037 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:49.991896 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5znd\" (UniqueName: \"kubernetes.io/projected/31c8f4ee-a296-478e-9ccc-7f21794b0009-kube-api-access-w5znd\") pod \"limitador-limitador-78c99df468-4q7lc\" (UID: \"31c8f4ee-a296-478e-9ccc-7f21794b0009\") " pod="kuadrant-system/limitador-limitador-78c99df468-4q7lc" Jun 02 15:19:49.992502 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:49.992477 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31c8f4ee-a296-478e-9ccc-7f21794b0009-config-file\") pod \"limitador-limitador-78c99df468-4q7lc\" (UID: \"31c8f4ee-a296-478e-9ccc-7f21794b0009\") " pod="kuadrant-system/limitador-limitador-78c99df468-4q7lc" Jun 02 15:19:50.000696 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:50.000661 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5znd\" (UniqueName: \"kubernetes.io/projected/31c8f4ee-a296-478e-9ccc-7f21794b0009-kube-api-access-w5znd\") pod \"limitador-limitador-78c99df468-4q7lc\" (UID: \"31c8f4ee-a296-478e-9ccc-7f21794b0009\") " pod="kuadrant-system/limitador-limitador-78c99df468-4q7lc" Jun 02 15:19:50.081954 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:50.081910 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-4q7lc" Jun 02 15:19:50.226886 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:50.226859 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4q7lc"] Jun 02 15:19:50.229350 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:19:50.229312 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c8f4ee_a296_478e_9ccc_7f21794b0009.slice/crio-6b964742c9bc9ef47c533c5e132543ca84bb004ca98406adfdd89aac93ad3e73 WatchSource:0}: Error finding container 6b964742c9bc9ef47c533c5e132543ca84bb004ca98406adfdd89aac93ad3e73: Status 404 returned error can't find the container with id 6b964742c9bc9ef47c533c5e132543ca84bb004ca98406adfdd89aac93ad3e73 Jun 02 15:19:50.231297 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:50.231281 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:19:51.206343 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:51.206303 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-4q7lc" event={"ID":"31c8f4ee-a296-478e-9ccc-7f21794b0009","Type":"ContainerStarted","Data":"6b964742c9bc9ef47c533c5e132543ca84bb004ca98406adfdd89aac93ad3e73"} Jun 02 15:19:53.214556 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:53.214451 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-4q7lc" event={"ID":"31c8f4ee-a296-478e-9ccc-7f21794b0009","Type":"ContainerStarted","Data":"97af7261c1a13821f7a951bd2f240e806e2e50102086812f076b552cb219fd31"} Jun 02 15:19:53.215001 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:53.214694 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-4q7lc" Jun 02 15:19:53.231354 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:19:53.231302 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-4q7lc" podStartSLOduration=1.647200269 podStartE2EDuration="4.231287049s" podCreationTimestamp="2026-06-02 15:19:49 +0000 UTC" firstStartedPulling="2026-06-02 15:19:50.231416227 +0000 UTC m=+630.543263197" lastFinishedPulling="2026-06-02 15:19:52.81550302 +0000 UTC m=+633.127349977" observedRunningTime="2026-06-02 15:19:53.230208762 +0000 UTC m=+633.542055742" watchObservedRunningTime="2026-06-02 15:19:53.231287049 +0000 UTC m=+633.543134027" Jun 02 15:20:04.219230 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:20:04.219191 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-4q7lc" Jun 02 15:21:52.639535 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:52.639498 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6b989f9fdb-k6clr"] Jun 02 15:21:52.641797 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:52.641779 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6b989f9fdb-k6clr" Jun 02 15:21:52.644256 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:52.644234 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 02 15:21:52.644256 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:52.644244 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6b4gj\"" Jun 02 15:21:52.653303 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:52.653275 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6b989f9fdb-k6clr"] Jun 02 15:21:52.780890 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:52.780840 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf-maas-api-tls\") pod \"maas-api-6b989f9fdb-k6clr\" (UID: \"1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf\") " pod="opendatahub/maas-api-6b989f9fdb-k6clr" Jun 02 15:21:52.781077 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:52.780923 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zngd9\" (UniqueName: \"kubernetes.io/projected/1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf-kube-api-access-zngd9\") pod \"maas-api-6b989f9fdb-k6clr\" (UID: \"1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf\") " pod="opendatahub/maas-api-6b989f9fdb-k6clr" Jun 02 15:21:52.881710 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:52.881668 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf-maas-api-tls\") pod \"maas-api-6b989f9fdb-k6clr\" (UID: \"1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf\") " pod="opendatahub/maas-api-6b989f9fdb-k6clr" Jun 02 15:21:52.881927 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:52.881739 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zngd9\" (UniqueName: \"kubernetes.io/projected/1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf-kube-api-access-zngd9\") pod \"maas-api-6b989f9fdb-k6clr\" (UID: \"1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf\") " pod="opendatahub/maas-api-6b989f9fdb-k6clr" Jun 02 15:21:52.884434 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:52.884405 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf-maas-api-tls\") pod \"maas-api-6b989f9fdb-k6clr\" (UID: \"1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf\") " pod="opendatahub/maas-api-6b989f9fdb-k6clr" Jun 02 15:21:52.890177 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:52.890121 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zngd9\" (UniqueName: \"kubernetes.io/projected/1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf-kube-api-access-zngd9\") pod \"maas-api-6b989f9fdb-k6clr\" (UID: \"1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf\") " pod="opendatahub/maas-api-6b989f9fdb-k6clr" Jun 02 15:21:52.952933 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:52.952895 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6b989f9fdb-k6clr" Jun 02 15:21:53.100941 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:53.100913 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6b989f9fdb-k6clr"] Jun 02 15:21:53.103643 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:21:53.103599 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dde45b1_dcbc_4dd6_9c1b_cf48d5318cbf.slice/crio-8007db32445b1c79aa0612bf18dda2f58018dd4bd2c258bbab0e769c0a994f63 WatchSource:0}: Error finding container 8007db32445b1c79aa0612bf18dda2f58018dd4bd2c258bbab0e769c0a994f63: Status 404 returned error can't find the container with id 8007db32445b1c79aa0612bf18dda2f58018dd4bd2c258bbab0e769c0a994f63 Jun 02 15:21:53.182534 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:53.182434 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-75d9d88b9-tmjmg"] Jun 02 15:21:53.185359 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:53.185325 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-75d9d88b9-tmjmg" Jun 02 15:21:53.188101 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:53.188079 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-s27vl\"" Jun 02 15:21:53.188222 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:53.188079 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 02 15:21:53.209770 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:53.209738 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-75d9d88b9-tmjmg"] Jun 02 15:21:53.264658 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:53.264613 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4q7lc"] Jun 02 15:21:53.285521 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:53.285481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snwmz\" (UniqueName: \"kubernetes.io/projected/fa386394-14de-4553-8372-09ea7f4eba55-kube-api-access-snwmz\") pod \"payload-pre-processing-75d9d88b9-tmjmg\" (UID: \"fa386394-14de-4553-8372-09ea7f4eba55\") " pod="openshift-ingress/payload-pre-processing-75d9d88b9-tmjmg" Jun 02 15:21:53.386911 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:53.386865 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snwmz\" (UniqueName: \"kubernetes.io/projected/fa386394-14de-4553-8372-09ea7f4eba55-kube-api-access-snwmz\") pod \"payload-pre-processing-75d9d88b9-tmjmg\" (UID: \"fa386394-14de-4553-8372-09ea7f4eba55\") " pod="openshift-ingress/payload-pre-processing-75d9d88b9-tmjmg" Jun 02 15:21:53.396516 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:53.396479 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snwmz\" (UniqueName: \"kubernetes.io/projected/fa386394-14de-4553-8372-09ea7f4eba55-kube-api-access-snwmz\") pod \"payload-pre-processing-75d9d88b9-tmjmg\" (UID: \"fa386394-14de-4553-8372-09ea7f4eba55\") " pod="openshift-ingress/payload-pre-processing-75d9d88b9-tmjmg" Jun 02 15:21:53.497209 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:53.497126 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-75d9d88b9-tmjmg" Jun 02 15:21:53.638856 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:53.638808 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6b989f9fdb-k6clr" event={"ID":"1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf","Type":"ContainerStarted","Data":"8007db32445b1c79aa0612bf18dda2f58018dd4bd2c258bbab0e769c0a994f63"} Jun 02 15:21:53.643130 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:53.643067 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-75d9d88b9-tmjmg"] Jun 02 15:21:53.648751 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:21:53.648725 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa386394_14de_4553_8372_09ea7f4eba55.slice/crio-f9f5126695bb051f9135f0a2d98293410b720c93d09cb1c39c3bcd3354b778f5 WatchSource:0}: Error finding container f9f5126695bb051f9135f0a2d98293410b720c93d09cb1c39c3bcd3354b778f5: Status 404 returned error can't find the container with id f9f5126695bb051f9135f0a2d98293410b720c93d09cb1c39c3bcd3354b778f5 Jun 02 15:21:54.647054 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:54.647010 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-75d9d88b9-tmjmg" event={"ID":"fa386394-14de-4553-8372-09ea7f4eba55","Type":"ContainerStarted","Data":"f9f5126695bb051f9135f0a2d98293410b720c93d09cb1c39c3bcd3354b778f5"} Jun 02 15:21:56.656470 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:56.656433 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6b989f9fdb-k6clr" event={"ID":"1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf","Type":"ContainerStarted","Data":"5ce54b07058f86a157a0d3776b47e1b0120e01827bb3ae9a1e419ba0a5f9eda0"} Jun 02 15:21:56.656996 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:56.656544 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6b989f9fdb-k6clr" Jun 02 15:21:56.657969 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:56.657946 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-75d9d88b9-tmjmg" event={"ID":"fa386394-14de-4553-8372-09ea7f4eba55","Type":"ContainerStarted","Data":"ab262e374483762dbd88787eca12b5ce4da9d5bf1376d3c560df2a0f2122df93"} Jun 02 15:21:56.658072 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:56.658048 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-75d9d88b9-tmjmg" Jun 02 15:21:56.676129 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:56.676070 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6b989f9fdb-k6clr" podStartSLOduration=1.933218413 podStartE2EDuration="4.676051401s" podCreationTimestamp="2026-06-02 15:21:52 +0000 UTC" firstStartedPulling="2026-06-02 15:21:53.105182343 +0000 UTC m=+753.417029320" lastFinishedPulling="2026-06-02 15:21:55.848015348 +0000 UTC m=+756.159862308" observedRunningTime="2026-06-02 15:21:56.675600449 +0000 UTC m=+756.987447420" watchObservedRunningTime="2026-06-02 15:21:56.676051401 +0000 UTC m=+756.987898387" Jun 02 15:21:56.694363 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:21:56.694310 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-75d9d88b9-tmjmg" podStartSLOduration=1.496179529 podStartE2EDuration="3.694296932s" podCreationTimestamp="2026-06-02 15:21:53 +0000 UTC" firstStartedPulling="2026-06-02 15:21:53.651031044 +0000 UTC m=+753.962878006" lastFinishedPulling="2026-06-02 15:21:55.849148449 +0000 UTC m=+756.160995409" observedRunningTime="2026-06-02 15:21:56.691923494 +0000 UTC m=+757.003770474" watchObservedRunningTime="2026-06-02 15:21:56.694296932 +0000 UTC m=+757.006143911" Jun 02 15:22:02.668362 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:22:02.668330 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6b989f9fdb-k6clr" Jun 02 15:22:07.665337 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:22:07.665309 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-75d9d88b9-tmjmg" Jun 02 15:22:53.357837 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:22:53.357753 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4q7lc"] Jun 02 15:23:00.923866 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:00.923827 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v"] Jun 02 15:23:00.928104 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:00.928080 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:00.930745 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:00.930721 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 15:23:00.931898 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:00.931876 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 15:23:00.932045 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:00.931876 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tbtct\"" Jun 02 15:23:00.932045 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:00.931904 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 02 15:23:00.943242 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:00.943210 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v"] Jun 02 15:23:00.971458 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:00.971418 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:00.971458 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:00.971457 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:00.971706 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:00.971475 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:00.971706 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:00.971528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:00.971706 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:00.971630 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:00.971816 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:00.971707 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vljfg\" (UniqueName: \"kubernetes.io/projected/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-kube-api-access-vljfg\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:01.073063 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.073017 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vljfg\" (UniqueName: \"kubernetes.io/projected/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-kube-api-access-vljfg\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:01.073262 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.073087 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:01.073262 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.073120 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:01.073262 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.073142 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:01.073262 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.073164 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:01.073262 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.073198 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:01.073620 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.073563 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:01.073695 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.073675 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:01.073752 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.073736 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:01.075814 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.075790 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:01.075966 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.075947 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:01.084268 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.084240 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vljfg\" (UniqueName: \"kubernetes.io/projected/e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f-kube-api-access-vljfg\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xn87v\" (UID: \"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:01.240273 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.240177 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:23:01.402166 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.402129 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v"] Jun 02 15:23:01.405410 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:23:01.405378 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80a2eba_1fd0_4e32_8bb9_ce2de4cb9b6f.slice/crio-9705b573a9f7b86676651a3f72baf3ed1371f9ac1196ba69112ee8b28135f5ab WatchSource:0}: Error finding container 9705b573a9f7b86676651a3f72baf3ed1371f9ac1196ba69112ee8b28135f5ab: Status 404 returned error can't find the container with id 9705b573a9f7b86676651a3f72baf3ed1371f9ac1196ba69112ee8b28135f5ab Jun 02 15:23:01.644831 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.644795 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4q7lc"] Jun 02 15:23:01.900517 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:01.900424 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" event={"ID":"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f","Type":"ContainerStarted","Data":"9705b573a9f7b86676651a3f72baf3ed1371f9ac1196ba69112ee8b28135f5ab"} Jun 02 15:23:04.917282 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:04.917194 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" event={"ID":"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f","Type":"ContainerStarted","Data":"c82c58424bc3204d37e05c379a228ebea94d1910ec3c67e793aa730c24bb012a"} Jun 02 15:23:16.537126 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:16.537083 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4q7lc"] Jun 02 15:23:38.854531 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:38.854486 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4q7lc"] Jun 02 15:23:43.642423 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:43.642364 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4q7lc"] Jun 02 15:23:57.113204 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:57.113167 2565 generic.go:358] "Generic (PLEG): container finished" podID="e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f" containerID="c82c58424bc3204d37e05c379a228ebea94d1910ec3c67e793aa730c24bb012a" exitCode=0 Jun 02 15:23:57.113634 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:23:57.113241 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" event={"ID":"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f","Type":"ContainerDied","Data":"c82c58424bc3204d37e05c379a228ebea94d1910ec3c67e793aa730c24bb012a"} Jun 02 15:24:00.129197 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.129155 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" event={"ID":"e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f","Type":"ContainerStarted","Data":"a46fb087c848dc41ce407734824958822487bfd5487c7cf05f4dad3b9d6b789a"} Jun 02 15:24:00.149409 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.149353 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" podStartSLOduration=2.260954478 podStartE2EDuration="1m0.149335963s" podCreationTimestamp="2026-06-02 15:23:00 +0000 UTC" firstStartedPulling="2026-06-02 15:23:01.407234116 +0000 UTC m=+821.719081076" lastFinishedPulling="2026-06-02 15:23:59.295615602 +0000 UTC m=+879.607462561" observedRunningTime="2026-06-02 15:24:00.148341756 +0000 UTC m=+880.460188734" watchObservedRunningTime="2026-06-02 15:24:00.149335963 +0000 UTC m=+880.461182943" Jun 02 15:24:00.529834 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.529799 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq"] Jun 02 15:24:00.534309 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.534283 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.536934 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.536910 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 02 15:24:00.544714 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.544684 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq"] Jun 02 15:24:00.616442 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.616397 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8981587e-0d78-4726-8946-d5371550df30-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.616648 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.616461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzfxh\" (UniqueName: \"kubernetes.io/projected/8981587e-0d78-4726-8946-d5371550df30-kube-api-access-rzfxh\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.616648 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.616505 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8981587e-0d78-4726-8946-d5371550df30-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.616648 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.616531 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8981587e-0d78-4726-8946-d5371550df30-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.616648 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.616634 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8981587e-0d78-4726-8946-d5371550df30-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.616791 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.616696 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8981587e-0d78-4726-8946-d5371550df30-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.717314 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.717272 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8981587e-0d78-4726-8946-d5371550df30-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.717314 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.717313 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8981587e-0d78-4726-8946-d5371550df30-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.717565 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.717347 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8981587e-0d78-4726-8946-d5371550df30-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.717565 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.717393 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8981587e-0d78-4726-8946-d5371550df30-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.717565 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.717425 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzfxh\" (UniqueName: \"kubernetes.io/projected/8981587e-0d78-4726-8946-d5371550df30-kube-api-access-rzfxh\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.717565 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.717478 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8981587e-0d78-4726-8946-d5371550df30-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.717816 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.717788 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8981587e-0d78-4726-8946-d5371550df30-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.717816 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.717808 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8981587e-0d78-4726-8946-d5371550df30-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.717954 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.717877 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8981587e-0d78-4726-8946-d5371550df30-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.719894 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.719872 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8981587e-0d78-4726-8946-d5371550df30-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.720097 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.720083 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8981587e-0d78-4726-8946-d5371550df30-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.725835 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.725808 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzfxh\" (UniqueName: \"kubernetes.io/projected/8981587e-0d78-4726-8946-d5371550df30-kube-api-access-rzfxh\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq\" (UID: \"8981587e-0d78-4726-8946-d5371550df30\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.846079 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.845980 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" Jun 02 15:24:00.982220 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:00.982178 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq"] Jun 02 15:24:00.985416 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:24:00.985389 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8981587e_0d78_4726_8946_d5371550df30.slice/crio-e47a2635701111d37310007f624970c339faf6bec816f6be9ede84a27d1abff1 WatchSource:0}: Error finding container e47a2635701111d37310007f624970c339faf6bec816f6be9ede84a27d1abff1: Status 404 returned error can't find the container with id e47a2635701111d37310007f624970c339faf6bec816f6be9ede84a27d1abff1 Jun 02 15:24:01.138178 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:01.138077 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" event={"ID":"8981587e-0d78-4726-8946-d5371550df30","Type":"ContainerStarted","Data":"eaa4aed83794e3e579e67373da94e976aca38a161d06444164f7c636f1fcb12c"} Jun 02 15:24:01.138178 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:01.138126 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq" event={"ID":"8981587e-0d78-4726-8946-d5371550df30","Type":"ContainerStarted","Data":"e47a2635701111d37310007f624970c339faf6bec816f6be9ede84a27d1abff1"} Jun 02 15:24:01.240444 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:01.240409 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:24:01.240650 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:01.240513 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:24:01.259583 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:01.259545 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:24:02.153832 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:02.153754 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xn87v" Jun 02 15:24:02.444306 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:02.444214 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4q7lc"] Jun 02 15:24:20.152102 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:20.152070 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-acl-logging/0.log" Jun 02 15:24:20.154861 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:24:20.154835 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-acl-logging/0.log" Jun 02 15:29:20.178425 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:20.178396 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-acl-logging/0.log" Jun 02 15:29:20.181998 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:20.181977 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-acl-logging/0.log" Jun 02 15:29:46.257743 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:46.257707 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq_8981587e-0d78-4726-8946-d5371550df30/storage-initializer/0.log" Jun 02 15:29:51.981057 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:51.981026 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5678dd97d5-2cvqw_0de93934-910c-4c6e-9311-9efd4c4e6910/nginx/0.log" Jun 02 15:29:52.211292 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:52.211240 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-nck5g_6e3faa46-1b20-4b03-9eb5-d9db1eb7982c/manager/0.log" Jun 02 15:29:52.330949 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:52.330909 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-zwk5l_72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2/manager/0.log" Jun 02 15:29:52.454731 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:52.454697 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6b989f9fdb-k6clr_1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf/maas-api/0.log" Jun 02 15:29:52.722641 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:52.722527 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-7cdhz_b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f/server/0.log" Jun 02 15:29:52.840608 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:52.840545 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-ks2zx_530fb8ca-172f-409a-a3e6-f588114b7adb/manager/0.log" Jun 02 15:29:52.953379 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:52.953342 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5889c5df7b-5fh7h_e7ca39fb-ff88-490c-8d0b-828a531bbe0f/copy-manifests/0.log" Jun 02 15:29:52.974083 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:52.973989 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5889c5df7b-5fh7h_e7ca39fb-ff88-490c-8d0b-828a531bbe0f/manager/0.log" Jun 02 15:29:54.916622 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:54.916588 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-4w55m_44c6a4bb-5c67-4b93-8d88-ecc9eca96b2e/manager/0.log" Jun 02 15:29:55.439195 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:55.439160 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-4q7lc_31c8f4ee-a296-478e-9ccc-7f21794b0009/limitador/0.log" Jun 02 15:29:55.558382 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:55.558354 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-xqjb8_3d803013-7a84-4b70-8782-33521db9b555/manager/0.log" Jun 02 15:29:56.085650 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:56.085618 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-qk59p_f1592546-934d-440b-a9ff-fb296f685641/discovery/0.log" Jun 02 15:29:56.343359 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:56.343269 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c6f598cb-wnh97_bae4275c-6874-416e-b748-6520993540c3/kube-auth-proxy/0.log" Jun 02 15:29:56.592737 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:56.592705 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-75d9d88b9-tmjmg_fa386394-14de-4553-8372-09ea7f4eba55/payload-pre-processing/0.log" Jun 02 15:29:57.371118 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:57.371088 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-xn87v_e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f/storage-initializer/0.log" Jun 02 15:29:57.379670 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:57.379636 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-xn87v_e80a2eba-1fd0-4e32-8bb9-ce2de4cb9b6f/main/0.log" Jun 02 15:29:57.902139 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:29:57.902107 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-9lwfq_8981587e-0d78-4726-8946-d5371550df30/storage-initializer/0.log" Jun 02 15:30:05.875776 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:05.875682 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vvmdt_45a8a35d-8eca-4e5c-ac40-9752b116226e/global-pull-secret-syncer/0.log" Jun 02 15:30:05.991531 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:05.991480 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xlwcz_61aec005-b203-495a-8b3f-010f0d122d22/konnectivity-agent/0.log" Jun 02 15:30:06.063192 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:06.063163 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-77.ec2.internal_c658f17ddd141ce427e5f4dbd67615e5/haproxy/0.log" Jun 02 15:30:10.525351 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:10.525253 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-4w55m_44c6a4bb-5c67-4b93-8d88-ecc9eca96b2e/manager/0.log" Jun 02 15:30:10.692788 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:10.692752 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-4q7lc_31c8f4ee-a296-478e-9ccc-7f21794b0009/limitador/0.log" Jun 02 15:30:10.723441 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:10.723408 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-xqjb8_3d803013-7a84-4b70-8782-33521db9b555/manager/0.log" Jun 02 15:30:12.642396 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:12.642363 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z5qpr_ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9/node-exporter/0.log" Jun 02 15:30:12.660887 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:12.660856 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z5qpr_ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9/kube-rbac-proxy/0.log" Jun 02 15:30:12.682886 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:12.682857 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z5qpr_ddb5a94a-8eb3-4481-a742-a3bd5bc3ebd9/init-textfile/0.log" Jun 02 15:30:12.710794 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:12.710764 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-2rs28_63471a61-0d20-48de-8e1e-56001ab023c9/kube-rbac-proxy-main/0.log" Jun 02 15:30:12.735059 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:12.735026 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-2rs28_63471a61-0d20-48de-8e1e-56001ab023c9/kube-rbac-proxy-self/0.log" Jun 02 15:30:12.757120 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:12.757089 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-2rs28_63471a61-0d20-48de-8e1e-56001ab023c9/openshift-state-metrics/0.log" Jun 02 15:30:12.953918 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:12.953823 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-cpdds_04c3a471-c5f8-495a-bef9-316839649880/prometheus-operator/0.log" Jun 02 15:30:12.970657 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:12.970628 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-cpdds_04c3a471-c5f8-495a-bef9-316839649880/kube-rbac-proxy/0.log" Jun 02 15:30:15.381178 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.381151 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-569bfc8846-xrtjx_3d34683b-3dcf-447c-9402-cc8238bd9976/console/0.log" Jun 02 15:30:15.609722 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.609688 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb"] Jun 02 15:30:15.613222 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.613204 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.615931 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.615913 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x79r2\"/\"openshift-service-ca.crt\"" Jun 02 15:30:15.616017 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.615917 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x79r2\"/\"default-dockercfg-rwpxj\"" Jun 02 15:30:15.616930 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.616900 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x79r2\"/\"kube-root-ca.crt\"" Jun 02 15:30:15.622860 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.622833 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb"] Jun 02 15:30:15.649486 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.649390 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/398922c3-6159-4b29-9af4-89983c360a42-sys\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.649486 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.649429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/398922c3-6159-4b29-9af4-89983c360a42-proc\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.649486 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.649447 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/398922c3-6159-4b29-9af4-89983c360a42-lib-modules\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.649747 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.649565 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxj6w\" (UniqueName: \"kubernetes.io/projected/398922c3-6159-4b29-9af4-89983c360a42-kube-api-access-rxj6w\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.649747 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.649672 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/398922c3-6159-4b29-9af4-89983c360a42-podres\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.750546 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.750504 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/398922c3-6159-4b29-9af4-89983c360a42-sys\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.750546 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.750549 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/398922c3-6159-4b29-9af4-89983c360a42-proc\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.750790 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.750595 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/398922c3-6159-4b29-9af4-89983c360a42-lib-modules\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.750790 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.750656 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxj6w\" (UniqueName: \"kubernetes.io/projected/398922c3-6159-4b29-9af4-89983c360a42-kube-api-access-rxj6w\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.750790 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.750655 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/398922c3-6159-4b29-9af4-89983c360a42-sys\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.750790 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.750655 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/398922c3-6159-4b29-9af4-89983c360a42-proc\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.750790 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.750713 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/398922c3-6159-4b29-9af4-89983c360a42-podres\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.750790 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.750761 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/398922c3-6159-4b29-9af4-89983c360a42-lib-modules\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.751006 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.750838 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/398922c3-6159-4b29-9af4-89983c360a42-podres\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.760036 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.760009 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxj6w\" (UniqueName: \"kubernetes.io/projected/398922c3-6159-4b29-9af4-89983c360a42-kube-api-access-rxj6w\") pod \"perf-node-gather-daemonset-mjqrb\" (UID: \"398922c3-6159-4b29-9af4-89983c360a42\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.925110 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.925013 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:15.998402 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:15.998370 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-zdpcw_c3affaa5-5d87-4388-8c6f-00f698d7dee1/volume-data-source-validator/0.log" Jun 02 15:30:16.064614 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:16.064585 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb"] Jun 02 15:30:16.067101 ip-10-0-136-77 kubenswrapper[2565]: W0602 15:30:16.067060 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod398922c3_6159_4b29_9af4_89983c360a42.slice/crio-819ee639bf264ff525b371632bf9137a18c8be2e2e48de070ae3966b92662d2b WatchSource:0}: Error finding container 819ee639bf264ff525b371632bf9137a18c8be2e2e48de070ae3966b92662d2b: Status 404 returned error can't find the container with id 819ee639bf264ff525b371632bf9137a18c8be2e2e48de070ae3966b92662d2b Jun 02 15:30:16.068744 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:16.068728 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:30:16.545370 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:16.545332 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" event={"ID":"398922c3-6159-4b29-9af4-89983c360a42","Type":"ContainerStarted","Data":"f0b866a0a73c84c0b9765a804b347443b7a1b65b842860dd285493f4b4e130b4"} Jun 02 15:30:16.545370 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:16.545368 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" event={"ID":"398922c3-6159-4b29-9af4-89983c360a42","Type":"ContainerStarted","Data":"819ee639bf264ff525b371632bf9137a18c8be2e2e48de070ae3966b92662d2b"} Jun 02 15:30:16.545828 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:16.545402 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:16.561111 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:16.561064 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" podStartSLOduration=1.561046596 podStartE2EDuration="1.561046596s" podCreationTimestamp="2026-06-02 15:30:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:30:16.560844059 +0000 UTC m=+1256.872691040" watchObservedRunningTime="2026-06-02 15:30:16.561046596 +0000 UTC m=+1256.872893577" Jun 02 15:30:16.826021 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:16.825932 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-frjk8_33d76fef-113f-48b8-992c-fd381b37c57b/dns/0.log" Jun 02 15:30:16.847245 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:16.847216 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-frjk8_33d76fef-113f-48b8-992c-fd381b37c57b/kube-rbac-proxy/0.log" Jun 02 15:30:16.956732 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:16.956704 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rxpl6_b850fa03-c11b-4f51-bd9b-fcb48c57c6c4/dns-node-resolver/0.log" Jun 02 15:30:17.443178 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:17.443149 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kxx6p_8f146772-5c11-4d4a-b181-c3a97f443e05/node-ca/0.log" Jun 02 15:30:18.444290 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:18.444254 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-qk59p_f1592546-934d-440b-a9ff-fb296f685641/discovery/0.log" Jun 02 15:30:18.490183 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:18.490143 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c6f598cb-wnh97_bae4275c-6874-416e-b748-6520993540c3/kube-auth-proxy/0.log" Jun 02 15:30:18.540898 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:18.540859 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-75d9d88b9-tmjmg_fa386394-14de-4553-8372-09ea7f4eba55/payload-pre-processing/0.log" Jun 02 15:30:19.213031 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:19.212998 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dfdxt_9ac0a463-e368-474d-a22b-d8dd24084eb1/serve-healthcheck-canary/0.log" Jun 02 15:30:19.726495 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:19.726459 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-s9rmk_3ab7438d-cd06-4152-8cf7-0f5478311866/insights-operator/0.log" Jun 02 15:30:19.727045 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:19.727024 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-s9rmk_3ab7438d-cd06-4152-8cf7-0f5478311866/insights-operator/1.log" Jun 02 15:30:19.957429 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:19.957383 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7tjj_84e8b11e-9d01-4955-bc4e-5bba08f7936a/kube-rbac-proxy/0.log" Jun 02 15:30:19.979527 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:19.979445 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7tjj_84e8b11e-9d01-4955-bc4e-5bba08f7936a/exporter/0.log" Jun 02 15:30:19.999974 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:19.999946 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7tjj_84e8b11e-9d01-4955-bc4e-5bba08f7936a/extractor/0.log" Jun 02 15:30:22.055788 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:22.055756 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5678dd97d5-2cvqw_0de93934-910c-4c6e-9311-9efd4c4e6910/nginx/0.log" Jun 02 15:30:22.106130 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:22.106098 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-nck5g_6e3faa46-1b20-4b03-9eb5-d9db1eb7982c/manager/0.log" Jun 02 15:30:22.150850 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:22.150800 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-zwk5l_72ca08fa-7ac1-42e6-9fd2-1362ae7fa7a2/manager/0.log" Jun 02 15:30:22.179510 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:22.179469 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6b989f9fdb-k6clr_1dde45b1-dcbc-4dd6-9c1b-cf48d5318cbf/maas-api/0.log" Jun 02 15:30:22.252026 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:22.251998 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-7cdhz_b1dd9ae3-815b-48c3-9fc5-9af9755a3b1f/server/0.log" Jun 02 15:30:22.321075 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:22.320994 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-ks2zx_530fb8ca-172f-409a-a3e6-f588114b7adb/manager/0.log" Jun 02 15:30:22.444114 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:22.444077 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5889c5df7b-5fh7h_e7ca39fb-ff88-490c-8d0b-828a531bbe0f/manager/0.log" Jun 02 15:30:22.465823 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:22.465796 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5889c5df7b-5fh7h_e7ca39fb-ff88-490c-8d0b-828a531bbe0f/copy-manifests/0.log" Jun 02 15:30:22.560286 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:22.560254 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mjqrb" Jun 02 15:30:28.911072 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:28.911037 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-4skzw_d9fb428e-1712-485e-9b85-a5db6002b679/migrator/0.log" Jun 02 15:30:28.957199 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:28.957166 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-4skzw_d9fb428e-1712-485e-9b85-a5db6002b679/graceful-termination/0.log" Jun 02 15:30:29.407187 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:29.407137 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-8tzc6_ce14a81f-869c-4e74-b7e1-40ea53c1e877/kube-storage-version-migrator-operator/1.log" Jun 02 15:30:29.408986 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:29.408961 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-8tzc6_ce14a81f-869c-4e74-b7e1-40ea53c1e877/kube-storage-version-migrator-operator/0.log" Jun 02 15:30:30.463161 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:30.463132 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4nzcf_618ed771-f69b-4815-8098-7ea7650b2584/kube-multus-additional-cni-plugins/0.log" Jun 02 15:30:30.485233 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:30.485205 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4nzcf_618ed771-f69b-4815-8098-7ea7650b2584/egress-router-binary-copy/0.log" Jun 02 15:30:30.504507 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:30.504475 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4nzcf_618ed771-f69b-4815-8098-7ea7650b2584/cni-plugins/0.log" Jun 02 15:30:30.527219 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:30.527191 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4nzcf_618ed771-f69b-4815-8098-7ea7650b2584/bond-cni-plugin/0.log" Jun 02 15:30:30.548177 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:30.548145 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4nzcf_618ed771-f69b-4815-8098-7ea7650b2584/routeoverride-cni/0.log" Jun 02 15:30:30.568142 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:30.568112 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4nzcf_618ed771-f69b-4815-8098-7ea7650b2584/whereabouts-cni-bincopy/0.log" Jun 02 15:30:30.592160 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:30.592132 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4nzcf_618ed771-f69b-4815-8098-7ea7650b2584/whereabouts-cni/0.log" Jun 02 15:30:30.960920 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:30.960882 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vwvx6_1087c955-eb48-4cf5-90be-2360a5374097/kube-multus/0.log" Jun 02 15:30:31.060848 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:31.060806 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b9dfl_9b4c9ae9-da6d-4818-ab9e-a67012f72b1d/network-metrics-daemon/0.log" Jun 02 15:30:31.080674 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:31.080640 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b9dfl_9b4c9ae9-da6d-4818-ab9e-a67012f72b1d/kube-rbac-proxy/0.log" Jun 02 15:30:32.014888 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:32.014850 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-controller/0.log" Jun 02 15:30:32.032580 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:32.032548 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-acl-logging/0.log" Jun 02 15:30:32.044190 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:32.044156 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovn-acl-logging/1.log" Jun 02 15:30:32.068934 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:32.068905 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/kube-rbac-proxy-node/0.log" Jun 02 15:30:32.092223 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:32.092192 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 15:30:32.112432 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:32.112406 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/northd/0.log" Jun 02 15:30:32.135765 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:32.135736 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/nbdb/0.log" Jun 02 15:30:32.158152 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:32.158121 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/sbdb/0.log" Jun 02 15:30:32.332511 ip-10-0-136-77 kubenswrapper[2565]: I0602 15:30:32.332471 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6xmhn_87829040-0b55-4e0c-bee5-95b95bc8d9b7/ovnkube-controller/0.log"