Jul 29 17:32:39.597345 ip-10-0-131-247 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 17:32:39.597358 ip-10-0-131-247 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 17:32:39.597367 ip-10-0-131-247 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 17:32:39.597727 ip-10-0-131-247 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 17:32:49.727968 ip-10-0-131-247 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 17:32:49.727990 ip-10-0-131-247 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2650dedf0ce64e4c821bf365b14f62f7 -- Jul 29 17:34:42.310550 ip-10-0-131-247 systemd[1]: Starting Kubernetes Kubelet... Jul 29 17:34:42.724254 ip-10-0-131-247 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 17:34:42.724254 ip-10-0-131-247 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 17:34:42.724254 ip-10-0-131-247 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 17:34:42.724254 ip-10-0-131-247 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 17:34:42.724254 ip-10-0-131-247 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 17:34:42.726228 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.726070 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 17:34:42.731865 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731839 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:42.731865 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731860 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:42.731865 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731864 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:42.731865 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731867 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:42.731865 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731871 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:42.731865 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731874 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731877 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731881 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731886 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731889 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731894 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731897 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731901 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731904 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731907 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731909 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731912 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731915 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731919 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731923 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731929 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731933 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731936 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731939 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:42.732090 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731942 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731945 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731948 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731951 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731953 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731956 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731959 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731961 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731964 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731969 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731972 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731976 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731978 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731982 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731985 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731990 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731994 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.731997 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732000 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732004 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:42.732553 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732007 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732013 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732016 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732018 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732021 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732024 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732026 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732029 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732032 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732035 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732038 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732040 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732043 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732048 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732051 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732054 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732056 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732059 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732062 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:42.733049 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732064 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732067 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732070 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732072 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732076 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732079 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732082 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732087 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732090 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732093 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732096 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732099 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732102 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732105 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732108 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732111 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732114 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732117 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732120 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732122 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:42.733678 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732128 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732130 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732133 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732137 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732140 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732143 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732146 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732149 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732152 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732155 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732157 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732164 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732168 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732171 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732173 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.732176 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733523 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733535 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733539 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733542 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:42.734242 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733545 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733548 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733551 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733554 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733557 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733559 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733563 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733566 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733569 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733573 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733575 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733578 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733580 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733583 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733586 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733589 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733591 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733594 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733597 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733600 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:42.734842 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733602 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733607 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733611 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733614 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733617 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733619 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733622 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733624 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733627 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733630 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733633 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733636 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733638 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733641 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733643 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733646 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733649 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733651 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733658 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:42.735351 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733661 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733666 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733672 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733675 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733680 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733683 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733686 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733691 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733694 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733698 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733701 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733705 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733707 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733711 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733714 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733718 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733721 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733725 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733728 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733731 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:42.735820 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733733 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733736 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733740 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733742 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733745 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733748 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733751 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733753 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733756 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733759 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733761 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733764 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733766 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733769 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733771 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733774 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733778 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733781 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733783 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733786 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:42.736315 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733789 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733792 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733795 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733798 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733800 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733803 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733806 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733808 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733811 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733813 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733816 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733818 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733821 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733823 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733828 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.733832 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734247 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734253 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734257 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:42.736815 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734260 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734263 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734266 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734269 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734272 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734275 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734277 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734280 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734283 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734285 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734288 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734290 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734293 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734297 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734299 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734302 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734305 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734307 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734310 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734313 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:42.737295 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734315 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734318 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734321 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734323 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734326 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734328 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734331 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734334 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734337 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734340 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734342 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734345 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734348 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734350 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734353 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734355 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734358 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734360 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734363 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734366 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:42.737766 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734368 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734371 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734373 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734376 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734378 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734381 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734384 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734386 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734389 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734392 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734394 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734403 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734407 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734411 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734415 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734417 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734420 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734423 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734426 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:42.738263 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734431 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734434 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734438 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734442 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734445 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734448 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734450 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734453 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734456 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734459 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734463 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734466 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734468 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734471 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734473 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734476 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734478 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734480 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734483 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:42.738724 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734486 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734489 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734491 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734494 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734496 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734499 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734501 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734504 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734506 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734512 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734515 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734518 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734520 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734523 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734526 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734528 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734531 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.734533 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734610 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734617 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734623 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 17:34:42.739278 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734629 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734636 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734640 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734647 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734654 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734657 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734660 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734664 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734667 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734670 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734673 2578 flags.go:64] FLAG: --cgroup-root="" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734676 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734679 2578 flags.go:64] FLAG: --client-ca-file="" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734683 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734686 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734690 2578 flags.go:64] FLAG: --cluster-domain="" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734693 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734696 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734699 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734702 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734709 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734713 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734716 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 17:34:42.739812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734719 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734722 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734725 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734728 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734731 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734734 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734738 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734741 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734744 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734747 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734751 2578 flags.go:64] FLAG: --enable-server="true" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734753 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734760 2578 flags.go:64] FLAG: --event-burst="100" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734764 2578 flags.go:64] FLAG: --event-qps="50" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734767 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734770 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734773 2578 flags.go:64] FLAG: --eviction-hard="" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734777 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734779 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734782 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734785 2578 flags.go:64] FLAG: --eviction-soft="" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734788 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734791 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734794 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734797 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 17:34:42.740384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734800 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734803 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734807 2578 flags.go:64] FLAG: --feature-gates="" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734811 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734815 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734818 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734821 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734824 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734827 2578 flags.go:64] FLAG: --help="false" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734830 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-131-247.ec2.internal" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734833 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734836 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734839 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734842 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734845 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734848 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734852 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734854 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734858 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734860 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734864 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734867 2578 flags.go:64] FLAG: --kube-reserved="" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734870 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734872 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 17:34:42.740995 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734876 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734879 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734882 2578 flags.go:64] FLAG: --lock-file="" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734884 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734887 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734890 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734896 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734899 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734902 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734904 2578 flags.go:64] FLAG: --logging-format="text" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734908 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734912 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734916 2578 flags.go:64] FLAG: --manifest-url="" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734919 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734923 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734926 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734930 2578 flags.go:64] FLAG: --max-pods="110" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734934 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734937 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734940 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734942 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734945 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734948 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734951 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734959 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 17:34:42.741597 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734962 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734965 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734968 2578 flags.go:64] FLAG: --pod-cidr="" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734971 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734978 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734980 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734983 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734986 2578 flags.go:64] FLAG: --port="10250" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734990 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734992 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00adf14dde8f89253" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734996 2578 flags.go:64] FLAG: --qos-reserved="" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.734999 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735002 2578 flags.go:64] FLAG: --register-node="true" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735005 2578 flags.go:64] FLAG: --register-with-taints="" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735008 2578 flags.go:64] FLAG: --registry-burst="10" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735011 2578 flags.go:64] FLAG: --registry-qps="5" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735014 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735019 2578 flags.go:64] FLAG: --reserved-memory="" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735022 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735025 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735030 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735033 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735035 2578 flags.go:64] FLAG: --runonce="false" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735038 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735041 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 17:34:42.742237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735044 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735047 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735050 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735053 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735056 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735059 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735061 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735064 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735067 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735070 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735073 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735076 2578 flags.go:64] FLAG: --system-cgroups="" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735078 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735084 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735087 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735090 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735093 2578 flags.go:64] FLAG: --tls-min-version="" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735095 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735098 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735101 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735103 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735106 2578 flags.go:64] FLAG: --v="2" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735110 2578 flags.go:64] FLAG: --version="false" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735115 2578 flags.go:64] FLAG: --vmodule="" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735120 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 17:34:42.742895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.735123 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735276 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735282 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735285 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735288 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735291 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735294 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735297 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735299 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735302 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735305 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735308 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735311 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735313 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735316 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735318 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735321 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735324 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735327 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:42.743512 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735331 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735334 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735337 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735340 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735344 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735347 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735350 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735353 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735356 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735359 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735362 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735365 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735370 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735373 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735375 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735379 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735382 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735385 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735387 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735390 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:42.743981 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735392 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735395 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735399 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735402 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735405 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735408 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735410 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735413 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735416 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735419 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735421 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735424 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735427 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735429 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735432 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735434 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735437 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735439 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735442 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:42.744497 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735444 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735447 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735449 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735452 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735455 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735458 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735461 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735464 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735468 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735471 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735473 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735476 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735478 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735481 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735483 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735486 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735489 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735492 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735494 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735497 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:42.744960 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735499 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735502 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735504 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735506 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735509 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735512 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735514 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735517 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735519 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735522 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735525 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735527 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735530 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735532 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735535 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735537 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735540 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735543 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735546 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735549 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:42.745465 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735553 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.735555 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.736358 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.743381 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.743399 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.744239 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.744246 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744308 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744314 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744317 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744321 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744323 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744327 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744330 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744332 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:42.745958 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744335 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744338 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744341 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744343 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744346 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744349 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744351 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744354 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744357 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744359 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744362 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744364 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744367 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744369 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744372 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744374 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744377 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744380 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744383 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744386 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:42.746350 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744389 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744393 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744395 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744398 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744401 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744404 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744406 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744409 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744412 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744414 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744417 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744421 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744425 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744428 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744431 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744433 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744436 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744439 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744441 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:42.746832 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744444 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744447 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744449 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744452 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744454 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744457 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744459 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744462 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744465 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744467 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744471 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744475 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744478 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744482 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744485 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744488 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744491 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744494 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744496 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:42.747320 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744499 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744502 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744505 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744507 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744510 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744513 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744516 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744518 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744521 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744523 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744526 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744529 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744532 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744535 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744538 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744541 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744544 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744547 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744550 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:42.747781 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744553 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744555 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744558 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744561 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744564 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744566 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744569 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744572 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744575 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744578 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744581 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744584 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744586 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744589 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.744594 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 17:34:42.748301 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744730 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744736 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744739 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744742 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744745 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744748 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744750 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744753 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744756 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744759 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744761 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744764 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744766 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744769 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744772 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744776 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744779 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744782 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744785 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744787 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:42.748679 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744790 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744792 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744795 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744797 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744800 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744803 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744806 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744810 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744814 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744817 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744819 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744822 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744825 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744827 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744830 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744833 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744835 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744838 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744840 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:42.749175 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744842 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744845 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744847 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744850 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744852 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744855 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744857 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744860 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744863 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744865 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744868 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744870 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744873 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744875 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744878 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744880 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744882 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744885 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744888 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744891 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:42.749650 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744894 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744896 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744899 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744902 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744905 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744907 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744910 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744912 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744915 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744917 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744920 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744922 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744925 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744927 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744930 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744932 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744935 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744938 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744940 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744943 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:42.750132 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744945 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744948 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744950 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744953 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744955 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744959 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744962 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744965 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744968 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744971 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744974 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744977 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744980 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744983 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744986 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744989 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744991 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744994 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744996 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:42.750628 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:42.744999 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:42.751085 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.745003 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 17:34:42.751085 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.745131 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 17:34:42.751085 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.747144 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 17:34:42.751085 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.748706 2578 server.go:1019] "Starting client certificate rotation" Jul 29 17:34:42.751085 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.748807 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 17:34:42.751085 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.749473 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 17:34:42.751357 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.751343 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 17:34:42.754662 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.754646 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 17:34:42.768473 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.768445 2578 log.go:25] "Validated CRI v1 runtime API" Jul 29 17:34:42.771310 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.771296 2578 log.go:25] "Validated CRI v1 image API" Jul 29 17:34:42.772085 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.772063 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 17:34:42.774881 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.774848 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7f3cf9ce-4a42-4730-b663-4e2a4eac041c:/dev/nvme0n1p3 ce559ae1-3b7c-4b65-a868-dee0ff449aa1:/dev/nvme0n1p4] Jul 29 17:34:42.774949 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.774876 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 17:34:42.777253 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.777237 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 17:34:42.780432 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.780294 2578 manager.go:216] Machine: {Timestamp:2026-07-29 17:34:42.778866671 +0000 UTC m=+0.347233536 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097382 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20ffc8497c92dc6b1ef58b98268b9f SystemUUID:ec20ffc8-497c-92dc-6b1e-f58b98268b9f BootID:2650dedf-0ce6-4e4c-821b-f365b14f62f7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:da:25:b4:74:c9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:da:25:b4:74:c9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:4c:87:ae:84:0f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 17:34:42.780432 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.780423 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 17:34:42.780547 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.780507 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 17:34:42.783726 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.783698 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 17:34:42.783875 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.783733 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-247.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 17:34:42.785468 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.785457 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 17:34:42.785507 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.785471 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 17:34:42.785507 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.785479 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 17:34:42.786410 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.786394 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 17:34:42.787774 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.787764 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 17:34:42.790882 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.790870 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 29 17:34:42.791000 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.790991 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 17:34:42.791034 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.791023 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 29 17:34:42.791034 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.791034 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 17:34:42.791084 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.791044 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 17:34:42.791084 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.791059 2578 kubelet.go:398] "Adding apiserver pod source" Jul 29 17:34:42.791084 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.791068 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 17:34:42.791487 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.791474 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 17:34:42.791545 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.791496 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 17:34:42.793852 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.793834 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 17:34:42.795338 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.795324 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 17:34:42.795395 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.795355 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 17:34:42.796016 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.796006 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 17:34:42.796046 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.796020 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 17:34:42.796046 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.796027 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 17:34:42.796046 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.796032 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 17:34:42.796046 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.796040 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 17:34:42.796046 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.796046 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 17:34:42.796212 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.796202 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 17:34:42.796212 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.796212 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 17:34:42.796296 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.796236 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 17:34:42.796296 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.796242 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 17:34:42.796296 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.796251 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 17:34:42.796296 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.796258 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 17:34:42.798068 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.798058 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 17:34:42.798068 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.798067 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 17:34:42.801336 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.801321 2578 server.go:1268] "Started kubelet" Jul 29 17:34:42.801487 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.801454 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 17:34:42.801591 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.801438 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 17:34:42.801591 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.801578 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 17:34:42.801714 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.801690 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-247.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 17:34:42.802261 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.802242 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-58x7j" Jul 29 17:34:42.802284 ip-10-0-131-247 systemd[1]: Started Kubernetes Kubelet. Jul 29 17:34:42.802533 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:42.802493 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 17:34:42.802533 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:42.802495 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 17:34:42.803295 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.803241 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 17:34:42.804069 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.804046 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 29 17:34:42.807340 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:42.807319 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 17:34:42.808908 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.808891 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-58x7j" Jul 29 17:34:42.810328 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.810313 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 17:34:42.810328 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.810323 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 17:34:42.810515 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:42.810487 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:42.810884 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:42.809743 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-247.ec2.internal.18c6d32abc5d3624 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-247.ec2.internal,UID:ip-10-0-131-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-247.ec2.internal,},FirstTimestamp:2026-07-29 17:34:42.801292836 +0000 UTC m=+0.369659698,LastTimestamp:2026-07-29 17:34:42.801292836 +0000 UTC m=+0.369659698,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-247.ec2.internal,}" Jul 29 17:34:42.810999 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.810928 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 17:34:42.810999 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.810931 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 17:34:42.810999 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.810951 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 17:34:42.811137 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.811124 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 29 17:34:42.811137 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.811135 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 29 17:34:42.811211 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.811159 2578 factory.go:55] Registering systemd factory Jul 29 17:34:42.811211 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.811175 2578 factory.go:223] Registration of the systemd container factory successfully Jul 29 17:34:42.811445 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.811421 2578 factory.go:153] Registering CRI-O factory Jul 29 17:34:42.811518 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.811448 2578 factory.go:223] Registration of the crio container factory successfully Jul 29 17:34:42.811518 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.811512 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 17:34:42.811620 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.811537 2578 factory.go:103] Registering Raw factory Jul 29 17:34:42.811620 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.811555 2578 manager.go:1196] Started watching for new ooms in manager Jul 29 17:34:42.811891 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.811877 2578 manager.go:349] Starting recovery of all containers Jul 29 17:34:42.818925 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:42.815867 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 17:34:42.818925 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:42.815936 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 17:34:42.818925 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.818864 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 17:34:42.821800 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.821779 2578 manager.go:354] Recovery completed Jul 29 17:34:42.826831 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.826817 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:42.828998 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.828984 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:42.829052 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.829012 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:42.829052 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.829024 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:42.829574 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.829561 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 17:34:42.829632 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.829574 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 17:34:42.829632 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.829590 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 29 17:34:42.829699 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.829648 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:42.830823 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.830806 2578 policy_none.go:49] "None policy: Start" Jul 29 17:34:42.830918 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.830828 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 17:34:42.830918 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.830842 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 17:34:42.830994 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.830957 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:42.830994 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.830990 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:42.831050 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.831000 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:42.832030 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:42.832019 2578 policy_none.go:47] "Start" Jul 29 17:34:44.837486 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.837319 2578 manager.go:337] "Starting Device Plugin manager" Jul 29 17:34:44.837618 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:44.837520 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 17:34:44.837618 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.837535 2578 server.go:87] "Starting device plugin registration server" Jul 29 17:34:44.837817 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.837805 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 17:34:44.837875 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.837818 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 17:34:44.838037 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.838018 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 17:34:44.838137 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.838106 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 17:34:44.838137 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.838115 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 17:34:44.838515 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:44.838492 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 17:34:44.838602 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:44.838542 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:44.936740 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.936699 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 17:34:44.937975 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.936755 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 17:34:44.937975 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.936779 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 17:34:44.937975 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:44.936813 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 17:34:44.938164 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.938130 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:44.938981 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.938964 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:44.939052 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.938993 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:44.939052 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.939005 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:44.939052 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.939027 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-247.ec2.internal" Jul 29 17:34:44.939221 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.939207 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:44.947344 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:44.947327 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-247.ec2.internal" Jul 29 17:34:44.947429 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:44.947351 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-247.ec2.internal\": node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:44.961930 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:44.961907 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:45.037294 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.037253 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-247.ec2.internal"] Jul 29 17:34:45.037453 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.037342 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:45.038540 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.038525 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:45.038609 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.038560 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:45.038609 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.038570 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:45.039920 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.039906 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:45.040082 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.040067 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.040119 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.040100 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:45.040791 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.040768 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:45.040895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.040798 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:45.040895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.040808 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:45.040895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.040775 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:45.040895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.040871 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:45.040895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.040883 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:45.042230 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.042214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.042327 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.042238 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:45.042974 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.042958 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:45.043061 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.042986 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:45.043061 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.042997 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:45.062298 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:45.062273 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:45.068509 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:45.068488 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-247.ec2.internal\" not found" node="ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.073046 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:45.073031 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-247.ec2.internal\" not found" node="ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.076161 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.076144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/782acfccb3f2820d4b0360316ae2b9b0-config\") pod \"kube-apiserver-proxy-ip-10-0-131-247.ec2.internal\" (UID: \"782acfccb3f2820d4b0360316ae2b9b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.076215 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.076171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49461f5af4f417aa4a4f06cb4fc2c045-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal\" (UID: \"49461f5af4f417aa4a4f06cb4fc2c045\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.076215 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.076189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49461f5af4f417aa4a4f06cb4fc2c045-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal\" (UID: \"49461f5af4f417aa4a4f06cb4fc2c045\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.162512 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:45.162477 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:45.176423 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.176391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/782acfccb3f2820d4b0360316ae2b9b0-config\") pod \"kube-apiserver-proxy-ip-10-0-131-247.ec2.internal\" (UID: \"782acfccb3f2820d4b0360316ae2b9b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.176423 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.176421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49461f5af4f417aa4a4f06cb4fc2c045-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal\" (UID: \"49461f5af4f417aa4a4f06cb4fc2c045\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.176585 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.176438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49461f5af4f417aa4a4f06cb4fc2c045-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal\" (UID: \"49461f5af4f417aa4a4f06cb4fc2c045\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.176585 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.176481 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49461f5af4f417aa4a4f06cb4fc2c045-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal\" (UID: \"49461f5af4f417aa4a4f06cb4fc2c045\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.176585 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.176487 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/782acfccb3f2820d4b0360316ae2b9b0-config\") pod \"kube-apiserver-proxy-ip-10-0-131-247.ec2.internal\" (UID: \"782acfccb3f2820d4b0360316ae2b9b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.176585 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.176524 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49461f5af4f417aa4a4f06cb4fc2c045-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal\" (UID: \"49461f5af4f417aa4a4f06cb4fc2c045\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.263192 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:45.263110 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:45.363681 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:45.363642 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:45.370825 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.370805 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.376436 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.376410 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-247.ec2.internal" Jul 29 17:34:45.464695 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:45.464655 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:45.565278 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:45.565190 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:45.665818 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:45.665784 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:45.711326 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.711294 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 17:34:45.711795 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.711446 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 17:34:45.733170 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.733143 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:45.766109 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:45.766080 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:45.777879 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.777844 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 17:29:44 +0000 UTC" deadline="2028-01-26 08:04:30.267440219 +0000 UTC" Jul 29 17:34:45.777879 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.777878 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13094h29m44.489566081s" Jul 29 17:34:45.866252 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:45.866183 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:45.904125 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:45.904086 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49461f5af4f417aa4a4f06cb4fc2c045.slice/crio-5bd5118cac48bb3c264a3d2d74562ba69876b97d5570190cc627cb30f90bb6eb WatchSource:0}: Error finding container 5bd5118cac48bb3c264a3d2d74562ba69876b97d5570190cc627cb30f90bb6eb: Status 404 returned error can't find the container with id 5bd5118cac48bb3c264a3d2d74562ba69876b97d5570190cc627cb30f90bb6eb Jul 29 17:34:45.904353 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:45.904333 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782acfccb3f2820d4b0360316ae2b9b0.slice/crio-6ea4ce3c0c77421e780420aba1bf4ae838326577f3afbbcf6cea1291f7acf2c5 WatchSource:0}: Error finding container 6ea4ce3c0c77421e780420aba1bf4ae838326577f3afbbcf6cea1291f7acf2c5: Status 404 returned error can't find the container with id 6ea4ce3c0c77421e780420aba1bf4ae838326577f3afbbcf6cea1291f7acf2c5 Jul 29 17:34:45.908472 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.908459 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 17:34:45.940301 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.940245 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal" event={"ID":"49461f5af4f417aa4a4f06cb4fc2c045","Type":"ContainerStarted","Data":"5bd5118cac48bb3c264a3d2d74562ba69876b97d5570190cc627cb30f90bb6eb"} Jul 29 17:34:45.941279 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:45.941257 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-247.ec2.internal" event={"ID":"782acfccb3f2820d4b0360316ae2b9b0","Type":"ContainerStarted","Data":"6ea4ce3c0c77421e780420aba1bf4ae838326577f3afbbcf6cea1291f7acf2c5"} Jul 29 17:34:45.966436 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:45.966409 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:46.066930 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:46.066895 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:46.074356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.074332 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:46.167530 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:46.167494 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-247.ec2.internal\" not found" Jul 29 17:34:46.222374 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.222337 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:46.275116 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.275087 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal" Jul 29 17:34:46.286018 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.285996 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 17:34:46.287087 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.287073 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-247.ec2.internal" Jul 29 17:34:46.293649 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.293631 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 17:34:46.755851 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.755819 2578 apiserver.go:52] "Watching apiserver" Jul 29 17:34:46.761812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.761490 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 17:34:46.766748 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.764725 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-2s78m","kube-system/global-pull-secret-syncer-lkrjd","kube-system/kube-apiserver-proxy-ip-10-0-131-247.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs","openshift-multus/multus-2vlbk","openshift-multus/multus-additional-cni-plugins-zkcmj","openshift-multus/network-metrics-daemon-95tg5","openshift-network-diagnostics/network-check-target-9hm87","openshift-network-operator/iptables-alerter-8nwkt","kube-system/konnectivity-agent-sd7tw","openshift-cluster-node-tuning-operator/tuned-pdn8q","openshift-dns/node-resolver-mfj6t","openshift-image-registry/node-ca-p7ncg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal"] Jul 29 17:34:46.766906 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.766754 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.768518 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.768479 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p7ncg" Jul 29 17:34:46.769007 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.768812 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 17:34:46.769119 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.769103 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 17:34:46.769182 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.769155 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 17:34:46.769572 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.769552 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ct5vn\"" Jul 29 17:34:46.769765 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.769742 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 17:34:46.770439 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.770414 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2m5c2\"" Jul 29 17:34:46.771230 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.770614 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 17:34:46.771230 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.770756 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 17:34:46.771230 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.770841 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 17:34:46.771230 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.770945 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mfj6t" Jul 29 17:34:46.772239 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.772218 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.772723 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.772567 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 17:34:46.772816 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.772761 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wx79t\"" Jul 29 17:34:46.773202 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.773040 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 17:34:46.774048 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.773781 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:46.774048 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:46.773852 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:34:46.774048 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.774047 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 17:34:46.774974 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.774242 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t6glz\"" Jul 29 17:34:46.774974 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.774339 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 17:34:46.774974 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.774793 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 17:34:46.775903 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.775885 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.777602 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.777582 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.777982 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.777952 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4x6ht\"" Jul 29 17:34:46.778140 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.778073 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 17:34:46.778235 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.778219 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 17:34:46.778697 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.778681 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 17:34:46.778871 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.778856 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:34:46.778940 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:46.778920 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:34:46.780817 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.779900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8nwkt" Jul 29 17:34:46.780817 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.780460 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mvfw7\"" Jul 29 17:34:46.780817 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.780586 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 17:34:46.781034 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.780825 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 17:34:46.781034 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.780858 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 17:34:46.781034 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.780871 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 17:34:46.781034 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.780929 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 17:34:46.781034 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.780833 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 17:34:46.781319 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.781154 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sd7tw" Jul 29 17:34:46.781957 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.781916 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tcqh2\"" Jul 29 17:34:46.782488 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.782325 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 17:34:46.782488 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.782341 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 17:34:46.782488 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.782406 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 17:34:46.783347 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.783144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.783347 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.783166 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6sf28\"" Jul 29 17:34:46.783693 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.783678 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 17:34:46.784742 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.784087 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:46.784742 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:46.784167 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:34:46.785019 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.784755 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 17:34:46.785019 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.784993 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 17:34:46.785820 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785437 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 17:34:46.785820 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785472 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-os-release\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.785820 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785508 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhsdm\" (UniqueName: \"kubernetes.io/projected/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-kube-api-access-dhsdm\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.785820 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-socket-dir\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.785820 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-cnibin\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.785820 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785577 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j8fbw\"" Jul 29 17:34:46.785820 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-var-lib-cni-bin\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.785820 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785655 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cf7e7d-5acd-42dd-8014-1eee405b5ab2-tmp-dir\") pod \"node-resolver-mfj6t\" (UID: \"a6cf7e7d-5acd-42dd-8014-1eee405b5ab2\") " pod="openshift-dns/node-resolver-mfj6t" Jul 29 17:34:46.785820 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.785820 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-run-multus-certs\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.785820 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-multus-cni-dir\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.786352 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-multus-socket-dir-parent\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.786352 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-var-lib-cni-multus\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.786352 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785913 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-var-lib-kubelet\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.786352 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785961 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-system-cni-dir\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.786352 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.785988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-registration-dir\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.786352 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-system-cni-dir\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.786352 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786110 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-hostroot\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.786352 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786166 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddvcm\" (UniqueName: \"kubernetes.io/projected/a6cf7e7d-5acd-42dd-8014-1eee405b5ab2-kube-api-access-ddvcm\") pod \"node-resolver-mfj6t\" (UID: \"a6cf7e7d-5acd-42dd-8014-1eee405b5ab2\") " pod="openshift-dns/node-resolver-mfj6t" Jul 29 17:34:46.786352 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786218 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.786352 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786246 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-sys-fs\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.786352 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-run-k8s-cni-cncf-io\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.786352 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-etc-kubernetes\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.786352 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rpbg\" (UniqueName: \"kubernetes.io/projected/0208514f-816a-4d0b-ac41-1ceea22d19b1-kube-api-access-8rpbg\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6cf7e7d-5acd-42dd-8014-1eee405b5ab2-hosts-file\") pod \"node-resolver-mfj6t\" (UID: \"a6cf7e7d-5acd-42dd-8014-1eee405b5ab2\") " pod="openshift-dns/node-resolver-mfj6t" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-multus-conf-dir\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0208514f-816a-4d0b-ac41-1ceea22d19b1-multus-daemon-config\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmkv9\" (UniqueName: \"kubernetes.io/projected/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-kube-api-access-qmkv9\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43c3182d-712b-43a5-a854-fa1be60e4a36-host\") pod \"node-ca-p7ncg\" (UID: \"43c3182d-712b-43a5-a854-fa1be60e4a36\") " pod="openshift-image-registry/node-ca-p7ncg" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786607 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786656 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs\") pod \"network-metrics-daemon-95tg5\" (UID: \"09c4bcf7-1764-48d5-9610-eaacef66e261\") " pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzzlr\" (UniqueName: \"kubernetes.io/projected/09c4bcf7-1764-48d5-9610-eaacef66e261-kube-api-access-gzzlr\") pod \"network-metrics-daemon-95tg5\" (UID: \"09c4bcf7-1764-48d5-9610-eaacef66e261\") " pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786771 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-os-release\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43c3182d-712b-43a5-a854-fa1be60e4a36-serviceca\") pod \"node-ca-p7ncg\" (UID: \"43c3182d-712b-43a5-a854-fa1be60e4a36\") " pod="openshift-image-registry/node-ca-p7ncg" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786826 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92xlv\" (UniqueName: \"kubernetes.io/projected/43c3182d-712b-43a5-a854-fa1be60e4a36-kube-api-access-92xlv\") pod \"node-ca-p7ncg\" (UID: \"43c3182d-712b-43a5-a854-fa1be60e4a36\") " pod="openshift-image-registry/node-ca-p7ncg" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-cnibin\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786904 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-cni-binary-copy\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.786956 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-device-dir\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.787843 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.786991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0208514f-816a-4d0b-ac41-1ceea22d19b1-cni-binary-copy\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.787843 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.787016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-run-netns\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.787843 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.787089 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 17:34:46.806833 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.806792 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pprgd" Jul 29 17:34:46.812854 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.812832 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pprgd" Jul 29 17:34:46.875779 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.875753 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 17:34:46.887499 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-registration-dir\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.887673 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-run-systemd\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.887673 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.887673 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-run-openvswitch\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.887673 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-env-overrides\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.887673 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887603 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-sys-fs\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.887673 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887619 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-run-k8s-cni-cncf-io\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.887673 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-etc-kubernetes\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.887673 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-run-ovn\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-ovnkube-script-lib\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-multus-conf-dir\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0208514f-816a-4d0b-ac41-1ceea22d19b1-multus-daemon-config\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmkv9\" (UniqueName: \"kubernetes.io/projected/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-kube-api-access-qmkv9\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f31b1811-35ad-4bd3-9c49-480e21c0131f-kubelet-config\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-run-netns\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-etc-openvswitch\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzzlr\" (UniqueName: \"kubernetes.io/projected/09c4bcf7-1764-48d5-9610-eaacef66e261-kube-api-access-gzzlr\") pod \"network-metrics-daemon-95tg5\" (UID: \"09c4bcf7-1764-48d5-9610-eaacef66e261\") " pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-os-release\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xlv\" (UniqueName: \"kubernetes.io/projected/43c3182d-712b-43a5-a854-fa1be60e4a36-kube-api-access-92xlv\") pod \"node-ca-p7ncg\" (UID: \"43c3182d-712b-43a5-a854-fa1be60e4a36\") " pod="openshift-image-registry/node-ca-p7ncg" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.887970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-kubernetes\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-sys\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888032 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-var-lib-kubelet\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-log-socket\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.888077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-device-dir\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888080 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-os-release\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888108 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjbt5\" (UniqueName: \"kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5\") pod \"network-check-target-9hm87\" (UID: \"cd90b6a5-299f-4d06-98e5-f9d78e610c0c\") " pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888123 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f31b1811-35ad-4bd3-9c49-480e21c0131f-dbus\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-cni-bin\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888156 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-ovnkube-config\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32a990ba-9fc1-4b70-99e7-7f5d8c35970a-host-slash\") pod \"iptables-alerter-8nwkt\" (UID: \"32a990ba-9fc1-4b70-99e7-7f5d8c35970a\") " pod="openshift-network-operator/iptables-alerter-8nwkt" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-var-lib-cni-bin\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-modprobe-d\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888274 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-etc-kubernetes\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888339 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-var-lib-cni-bin\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72zht\" (UniqueName: \"kubernetes.io/projected/d8c15965-1219-4c1f-9101-018344ce999b-kube-api-access-72zht\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-systemd-units\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-run-ovn-kubernetes\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888424 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-device-dir\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-cni-netd\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.888913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888455 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-multus-cni-dir\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888472 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-sys-fs\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-multus-socket-dir-parent\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888509 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-run-k8s-cni-cncf-io\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d8c15965-1219-4c1f-9101-018344ce999b-etc-tuned\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888539 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-slash\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32a990ba-9fc1-4b70-99e7-7f5d8c35970a-iptables-alerter-script\") pod \"iptables-alerter-8nwkt\" (UID: \"32a990ba-9fc1-4b70-99e7-7f5d8c35970a\") " pod="openshift-network-operator/iptables-alerter-8nwkt" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-system-cni-dir\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e5a3362-b8c5-41f1-a88f-4a4a604e070b-agent-certs\") pod \"konnectivity-agent-sd7tw\" (UID: \"9e5a3362-b8c5-41f1-a88f-4a4a604e070b\") " pod="kube-system/konnectivity-agent-sd7tw" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-run\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888653 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77649\" (UniqueName: \"kubernetes.io/projected/32a990ba-9fc1-4b70-99e7-7f5d8c35970a-kube-api-access-77649\") pod \"iptables-alerter-8nwkt\" (UID: \"32a990ba-9fc1-4b70-99e7-7f5d8c35970a\") " pod="openshift-network-operator/iptables-alerter-8nwkt" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-hostroot\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddvcm\" (UniqueName: \"kubernetes.io/projected/a6cf7e7d-5acd-42dd-8014-1eee405b5ab2-kube-api-access-ddvcm\") pod \"node-resolver-mfj6t\" (UID: \"a6cf7e7d-5acd-42dd-8014-1eee405b5ab2\") " pod="openshift-dns/node-resolver-mfj6t" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888729 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-lib-modules\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8c15965-1219-4c1f-9101-018344ce999b-tmp\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888771 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-node-log\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rpbg\" (UniqueName: \"kubernetes.io/projected/0208514f-816a-4d0b-ac41-1ceea22d19b1-kube-api-access-8rpbg\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.889684 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6cf7e7d-5acd-42dd-8014-1eee405b5ab2-hosts-file\") pod \"node-resolver-mfj6t\" (UID: \"a6cf7e7d-5acd-42dd-8014-1eee405b5ab2\") " pod="openshift-dns/node-resolver-mfj6t" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888840 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-systemd\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888861 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888931 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43c3182d-712b-43a5-a854-fa1be60e4a36-host\") pod \"node-ca-p7ncg\" (UID: \"43c3182d-712b-43a5-a854-fa1be60e4a36\") " pod="openshift-image-registry/node-ca-p7ncg" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888963 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0208514f-816a-4d0b-ac41-1ceea22d19b1-multus-daemon-config\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888969 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-multus-socket-dir-parent\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889001 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-multus-conf-dir\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889015 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-system-cni-dir\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889020 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-multus-cni-dir\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889067 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-hostroot\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889143 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.888872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43c3182d-712b-43a5-a854-fa1be60e4a36-host\") pod \"node-ca-p7ncg\" (UID: \"43c3182d-712b-43a5-a854-fa1be60e4a36\") " pod="openshift-image-registry/node-ca-p7ncg" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-sysconfig\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889200 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v76w7\" (UniqueName: \"kubernetes.io/projected/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-kube-api-access-v76w7\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs\") pod \"network-metrics-daemon-95tg5\" (UID: \"09c4bcf7-1764-48d5-9610-eaacef66e261\") " pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:46.890356 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43c3182d-712b-43a5-a854-fa1be60e4a36-serviceca\") pod \"node-ca-p7ncg\" (UID: \"43c3182d-712b-43a5-a854-fa1be60e4a36\") " pod="openshift-image-registry/node-ca-p7ncg" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-cnibin\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-cni-binary-copy\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889355 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-sysctl-d\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889366 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889379 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-host\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889398 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-kubelet\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0208514f-816a-4d0b-ac41-1ceea22d19b1-cni-binary-copy\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-run-netns\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889493 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889537 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-cnibin\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889569 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhsdm\" (UniqueName: \"kubernetes.io/projected/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-kube-api-access-dhsdm\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-sysctl-conf\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889595 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-os-release\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-var-lib-openvswitch\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889655 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-run-netns\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:46.889736 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:46.890979 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889803 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6cf7e7d-5acd-42dd-8014-1eee405b5ab2-hosts-file\") pod \"node-resolver-mfj6t\" (UID: \"a6cf7e7d-5acd-42dd-8014-1eee405b5ab2\") " pod="openshift-dns/node-resolver-mfj6t" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:46.889822 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs podName:09c4bcf7-1764-48d5-9610-eaacef66e261 nodeName:}" failed. No retries permitted until 2026-07-29 17:34:47.389785366 +0000 UTC m=+2.994656529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs") pod "network-metrics-daemon-95tg5" (UID: "09c4bcf7-1764-48d5-9610-eaacef66e261") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889934 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-cni-binary-copy\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.889991 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0208514f-816a-4d0b-ac41-1ceea22d19b1-cni-binary-copy\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890004 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-os-release\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890055 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-registration-dir\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-socket-dir\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890117 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-cnibin\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890195 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-socket-dir\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890258 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-cnibin\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cf7e7d-5acd-42dd-8014-1eee405b5ab2-tmp-dir\") pod \"node-resolver-mfj6t\" (UID: \"a6cf7e7d-5acd-42dd-8014-1eee405b5ab2\") " pod="openshift-dns/node-resolver-mfj6t" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e5a3362-b8c5-41f1-a88f-4a4a604e070b-konnectivity-ca\") pod \"konnectivity-agent-sd7tw\" (UID: \"9e5a3362-b8c5-41f1-a88f-4a4a604e070b\") " pod="kube-system/konnectivity-agent-sd7tw" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-ovn-node-metrics-cert\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-run-multus-certs\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.891784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890485 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-run-multus-certs\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.892513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-var-lib-cni-multus\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.892513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-var-lib-kubelet\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.892513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890532 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-var-lib-cni-multus\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.892513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890569 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-system-cni-dir\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.892513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890579 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cf7e7d-5acd-42dd-8014-1eee405b5ab2-tmp-dir\") pod \"node-resolver-mfj6t\" (UID: \"a6cf7e7d-5acd-42dd-8014-1eee405b5ab2\") " pod="openshift-dns/node-resolver-mfj6t" Jul 29 17:34:46.892513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890604 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0208514f-816a-4d0b-ac41-1ceea22d19b1-host-var-lib-kubelet\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.892513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890639 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-system-cni-dir\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.892513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.890966 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43c3182d-712b-43a5-a854-fa1be60e4a36-serviceca\") pod \"node-ca-p7ncg\" (UID: \"43c3182d-712b-43a5-a854-fa1be60e4a36\") " pod="openshift-image-registry/node-ca-p7ncg" Jul 29 17:34:46.901574 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.901546 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 17:34:46.906873 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.905947 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddvcm\" (UniqueName: \"kubernetes.io/projected/a6cf7e7d-5acd-42dd-8014-1eee405b5ab2-kube-api-access-ddvcm\") pod \"node-resolver-mfj6t\" (UID: \"a6cf7e7d-5acd-42dd-8014-1eee405b5ab2\") " pod="openshift-dns/node-resolver-mfj6t" Jul 29 17:34:46.906873 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.905962 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rpbg\" (UniqueName: \"kubernetes.io/projected/0208514f-816a-4d0b-ac41-1ceea22d19b1-kube-api-access-8rpbg\") pod \"multus-2vlbk\" (UID: \"0208514f-816a-4d0b-ac41-1ceea22d19b1\") " pod="openshift-multus/multus-2vlbk" Jul 29 17:34:46.906873 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.906450 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhsdm\" (UniqueName: \"kubernetes.io/projected/d9f1bcbb-a128-4b58-a2b8-78060c048d1d-kube-api-access-dhsdm\") pod \"multus-additional-cni-plugins-zkcmj\" (UID: \"d9f1bcbb-a128-4b58-a2b8-78060c048d1d\") " pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:46.906873 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.906465 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmkv9\" (UniqueName: \"kubernetes.io/projected/9c2e8b3a-b645-47b3-9a1c-a1374c635bc0-kube-api-access-qmkv9\") pod \"aws-ebs-csi-driver-node-55wcs\" (UID: \"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:46.908137 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.908081 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92xlv\" (UniqueName: \"kubernetes.io/projected/43c3182d-712b-43a5-a854-fa1be60e4a36-kube-api-access-92xlv\") pod \"node-ca-p7ncg\" (UID: \"43c3182d-712b-43a5-a854-fa1be60e4a36\") " pod="openshift-image-registry/node-ca-p7ncg" Jul 29 17:34:46.908251 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.908157 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzzlr\" (UniqueName: \"kubernetes.io/projected/09c4bcf7-1764-48d5-9610-eaacef66e261-kube-api-access-gzzlr\") pod \"network-metrics-daemon-95tg5\" (UID: \"09c4bcf7-1764-48d5-9610-eaacef66e261\") " pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:46.990856 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.990820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d8c15965-1219-4c1f-9101-018344ce999b-etc-tuned\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991031 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.990863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-slash\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.991031 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.990892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32a990ba-9fc1-4b70-99e7-7f5d8c35970a-iptables-alerter-script\") pod \"iptables-alerter-8nwkt\" (UID: \"32a990ba-9fc1-4b70-99e7-7f5d8c35970a\") " pod="openshift-network-operator/iptables-alerter-8nwkt" Jul 29 17:34:46.991031 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.990919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e5a3362-b8c5-41f1-a88f-4a4a604e070b-agent-certs\") pod \"konnectivity-agent-sd7tw\" (UID: \"9e5a3362-b8c5-41f1-a88f-4a4a604e070b\") " pod="kube-system/konnectivity-agent-sd7tw" Jul 29 17:34:46.991031 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.990977 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-slash\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.991031 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991030 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-run\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991277 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77649\" (UniqueName: \"kubernetes.io/projected/32a990ba-9fc1-4b70-99e7-7f5d8c35970a-kube-api-access-77649\") pod \"iptables-alerter-8nwkt\" (UID: \"32a990ba-9fc1-4b70-99e7-7f5d8c35970a\") " pod="openshift-network-operator/iptables-alerter-8nwkt" Jul 29 17:34:46.991277 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-lib-modules\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991277 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8c15965-1219-4c1f-9101-018344ce999b-tmp\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991277 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991120 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-node-log\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.991277 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-systemd\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991277 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991153 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-run\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991277 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-sysconfig\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991277 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991223 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-sysconfig\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991277 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:46.991277 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991267 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-node-log\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v76w7\" (UniqueName: \"kubernetes.io/projected/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-kube-api-access-v76w7\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991289 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-lib-modules\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-sysctl-d\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991341 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-systemd\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-host\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991416 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-host\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991465 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32a990ba-9fc1-4b70-99e7-7f5d8c35970a-iptables-alerter-script\") pod \"iptables-alerter-8nwkt\" (UID: \"32a990ba-9fc1-4b70-99e7-7f5d8c35970a\") " pod="openshift-network-operator/iptables-alerter-8nwkt" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991469 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-sysctl-d\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:46.991498 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-kubelet\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-sysctl-conf\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:46.991559 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret podName:f31b1811-35ad-4bd3-9c49-480e21c0131f nodeName:}" failed. No retries permitted until 2026-07-29 17:34:47.491540425 +0000 UTC m=+3.096411570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret") pod "global-pull-secret-syncer-lkrjd" (UID: "f31b1811-35ad-4bd3-9c49-480e21c0131f") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991574 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-kubelet\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-var-lib-openvswitch\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991618 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-var-lib-openvswitch\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.991828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991650 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-sysctl-conf\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991652 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e5a3362-b8c5-41f1-a88f-4a4a604e070b-konnectivity-ca\") pod \"konnectivity-agent-sd7tw\" (UID: \"9e5a3362-b8c5-41f1-a88f-4a4a604e070b\") " pod="kube-system/konnectivity-agent-sd7tw" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-ovn-node-metrics-cert\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-run-systemd\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-run-openvswitch\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-env-overrides\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-run-ovn\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-ovnkube-script-lib\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f31b1811-35ad-4bd3-9c49-480e21c0131f-kubelet-config\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-run-netns\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991952 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-etc-openvswitch\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.991981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-kubernetes\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-sys\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-var-lib-kubelet\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-log-socket\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjbt5\" (UniqueName: \"kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5\") pod \"network-check-target-9hm87\" (UID: \"cd90b6a5-299f-4d06-98e5-f9d78e610c0c\") " pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:34:46.992667 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f31b1811-35ad-4bd3-9c49-480e21c0131f-dbus\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992097 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f31b1811-35ad-4bd3-9c49-480e21c0131f-kubelet-config\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992120 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-cni-bin\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992141 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-run-systemd\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-ovnkube-config\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992168 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e5a3362-b8c5-41f1-a88f-4a4a604e070b-konnectivity-ca\") pod \"konnectivity-agent-sd7tw\" (UID: \"9e5a3362-b8c5-41f1-a88f-4a4a604e070b\") " pod="kube-system/konnectivity-agent-sd7tw" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32a990ba-9fc1-4b70-99e7-7f5d8c35970a-host-slash\") pod \"iptables-alerter-8nwkt\" (UID: \"32a990ba-9fc1-4b70-99e7-7f5d8c35970a\") " pod="openshift-network-operator/iptables-alerter-8nwkt" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992183 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-run-openvswitch\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-modprobe-d\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992234 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-run-ovn\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992291 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-kubernetes\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992295 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-var-lib-kubelet\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72zht\" (UniqueName: \"kubernetes.io/projected/d8c15965-1219-4c1f-9101-018344ce999b-kube-api-access-72zht\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992235 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-run-netns\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-systemd-units\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992399 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32a990ba-9fc1-4b70-99e7-7f5d8c35970a-host-slash\") pod \"iptables-alerter-8nwkt\" (UID: \"32a990ba-9fc1-4b70-99e7-7f5d8c35970a\") " pod="openshift-network-operator/iptables-alerter-8nwkt" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992410 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-cni-bin\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992448 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-log-socket\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.993364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992494 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-etc-modprobe-d\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.994073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-run-ovn-kubernetes\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.994073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992562 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-cni-netd\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.994073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992632 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-cni-netd\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.994073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992664 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-etc-openvswitch\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.994073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992736 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-host-run-ovn-kubernetes\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.994073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992773 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-systemd-units\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.994073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992901 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-env-overrides\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.994073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992956 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-ovnkube-config\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.994073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.992960 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8c15965-1219-4c1f-9101-018344ce999b-sys\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.994073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.993108 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f31b1811-35ad-4bd3-9c49-480e21c0131f-dbus\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:46.994073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.993430 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-ovnkube-script-lib\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:46.994073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.993695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d8c15965-1219-4c1f-9101-018344ce999b-etc-tuned\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.994073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.993800 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8c15965-1219-4c1f-9101-018344ce999b-tmp\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:46.994073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.993923 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e5a3362-b8c5-41f1-a88f-4a4a604e070b-agent-certs\") pod \"konnectivity-agent-sd7tw\" (UID: \"9e5a3362-b8c5-41f1-a88f-4a4a604e070b\") " pod="kube-system/konnectivity-agent-sd7tw" Jul 29 17:34:46.995315 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:46.995292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-ovn-node-metrics-cert\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:47.002065 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:47.002032 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:47.002065 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:47.002059 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:47.002227 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:47.002074 2578 projected.go:196] Error preparing data for projected volume kube-api-access-jjbt5 for pod openshift-network-diagnostics/network-check-target-9hm87: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:47.002227 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:47.002151 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5 podName:cd90b6a5-299f-4d06-98e5-f9d78e610c0c nodeName:}" failed. No retries permitted until 2026-07-29 17:34:47.502133562 +0000 UTC m=+3.107004708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jjbt5" (UniqueName: "kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5") pod "network-check-target-9hm87" (UID: "cd90b6a5-299f-4d06-98e5-f9d78e610c0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:47.003611 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.003588 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77649\" (UniqueName: \"kubernetes.io/projected/32a990ba-9fc1-4b70-99e7-7f5d8c35970a-kube-api-access-77649\") pod \"iptables-alerter-8nwkt\" (UID: \"32a990ba-9fc1-4b70-99e7-7f5d8c35970a\") " pod="openshift-network-operator/iptables-alerter-8nwkt" Jul 29 17:34:47.004003 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.003980 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72zht\" (UniqueName: \"kubernetes.io/projected/d8c15965-1219-4c1f-9101-018344ce999b-kube-api-access-72zht\") pod \"tuned-pdn8q\" (UID: \"d8c15965-1219-4c1f-9101-018344ce999b\") " pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:47.004478 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.004456 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v76w7\" (UniqueName: \"kubernetes.io/projected/34d740a9-fe87-4f4d-9dce-d1c43c0cd94e-kube-api-access-v76w7\") pod \"ovnkube-node-2s78m\" (UID: \"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:47.046182 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.046105 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:47.081355 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.081319 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2vlbk" Jul 29 17:34:47.089019 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.088998 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p7ncg" Jul 29 17:34:47.097809 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.097779 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mfj6t" Jul 29 17:34:47.109561 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.109534 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zkcmj" Jul 29 17:34:47.117509 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.117486 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" Jul 29 17:34:47.124280 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.124259 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:34:47.132888 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.132861 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8nwkt" Jul 29 17:34:47.141592 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.141569 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sd7tw" Jul 29 17:34:47.147376 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.147355 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" Jul 29 17:34:47.395843 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.395764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs\") pod \"network-metrics-daemon-95tg5\" (UID: \"09c4bcf7-1764-48d5-9610-eaacef66e261\") " pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:47.395991 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:47.395914 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:47.395991 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:47.395982 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs podName:09c4bcf7-1764-48d5-9610-eaacef66e261 nodeName:}" failed. No retries permitted until 2026-07-29 17:34:48.395964913 +0000 UTC m=+4.000836057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs") pod "network-metrics-daemon-95tg5" (UID: "09c4bcf7-1764-48d5-9610-eaacef66e261") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:47.496763 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.496730 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:47.496959 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:47.496874 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:47.496959 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:47.496934 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret podName:f31b1811-35ad-4bd3-9c49-480e21c0131f nodeName:}" failed. No retries permitted until 2026-07-29 17:34:48.496918807 +0000 UTC m=+4.101789949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret") pod "global-pull-secret-syncer-lkrjd" (UID: "f31b1811-35ad-4bd3-9c49-480e21c0131f") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:47.597362 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.597328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjbt5\" (UniqueName: \"kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5\") pod \"network-check-target-9hm87\" (UID: \"cd90b6a5-299f-4d06-98e5-f9d78e610c0c\") " pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:34:47.597540 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:47.597488 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:47.597540 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:47.597508 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:47.597540 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:47.597517 2578 projected.go:196] Error preparing data for projected volume kube-api-access-jjbt5 for pod openshift-network-diagnostics/network-check-target-9hm87: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:47.597665 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:47.597565 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5 podName:cd90b6a5-299f-4d06-98e5-f9d78e610c0c nodeName:}" failed. No retries permitted until 2026-07-29 17:34:48.59755166 +0000 UTC m=+4.202422800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjbt5" (UniqueName: "kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5") pod "network-check-target-9hm87" (UID: "cd90b6a5-299f-4d06-98e5-f9d78e610c0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:47.815182 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.815151 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 17:29:46 +0000 UTC" deadline="2028-03-01 10:39:03.71512684 +0000 UTC" Jul 29 17:34:47.815182 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.815178 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13937h4m15.899951246s" Jul 29 17:34:47.831458 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:47.831426 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2e8b3a_b645_47b3_9a1c_a1374c635bc0.slice/crio-719d2e4a6fc579701b600bbc718d59ebdcede5290fd5819c5cd2797bb15926a9 WatchSource:0}: Error finding container 719d2e4a6fc579701b600bbc718d59ebdcede5290fd5819c5cd2797bb15926a9: Status 404 returned error can't find the container with id 719d2e4a6fc579701b600bbc718d59ebdcede5290fd5819c5cd2797bb15926a9 Jul 29 17:34:47.832124 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:47.832101 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cf7e7d_5acd_42dd_8014_1eee405b5ab2.slice/crio-525e9df073555851ee70b607216753c0cbd3d4e0e34cd4d569513dc4c63dd156 WatchSource:0}: Error finding container 525e9df073555851ee70b607216753c0cbd3d4e0e34cd4d569513dc4c63dd156: Status 404 returned error can't find the container with id 525e9df073555851ee70b607216753c0cbd3d4e0e34cd4d569513dc4c63dd156 Jul 29 17:34:47.833037 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:47.833019 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c3182d_712b_43a5_a854_fa1be60e4a36.slice/crio-7e11449e930d427729ce9ebb595fed951d1b6e3059994467eb38d7f4d6aa8d9e WatchSource:0}: Error finding container 7e11449e930d427729ce9ebb595fed951d1b6e3059994467eb38d7f4d6aa8d9e: Status 404 returned error can't find the container with id 7e11449e930d427729ce9ebb595fed951d1b6e3059994467eb38d7f4d6aa8d9e Jul 29 17:34:47.835001 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:47.834868 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d740a9_fe87_4f4d_9dce_d1c43c0cd94e.slice/crio-8d06c33f70249cceeb272acd2fcc8852c9784909f62f34127c4abfc92b0971cc WatchSource:0}: Error finding container 8d06c33f70249cceeb272acd2fcc8852c9784909f62f34127c4abfc92b0971cc: Status 404 returned error can't find the container with id 8d06c33f70249cceeb272acd2fcc8852c9784909f62f34127c4abfc92b0971cc Jul 29 17:34:47.836622 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:47.836596 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0208514f_816a_4d0b_ac41_1ceea22d19b1.slice/crio-eded67f00d3aaead0778be049e0e209152e347822bce7c9f8e23d26eec968b44 WatchSource:0}: Error finding container eded67f00d3aaead0778be049e0e209152e347822bce7c9f8e23d26eec968b44: Status 404 returned error can't find the container with id eded67f00d3aaead0778be049e0e209152e347822bce7c9f8e23d26eec968b44 Jul 29 17:34:47.839708 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:47.839606 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f1bcbb_a128_4b58_a2b8_78060c048d1d.slice/crio-490b65caaccc563d4f92215d4fc53fe1de6b45de71b5a37ce7771bb5212fe83c WatchSource:0}: Error finding container 490b65caaccc563d4f92215d4fc53fe1de6b45de71b5a37ce7771bb5212fe83c: Status 404 returned error can't find the container with id 490b65caaccc563d4f92215d4fc53fe1de6b45de71b5a37ce7771bb5212fe83c Jul 29 17:34:47.840846 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:34:47.840821 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8c15965_1219_4c1f_9101_018344ce999b.slice/crio-89b0a843350db3efb0e960d87aa9a82a232ee57f46558626ffef718ffcedc428 WatchSource:0}: Error finding container 89b0a843350db3efb0e960d87aa9a82a232ee57f46558626ffef718ffcedc428: Status 404 returned error can't find the container with id 89b0a843350db3efb0e960d87aa9a82a232ee57f46558626ffef718ffcedc428 Jul 29 17:34:47.937642 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.937406 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:47.937828 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.937429 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:34:47.937828 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:47.937784 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:34:47.937918 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:47.937831 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:34:47.946037 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.946002 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sd7tw" event={"ID":"9e5a3362-b8c5-41f1-a88f-4a4a604e070b","Type":"ContainerStarted","Data":"348dc550c837bb1d2e716430f7bda8cff56c5b96f4dd73a1952108610f72bb01"} Jul 29 17:34:47.947192 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.947156 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" event={"ID":"d8c15965-1219-4c1f-9101-018344ce999b","Type":"ContainerStarted","Data":"89b0a843350db3efb0e960d87aa9a82a232ee57f46558626ffef718ffcedc428"} Jul 29 17:34:47.948392 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.948369 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkcmj" event={"ID":"d9f1bcbb-a128-4b58-a2b8-78060c048d1d","Type":"ContainerStarted","Data":"490b65caaccc563d4f92215d4fc53fe1de6b45de71b5a37ce7771bb5212fe83c"} Jul 29 17:34:47.949585 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.949565 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2vlbk" event={"ID":"0208514f-816a-4d0b-ac41-1ceea22d19b1","Type":"ContainerStarted","Data":"eded67f00d3aaead0778be049e0e209152e347822bce7c9f8e23d26eec968b44"} Jul 29 17:34:47.950763 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.950737 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" event={"ID":"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0","Type":"ContainerStarted","Data":"719d2e4a6fc579701b600bbc718d59ebdcede5290fd5819c5cd2797bb15926a9"} Jul 29 17:34:47.952820 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.952788 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-247.ec2.internal" event={"ID":"782acfccb3f2820d4b0360316ae2b9b0","Type":"ContainerStarted","Data":"8b0bdaf173db9813b63738d1150c97a8aad83435c7e096e4c0da165a2ff9ddee"} Jul 29 17:34:47.953812 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.953794 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8nwkt" event={"ID":"32a990ba-9fc1-4b70-99e7-7f5d8c35970a","Type":"ContainerStarted","Data":"e4cbabf79372d72e1d3bdac0aa562cfd9f9493cab5f621c177cca96b6c65d8ce"} Jul 29 17:34:47.954916 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.954897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mfj6t" event={"ID":"a6cf7e7d-5acd-42dd-8014-1eee405b5ab2","Type":"ContainerStarted","Data":"525e9df073555851ee70b607216753c0cbd3d4e0e34cd4d569513dc4c63dd156"} Jul 29 17:34:47.956417 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.956392 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" event={"ID":"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e","Type":"ContainerStarted","Data":"8d06c33f70249cceeb272acd2fcc8852c9784909f62f34127c4abfc92b0971cc"} Jul 29 17:34:47.957533 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.957511 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p7ncg" event={"ID":"43c3182d-712b-43a5-a854-fa1be60e4a36","Type":"ContainerStarted","Data":"7e11449e930d427729ce9ebb595fed951d1b6e3059994467eb38d7f4d6aa8d9e"} Jul 29 17:34:47.966482 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:47.966429 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-247.ec2.internal" podStartSLOduration=1.966411571 podStartE2EDuration="1.966411571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:34:47.966022798 +0000 UTC m=+3.570893959" watchObservedRunningTime="2026-07-29 17:34:47.966411571 +0000 UTC m=+3.571282739" Jul 29 17:34:48.402618 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:48.402579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs\") pod \"network-metrics-daemon-95tg5\" (UID: \"09c4bcf7-1764-48d5-9610-eaacef66e261\") " pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:48.402863 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:48.402745 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:48.402863 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:48.402814 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs podName:09c4bcf7-1764-48d5-9610-eaacef66e261 nodeName:}" failed. No retries permitted until 2026-07-29 17:34:50.402796075 +0000 UTC m=+6.007667221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs") pod "network-metrics-daemon-95tg5" (UID: "09c4bcf7-1764-48d5-9610-eaacef66e261") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:48.503734 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:48.503685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:48.503916 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:48.503868 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:48.503982 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:48.503933 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret podName:f31b1811-35ad-4bd3-9c49-480e21c0131f nodeName:}" failed. No retries permitted until 2026-07-29 17:34:50.5039144 +0000 UTC m=+6.108785542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret") pod "global-pull-secret-syncer-lkrjd" (UID: "f31b1811-35ad-4bd3-9c49-480e21c0131f") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:48.604778 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:48.604742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjbt5\" (UniqueName: \"kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5\") pod \"network-check-target-9hm87\" (UID: \"cd90b6a5-299f-4d06-98e5-f9d78e610c0c\") " pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:34:48.604960 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:48.604945 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:48.605033 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:48.604968 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:48.605033 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:48.604981 2578 projected.go:196] Error preparing data for projected volume kube-api-access-jjbt5 for pod openshift-network-diagnostics/network-check-target-9hm87: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:48.605129 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:48.605040 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5 podName:cd90b6a5-299f-4d06-98e5-f9d78e610c0c nodeName:}" failed. No retries permitted until 2026-07-29 17:34:50.605022285 +0000 UTC m=+6.209893444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjbt5" (UniqueName: "kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5") pod "network-check-target-9hm87" (UID: "cd90b6a5-299f-4d06-98e5-f9d78e610c0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:48.815624 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:48.815575 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 17:29:46 +0000 UTC" deadline="2028-04-23 14:38:55.149790804 +0000 UTC" Jul 29 17:34:48.815624 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:48.815614 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15213h4m6.334181827s" Jul 29 17:34:48.947354 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:48.946551 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:48.947354 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:48.946690 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:34:48.969614 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:48.969570 2578 generic.go:356] "Generic (PLEG): container finished" podID="49461f5af4f417aa4a4f06cb4fc2c045" containerID="b61b5c904b99da216b0a91f8f9381a7a7aa51a79cbda27a591b8ddc1a69a144c" exitCode=0 Jul 29 17:34:48.969963 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:48.969756 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal" event={"ID":"49461f5af4f417aa4a4f06cb4fc2c045","Type":"ContainerDied","Data":"b61b5c904b99da216b0a91f8f9381a7a7aa51a79cbda27a591b8ddc1a69a144c"} Jul 29 17:34:49.937140 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:49.937111 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:49.937140 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:49.937130 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:34:49.937672 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:49.937232 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:34:49.937672 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:49.937462 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:34:49.984890 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:49.984854 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal" event={"ID":"49461f5af4f417aa4a4f06cb4fc2c045","Type":"ContainerStarted","Data":"10f40b1007bb4bc30cbb6a8fbd9dd1e2095d100f7efe8f5fbe207f75fdc70a95"} Jul 29 17:34:50.421270 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:50.421232 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs\") pod \"network-metrics-daemon-95tg5\" (UID: \"09c4bcf7-1764-48d5-9610-eaacef66e261\") " pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:50.421474 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:50.421436 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:50.421543 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:50.421500 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs podName:09c4bcf7-1764-48d5-9610-eaacef66e261 nodeName:}" failed. No retries permitted until 2026-07-29 17:34:54.421481454 +0000 UTC m=+10.026352600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs") pod "network-metrics-daemon-95tg5" (UID: "09c4bcf7-1764-48d5-9610-eaacef66e261") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:50.522247 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:50.522211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:50.522432 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:50.522199 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:50.522432 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:50.522347 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret podName:f31b1811-35ad-4bd3-9c49-480e21c0131f nodeName:}" failed. No retries permitted until 2026-07-29 17:34:54.522328536 +0000 UTC m=+10.127199698 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret") pod "global-pull-secret-syncer-lkrjd" (UID: "f31b1811-35ad-4bd3-9c49-480e21c0131f") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:50.623179 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:50.623133 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjbt5\" (UniqueName: \"kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5\") pod \"network-check-target-9hm87\" (UID: \"cd90b6a5-299f-4d06-98e5-f9d78e610c0c\") " pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:34:50.623404 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:50.623382 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:50.623485 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:50.623411 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:50.623485 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:50.623425 2578 projected.go:196] Error preparing data for projected volume kube-api-access-jjbt5 for pod openshift-network-diagnostics/network-check-target-9hm87: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:50.623601 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:50.623487 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5 podName:cd90b6a5-299f-4d06-98e5-f9d78e610c0c nodeName:}" failed. No retries permitted until 2026-07-29 17:34:54.62346779 +0000 UTC m=+10.228338932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjbt5" (UniqueName: "kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5") pod "network-check-target-9hm87" (UID: "cd90b6a5-299f-4d06-98e5-f9d78e610c0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:50.942449 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:50.941985 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:50.942449 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:50.942122 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:34:51.937902 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:51.937232 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:51.937902 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:51.937371 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:34:51.937902 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:51.937756 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:34:51.937902 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:51.937852 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:34:52.938195 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:52.938161 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:52.938656 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:52.938316 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:34:53.937455 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:53.937173 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:53.937455 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:53.937313 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:34:53.937455 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:53.937193 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:34:53.937455 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:53.937409 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:34:54.457068 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:54.457032 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs\") pod \"network-metrics-daemon-95tg5\" (UID: \"09c4bcf7-1764-48d5-9610-eaacef66e261\") " pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:54.457535 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:54.457171 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:54.457535 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:54.457226 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs podName:09c4bcf7-1764-48d5-9610-eaacef66e261 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:02.457212176 +0000 UTC m=+18.062083318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs") pod "network-metrics-daemon-95tg5" (UID: "09c4bcf7-1764-48d5-9610-eaacef66e261") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:54.558058 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:54.558018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:54.558239 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:54.558178 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:54.558301 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:54.558248 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret podName:f31b1811-35ad-4bd3-9c49-480e21c0131f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:02.558229706 +0000 UTC m=+18.163100869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret") pod "global-pull-secret-syncer-lkrjd" (UID: "f31b1811-35ad-4bd3-9c49-480e21c0131f") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:54.659480 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:54.659365 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjbt5\" (UniqueName: \"kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5\") pod \"network-check-target-9hm87\" (UID: \"cd90b6a5-299f-4d06-98e5-f9d78e610c0c\") " pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:34:54.659664 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:54.659517 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:54.659664 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:54.659541 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:54.659664 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:54.659553 2578 projected.go:196] Error preparing data for projected volume kube-api-access-jjbt5 for pod openshift-network-diagnostics/network-check-target-9hm87: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:54.659664 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:54.659612 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5 podName:cd90b6a5-299f-4d06-98e5-f9d78e610c0c nodeName:}" failed. No retries permitted until 2026-07-29 17:35:02.659594653 +0000 UTC m=+18.264465795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjbt5" (UniqueName: "kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5") pod "network-check-target-9hm87" (UID: "cd90b6a5-299f-4d06-98e5-f9d78e610c0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:54.938150 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:54.938114 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:54.938336 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:54.938251 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:34:55.937324 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:55.937289 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:34:55.937844 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:55.937288 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:55.937844 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:55.937424 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:34:55.937844 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:55.937500 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:34:56.937453 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:56.937410 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:56.937910 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:56.937591 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:34:57.937227 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:57.937201 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:57.937395 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:57.937200 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:34:57.937395 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:57.937309 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:34:57.937395 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:57.937386 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:34:58.939966 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:58.939937 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:34:58.940323 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:58.940034 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:34:59.937839 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:59.937797 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:34:59.938047 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:34:59.937797 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:34:59.938047 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:59.937951 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:34:59.938047 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:34:59.938000 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:35:00.941044 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:00.941016 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:00.941517 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:00.941155 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:35:01.937693 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:01.937655 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:01.937937 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:01.937655 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:01.937937 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:01.937809 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:35:01.937937 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:01.937867 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:35:02.522535 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:02.522493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs\") pod \"network-metrics-daemon-95tg5\" (UID: \"09c4bcf7-1764-48d5-9610-eaacef66e261\") " pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:02.523008 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:02.522624 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:35:02.523008 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:02.522695 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs podName:09c4bcf7-1764-48d5-9610-eaacef66e261 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:18.522663919 +0000 UTC m=+34.127535062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs") pod "network-metrics-daemon-95tg5" (UID: "09c4bcf7-1764-48d5-9610-eaacef66e261") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:35:02.623905 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:02.623864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:02.624077 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:02.624035 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:35:02.624160 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:02.624111 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret podName:f31b1811-35ad-4bd3-9c49-480e21c0131f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:18.624087729 +0000 UTC m=+34.228958896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret") pod "global-pull-secret-syncer-lkrjd" (UID: "f31b1811-35ad-4bd3-9c49-480e21c0131f") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:35:02.724594 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:02.724555 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjbt5\" (UniqueName: \"kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5\") pod \"network-check-target-9hm87\" (UID: \"cd90b6a5-299f-4d06-98e5-f9d78e610c0c\") " pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:02.724782 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:02.724762 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:35:02.724843 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:02.724788 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:35:02.724843 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:02.724798 2578 projected.go:196] Error preparing data for projected volume kube-api-access-jjbt5 for pod openshift-network-diagnostics/network-check-target-9hm87: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:35:02.724913 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:02.724860 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5 podName:cd90b6a5-299f-4d06-98e5-f9d78e610c0c nodeName:}" failed. No retries permitted until 2026-07-29 17:35:18.724839002 +0000 UTC m=+34.329710141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjbt5" (UniqueName: "kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5") pod "network-check-target-9hm87" (UID: "cd90b6a5-299f-4d06-98e5-f9d78e610c0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:35:02.937778 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:02.937744 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:02.937955 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:02.937891 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:35:03.937377 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:03.937345 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:03.937377 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:03.937385 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:03.937890 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:03.937465 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:35:03.937890 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:03.937586 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:35:04.938219 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:04.938187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:04.938692 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:04.938302 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:35:05.937238 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:05.937197 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:05.937238 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:05.937226 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:05.937471 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:05.937338 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:35:05.937471 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:05.937452 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:35:06.938595 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:06.937043 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:06.938595 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:06.937375 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:35:07.024639 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.024607 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mfj6t" event={"ID":"a6cf7e7d-5acd-42dd-8014-1eee405b5ab2","Type":"ContainerStarted","Data":"20934910daef94de0c36f2c2f1eb38beecfcd1e4e53c62892a89a1e4526367c4"} Jul 29 17:35:07.026889 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.026854 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" event={"ID":"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e","Type":"ContainerStarted","Data":"e15d07568435e74196539667bdfcf08e9de032659b387c788d4878d2ebc0da2e"} Jul 29 17:35:07.028773 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.028664 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p7ncg" event={"ID":"43c3182d-712b-43a5-a854-fa1be60e4a36","Type":"ContainerStarted","Data":"1e9349353f41a0b93af4e7019d09c4934a455d0848b67e8c202160aad32d931e"} Jul 29 17:35:07.031020 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.030992 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sd7tw" event={"ID":"9e5a3362-b8c5-41f1-a88f-4a4a604e070b","Type":"ContainerStarted","Data":"2da9d3faa601d44e7b7554494c03110041f7d3cd17a5621bb508b60f344cfa17"} Jul 29 17:35:07.032653 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.032624 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" event={"ID":"d8c15965-1219-4c1f-9101-018344ce999b","Type":"ContainerStarted","Data":"ec3bf0e7cbba07ec468771b2d8824a7ade392c732c40e04da9dfb5332c8623a0"} Jul 29 17:35:07.034073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.034013 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkcmj" event={"ID":"d9f1bcbb-a128-4b58-a2b8-78060c048d1d","Type":"ContainerStarted","Data":"aad3e12e940fcfca93ac47c21330c703de706c1ba18bb4534efcf9ef4c16bd0d"} Jul 29 17:35:07.035285 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.035261 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2vlbk" event={"ID":"0208514f-816a-4d0b-ac41-1ceea22d19b1","Type":"ContainerStarted","Data":"565790b0dc54fa393f5ac5f5d4232836e1a181ec6f16f33188e64c82a6c1a46b"} Jul 29 17:35:07.037538 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.037479 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" event={"ID":"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0","Type":"ContainerStarted","Data":"139e830c3f491683c357c3a078a70f6abd773dfe0e16d1146d02c765948843ae"} Jul 29 17:35:07.038363 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.038310 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mfj6t" podStartSLOduration=4.0561723 podStartE2EDuration="23.038293317s" totalImagesPullingTime="18.982121017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:07.038147833 +0000 UTC m=+22.643018995" watchObservedRunningTime="2026-07-29 17:35:07.038293317 +0000 UTC m=+22.643164480" Jul 29 17:35:07.038487 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.038457 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-247.ec2.internal" podStartSLOduration=21.038446661 podStartE2EDuration="21.038446661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:34:50.001554004 +0000 UTC m=+5.606425167" watchObservedRunningTime="2026-07-29 17:35:07.038446661 +0000 UTC m=+22.643317823" Jul 29 17:35:07.052546 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.052502 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sd7tw" podStartSLOduration=3.173667147 podStartE2EDuration="22.052487607s" totalImagesPullingTime="18.87882046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:07.051949993 +0000 UTC m=+22.656821159" watchObservedRunningTime="2026-07-29 17:35:07.052487607 +0000 UTC m=+22.657358767" Jul 29 17:35:07.084651 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.084453 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2vlbk" podStartSLOduration=4.047127246 podStartE2EDuration="23.084434718s" totalImagesPullingTime="19.037307472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:07.084096396 +0000 UTC m=+22.688967561" watchObservedRunningTime="2026-07-29 17:35:07.084434718 +0000 UTC m=+22.689305879" Jul 29 17:35:07.084919 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.084895 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pdn8q" podStartSLOduration=3.1057924789999998 podStartE2EDuration="22.08488601s" totalImagesPullingTime="18.979093531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:07.068748332 +0000 UTC m=+22.673619490" watchObservedRunningTime="2026-07-29 17:35:07.08488601 +0000 UTC m=+22.689757230" Jul 29 17:35:07.096895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.096847 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p7ncg" podStartSLOduration=4.123497225 podStartE2EDuration="23.096834713s" totalImagesPullingTime="18.973337488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:07.096463441 +0000 UTC m=+22.701334602" watchObservedRunningTime="2026-07-29 17:35:07.096834713 +0000 UTC m=+22.701705874" Jul 29 17:35:07.937032 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.936994 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:07.937201 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:07.937003 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:07.937201 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:07.937104 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:35:07.937290 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:07.937198 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:35:08.041196 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:08.041167 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9f1bcbb-a128-4b58-a2b8-78060c048d1d" containerID="aad3e12e940fcfca93ac47c21330c703de706c1ba18bb4534efcf9ef4c16bd0d" exitCode=0 Jul 29 17:35:08.041893 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:08.041261 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkcmj" event={"ID":"d9f1bcbb-a128-4b58-a2b8-78060c048d1d","Type":"ContainerDied","Data":"aad3e12e940fcfca93ac47c21330c703de706c1ba18bb4534efcf9ef4c16bd0d"} Jul 29 17:35:08.046512 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:08.046489 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" event={"ID":"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e","Type":"ContainerStarted","Data":"3a8d6188a707af611ab28776025baa1497e75c0910e9dbe6aaccfdb74b0b0cbf"} Jul 29 17:35:08.046606 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:08.046560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" event={"ID":"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e","Type":"ContainerStarted","Data":"1be08d345f36e81405daa8e7e901dcffcd69d9051532587038f8d4fc562032ac"} Jul 29 17:35:08.046606 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:08.046594 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" event={"ID":"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e","Type":"ContainerStarted","Data":"d1886e36d744fda57b8ae96940fb3ccee398533c6f2ad3ead179de619735645e"} Jul 29 17:35:08.046674 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:08.046626 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" event={"ID":"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e","Type":"ContainerStarted","Data":"87015a9a8848a98f379a1d9d72b3aa5d299bb38f7ffa0ce19f8f574c2d063d51"} Jul 29 17:35:08.046674 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:08.046655 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" event={"ID":"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e","Type":"ContainerStarted","Data":"cbb9c01af0e5247f6977749cd28559cbc1bdac53d4ee31a264bc42781b596897"} Jul 29 17:35:08.108420 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:08.108397 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sd7tw" Jul 29 17:35:08.109012 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:08.108994 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sd7tw" Jul 29 17:35:08.153479 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:08.153440 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 17:35:08.850111 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:08.849978 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T17:35:08.15346175Z","UUID":"8e95f960-4c64-4bbd-a812-f9476ed5b811","Handler":null,"Name":"","Endpoint":""} Jul 29 17:35:08.851706 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:08.851682 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 17:35:08.851854 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:08.851743 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 17:35:08.937469 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:08.937438 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:08.937690 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:08.937608 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:35:09.050443 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:09.050401 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8nwkt" event={"ID":"32a990ba-9fc1-4b70-99e7-7f5d8c35970a","Type":"ContainerStarted","Data":"bf222c0971a7549d89ed7ee948916aec8ab244928f74295c047d260958816f6e"} Jul 29 17:35:09.053707 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:09.053676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" event={"ID":"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0","Type":"ContainerStarted","Data":"575d143eafdbc43e1639ace8d0de6a43eb0b6294a73f6d8f076da4fe5f9305d7"} Jul 29 17:35:09.068986 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:09.068926 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8nwkt" podStartSLOduration=5.10612973 podStartE2EDuration="24.06890869s" totalImagesPullingTime="18.96277896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:09.068861989 +0000 UTC m=+24.673733151" watchObservedRunningTime="2026-07-29 17:35:09.06890869 +0000 UTC m=+24.673779859" Jul 29 17:35:09.937996 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:09.937804 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:09.938179 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:09.937871 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:09.938179 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:09.938110 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:35:09.938505 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:09.938205 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:35:10.058849 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:10.058454 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" event={"ID":"9c2e8b3a-b645-47b3-9a1c-a1374c635bc0","Type":"ContainerStarted","Data":"62bcb9379354f0063704b02f6a0c68d8e97e8985cfd854d1ab1a798bd7db5d58"} Jul 29 17:35:10.062785 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:10.062752 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" event={"ID":"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e","Type":"ContainerStarted","Data":"5eea9ab9804df0f49127c9766424982ff16ebdbaee4c504301f6334a7bfa2fef"} Jul 29 17:35:10.062928 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:10.062798 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 17:35:10.076542 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:10.076479 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55wcs" podStartSLOduration=3.873348632 podStartE2EDuration="25.076458505s" totalImagesPullingTime="21.203109873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:10.075874322 +0000 UTC m=+25.680745485" watchObservedRunningTime="2026-07-29 17:35:10.076458505 +0000 UTC m=+25.681329668" Jul 29 17:35:10.937080 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:10.936979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:10.937401 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:10.937153 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:35:11.937132 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:11.937092 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:11.937810 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:11.937092 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:11.937810 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:11.937233 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:35:11.937810 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:11.937277 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:35:12.492124 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:12.491839 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sd7tw" Jul 29 17:35:12.492278 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:12.492163 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 17:35:12.492570 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:12.492549 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sd7tw" Jul 29 17:35:12.937833 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:12.937799 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:12.938394 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:12.937925 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:35:13.073332 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:13.073289 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" event={"ID":"34d740a9-fe87-4f4d-9dce-d1c43c0cd94e","Type":"ContainerStarted","Data":"5d1701f5e8b9ece3547aa568e8ac24a5fe55aac16262979d620f2f0a0f9ff03f"} Jul 29 17:35:13.073608 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:13.073586 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:35:13.073750 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:13.073656 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:35:13.073750 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:13.073702 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:35:13.075031 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:13.075005 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9f1bcbb-a128-4b58-a2b8-78060c048d1d" containerID="eed69a7ddbe24e4ab2541f2d6684cc15b429b61385a5200be59b5aad36db529a" exitCode=0 Jul 29 17:35:13.075140 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:13.075085 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkcmj" event={"ID":"d9f1bcbb-a128-4b58-a2b8-78060c048d1d","Type":"ContainerDied","Data":"eed69a7ddbe24e4ab2541f2d6684cc15b429b61385a5200be59b5aad36db529a"} Jul 29 17:35:13.089635 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:13.089605 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:35:13.095169 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:13.095149 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:35:13.105335 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:13.105295 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" podStartSLOduration=9.061610296 podStartE2EDuration="28.105281245s" totalImagesPullingTime="19.043670949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:13.105088081 +0000 UTC m=+28.709959238" watchObservedRunningTime="2026-07-29 17:35:13.105281245 +0000 UTC m=+28.710152405" Jul 29 17:35:13.937136 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:13.936985 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:13.937291 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:13.937030 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:13.937291 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:13.937224 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:35:13.937363 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:13.937291 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:35:14.115860 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:14.115828 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkrjd"] Jul 29 17:35:14.116310 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:14.115951 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:14.116310 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:14.116066 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:35:14.118406 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:14.118378 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9hm87"] Jul 29 17:35:14.118524 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:14.118478 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:14.118581 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:14.118567 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:35:14.130550 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:14.130473 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-95tg5"] Jul 29 17:35:14.130686 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:14.130660 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:14.130851 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:14.130826 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:35:15.081407 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:15.081370 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9f1bcbb-a128-4b58-a2b8-78060c048d1d" containerID="ea4b41898dafde6f72559dc80fcef5691bf876bd7986d7185491f2c0f92a6da5" exitCode=0 Jul 29 17:35:15.081605 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:15.081436 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkcmj" event={"ID":"d9f1bcbb-a128-4b58-a2b8-78060c048d1d","Type":"ContainerDied","Data":"ea4b41898dafde6f72559dc80fcef5691bf876bd7986d7185491f2c0f92a6da5"} Jul 29 17:35:15.938035 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:15.938004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:15.938494 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:15.938010 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:15.938494 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:15.938126 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:35:15.938494 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:15.938016 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:15.938494 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:15.938181 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:35:15.938494 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:15.938260 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:35:16.086041 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:16.086012 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkcmj" event={"ID":"d9f1bcbb-a128-4b58-a2b8-78060c048d1d","Type":"ContainerStarted","Data":"a63735df501cd0ed2df33ad20179c7a534a6b580f96802f086f3d398221eb705"} Jul 29 17:35:17.090907 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:17.090810 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9f1bcbb-a128-4b58-a2b8-78060c048d1d" containerID="a63735df501cd0ed2df33ad20179c7a534a6b580f96802f086f3d398221eb705" exitCode=0 Jul 29 17:35:17.090907 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:17.090880 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkcmj" event={"ID":"d9f1bcbb-a128-4b58-a2b8-78060c048d1d","Type":"ContainerDied","Data":"a63735df501cd0ed2df33ad20179c7a534a6b580f96802f086f3d398221eb705"} Jul 29 17:35:17.937199 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:17.937163 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:17.937199 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:17.937185 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:17.937448 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:17.937187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:17.937448 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:17.937287 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9hm87" podUID="cd90b6a5-299f-4d06-98e5-f9d78e610c0c" Jul 29 17:35:17.937448 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:17.937363 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkrjd" podUID="f31b1811-35ad-4bd3-9c49-480e21c0131f" Jul 29 17:35:17.937572 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:17.937446 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95tg5" podUID="09c4bcf7-1764-48d5-9610-eaacef66e261" Jul 29 17:35:18.532641 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:18.532602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs\") pod \"network-metrics-daemon-95tg5\" (UID: \"09c4bcf7-1764-48d5-9610-eaacef66e261\") " pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:18.533223 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:18.532745 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:35:18.533223 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:18.532832 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs podName:09c4bcf7-1764-48d5-9610-eaacef66e261 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:50.532808385 +0000 UTC m=+66.137679527 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs") pod "network-metrics-daemon-95tg5" (UID: "09c4bcf7-1764-48d5-9610-eaacef66e261") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:35:18.633270 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:18.633214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:18.633458 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:18.633396 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:35:18.633525 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:18.633475 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret podName:f31b1811-35ad-4bd3-9c49-480e21c0131f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:50.633457408 +0000 UTC m=+66.238328547 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret") pod "global-pull-secret-syncer-lkrjd" (UID: "f31b1811-35ad-4bd3-9c49-480e21c0131f") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:35:18.734270 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:18.734234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjbt5\" (UniqueName: \"kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5\") pod \"network-check-target-9hm87\" (UID: \"cd90b6a5-299f-4d06-98e5-f9d78e610c0c\") " pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:18.734450 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:18.734390 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:35:18.734450 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:18.734412 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:35:18.734450 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:18.734423 2578 projected.go:196] Error preparing data for projected volume kube-api-access-jjbt5 for pod openshift-network-diagnostics/network-check-target-9hm87: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:35:18.734577 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:18.734476 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5 podName:cd90b6a5-299f-4d06-98e5-f9d78e610c0c nodeName:}" failed. No retries permitted until 2026-07-29 17:35:50.734461316 +0000 UTC m=+66.339332455 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjbt5" (UniqueName: "kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5") pod "network-check-target-9hm87" (UID: "cd90b6a5-299f-4d06-98e5-f9d78e610c0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:35:19.674327 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.674297 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-247.ec2.internal" event="NodeReady" Jul 29 17:35:19.674751 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.674445 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 17:35:19.710124 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.710094 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-ccf666dcd-qxp75"] Jul 29 17:35:19.713784 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.712780 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.715648 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.715482 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qgjgr\"" Jul 29 17:35:19.716992 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.716971 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 17:35:19.717131 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.717062 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 17:35:19.717427 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.717408 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 17:35:19.720611 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.720591 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n2mkr"] Jul 29 17:35:19.722645 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.722605 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:19.724575 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.724552 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ctlvv\"" Jul 29 17:35:19.724682 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.724643 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 17:35:19.724912 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.724891 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 17:35:19.725572 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.725554 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 17:35:19.727942 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.727921 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f8ccv"] Jul 29 17:35:19.729963 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.729944 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f8ccv" Jul 29 17:35:19.732044 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.732024 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-ccf666dcd-qxp75"] Jul 29 17:35:19.734022 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.734001 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z85md\"" Jul 29 17:35:19.734120 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.734041 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 17:35:19.734120 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.734111 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 17:35:19.734208 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.734138 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 17:35:19.737005 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.736982 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n2mkr"] Jul 29 17:35:19.739984 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.739965 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f8ccv"] Jul 29 17:35:19.756866 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.756836 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-smwjz"] Jul 29 17:35:19.758821 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.758797 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:19.760869 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.760849 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 17:35:19.761016 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.760993 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n5kx8\"" Jul 29 17:35:19.761183 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.761165 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 17:35:19.761477 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.761336 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 17:35:19.761477 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.761440 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 17:35:19.774699 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.774675 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-smwjz"] Jul 29 17:35:19.843166 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-bound-sa-token\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.843346 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843183 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2912615-db0a-4cab-9d36-820c669c7fc1-trusted-ca\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.843346 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:19.843346 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/156dbf97-91ef-4c18-95c6-a141ad86b210-data-volume\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:19.843346 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a80edd5-e73b-4e4f-8150-63d1eb55488a-tmp-dir\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:19.843346 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-certificates\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.843346 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdkzh\" (UniqueName: \"kubernetes.io/projected/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-api-access-qdkzh\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:19.843557 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2912615-db0a-4cab-9d36-820c669c7fc1-installation-pull-secrets\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.843557 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843389 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1651f98-f8ff-4c37-bc66-009f039c298d-cert\") pod \"ingress-canary-f8ccv\" (UID: \"d1651f98-f8ff-4c37-bc66-009f039c298d\") " pod="openshift-ingress-canary/ingress-canary-f8ccv" Jul 29 17:35:19.843557 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843412 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j254b\" (UniqueName: \"kubernetes.io/projected/d1651f98-f8ff-4c37-bc66-009f039c298d-kube-api-access-j254b\") pod \"ingress-canary-f8ccv\" (UID: \"d1651f98-f8ff-4c37-bc66-009f039c298d\") " pod="openshift-ingress-canary/ingress-canary-f8ccv" Jul 29 17:35:19.843557 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2912615-db0a-4cab-9d36-820c669c7fc1-ca-trust-extracted\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.843557 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxzg9\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-kube-api-access-zxzg9\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.843557 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/156dbf97-91ef-4c18-95c6-a141ad86b210-crio-socket\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:19.843557 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843554 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2912615-db0a-4cab-9d36-820c669c7fc1-image-registry-private-configuration\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.843883 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843580 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.843883 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843597 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9a80edd5-e73b-4e4f-8150-63d1eb55488a-config-volume\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:19.843883 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843618 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:19.843883 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:19.843883 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.843757 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8c6l\" (UniqueName: \"kubernetes.io/projected/9a80edd5-e73b-4e4f-8150-63d1eb55488a-kube-api-access-m8c6l\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:19.937815 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.937727 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:19.937815 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.937768 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:19.937815 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.937774 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:19.940729 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.940698 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 17:35:19.940874 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.940696 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 17:35:19.940874 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.940773 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 17:35:19.940874 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.940803 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mkqbv\"" Jul 29 17:35:19.940874 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.940827 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 17:35:19.941056 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.940951 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tsgst\"" Jul 29 17:35:19.944220 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944192 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:19.944357 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944255 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/156dbf97-91ef-4c18-95c6-a141ad86b210-data-volume\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:19.944357 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a80edd5-e73b-4e4f-8150-63d1eb55488a-tmp-dir\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:19.944357 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-certificates\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.944357 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944341 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdkzh\" (UniqueName: \"kubernetes.io/projected/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-api-access-qdkzh\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:19.944553 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:19.944354 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 17:35:19.944553 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2912615-db0a-4cab-9d36-820c669c7fc1-installation-pull-secrets\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.944553 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1651f98-f8ff-4c37-bc66-009f039c298d-cert\") pod \"ingress-canary-f8ccv\" (UID: \"d1651f98-f8ff-4c37-bc66-009f039c298d\") " pod="openshift-ingress-canary/ingress-canary-f8ccv" Jul 29 17:35:19.944553 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:19.944417 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls podName:9a80edd5-e73b-4e4f-8150-63d1eb55488a nodeName:}" failed. No retries permitted until 2026-07-29 17:35:20.444396523 +0000 UTC m=+36.049267665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls") pod "dns-default-n2mkr" (UID: "9a80edd5-e73b-4e4f-8150-63d1eb55488a") : secret "dns-default-metrics-tls" not found Jul 29 17:35:19.944553 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j254b\" (UniqueName: \"kubernetes.io/projected/d1651f98-f8ff-4c37-bc66-009f039c298d-kube-api-access-j254b\") pod \"ingress-canary-f8ccv\" (UID: \"d1651f98-f8ff-4c37-bc66-009f039c298d\") " pod="openshift-ingress-canary/ingress-canary-f8ccv" Jul 29 17:35:19.944553 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2912615-db0a-4cab-9d36-820c669c7fc1-ca-trust-extracted\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.944553 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxzg9\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-kube-api-access-zxzg9\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.944942 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/156dbf97-91ef-4c18-95c6-a141ad86b210-crio-socket\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:19.944942 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944598 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2912615-db0a-4cab-9d36-820c669c7fc1-image-registry-private-configuration\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.944942 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.944942 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944660 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/156dbf97-91ef-4c18-95c6-a141ad86b210-data-volume\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:19.944942 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9a80edd5-e73b-4e4f-8150-63d1eb55488a-config-volume\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:19.944942 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:19.944942 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:19.944942 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8c6l\" (UniqueName: \"kubernetes.io/projected/9a80edd5-e73b-4e4f-8150-63d1eb55488a-kube-api-access-m8c6l\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:19.944942 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-bound-sa-token\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.944942 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2912615-db0a-4cab-9d36-820c669c7fc1-trusted-ca\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.945395 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.944995 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/156dbf97-91ef-4c18-95c6-a141ad86b210-crio-socket\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:19.945395 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.945075 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-certificates\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.945395 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:19.945169 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 17:35:19.945395 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:19.945217 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls podName:156dbf97-91ef-4c18-95c6-a141ad86b210 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:20.44520219 +0000 UTC m=+36.050073334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls") pod "insights-runtime-extractor-smwjz" (UID: "156dbf97-91ef-4c18-95c6-a141ad86b210") : secret "insights-runtime-extractor-tls" not found Jul 29 17:35:19.945395 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:19.945262 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 17:35:19.945395 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:19.945305 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-rbac-proxy-cm podName:156dbf97-91ef-4c18-95c6-a141ad86b210 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:20.445293431 +0000 UTC m=+36.050164571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-rbac-proxy-cm") pod "insights-runtime-extractor-smwjz" (UID: "156dbf97-91ef-4c18-95c6-a141ad86b210") : configmap "kube-rbac-proxy" not found Jul 29 17:35:19.945731 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.945457 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a80edd5-e73b-4e4f-8150-63d1eb55488a-tmp-dir\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:19.945731 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:19.945609 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 17:35:19.945731 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:19.945623 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-ccf666dcd-qxp75: secret "image-registry-tls" not found Jul 29 17:35:19.945731 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:19.945658 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls podName:e2912615-db0a-4cab-9d36-820c669c7fc1 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:20.445646157 +0000 UTC m=+36.050517296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls") pod "image-registry-ccf666dcd-qxp75" (UID: "e2912615-db0a-4cab-9d36-820c669c7fc1") : secret "image-registry-tls" not found Jul 29 17:35:19.945962 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.945930 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2912615-db0a-4cab-9d36-820c669c7fc1-trusted-ca\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.946131 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.946090 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9a80edd5-e73b-4e4f-8150-63d1eb55488a-config-volume\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:19.946131 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.946094 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2912615-db0a-4cab-9d36-820c669c7fc1-ca-trust-extracted\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.950256 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.950102 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2912615-db0a-4cab-9d36-820c669c7fc1-installation-pull-secrets\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.950363 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.950104 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1651f98-f8ff-4c37-bc66-009f039c298d-cert\") pod \"ingress-canary-f8ccv\" (UID: \"d1651f98-f8ff-4c37-bc66-009f039c298d\") " pod="openshift-ingress-canary/ingress-canary-f8ccv" Jul 29 17:35:19.951696 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.951668 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2912615-db0a-4cab-9d36-820c669c7fc1-image-registry-private-configuration\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.954093 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.953967 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8c6l\" (UniqueName: \"kubernetes.io/projected/9a80edd5-e73b-4e4f-8150-63d1eb55488a-kube-api-access-m8c6l\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:19.954093 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.954059 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j254b\" (UniqueName: \"kubernetes.io/projected/d1651f98-f8ff-4c37-bc66-009f039c298d-kube-api-access-j254b\") pod \"ingress-canary-f8ccv\" (UID: \"d1651f98-f8ff-4c37-bc66-009f039c298d\") " pod="openshift-ingress-canary/ingress-canary-f8ccv" Jul 29 17:35:19.955155 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.954534 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-bound-sa-token\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.955155 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.954537 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxzg9\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-kube-api-access-zxzg9\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:19.955310 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:19.955248 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdkzh\" (UniqueName: \"kubernetes.io/projected/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-api-access-qdkzh\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:20.042618 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.042573 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f8ccv" Jul 29 17:35:20.295028 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.294918 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-dw9x8"] Jul 29 17:35:20.297026 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.297006 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-dw9x8" Jul 29 17:35:20.299541 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.299511 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 29 17:35:20.299541 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.299534 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 29 17:35:20.299755 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.299511 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 29 17:35:20.299755 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.299575 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pvqqz\"" Jul 29 17:35:20.299968 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.299950 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 29 17:35:20.306601 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.306576 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-dw9x8"] Jul 29 17:35:20.448290 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.448248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:20.448466 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.448330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/56279ae6-812b-4a86-bfc3-26d590afa057-signing-cabundle\") pod \"service-ca-658d7b7c78-dw9x8\" (UID: \"56279ae6-812b-4a86-bfc3-26d590afa057\") " pod="openshift-service-ca/service-ca-658d7b7c78-dw9x8" Jul 29 17:35:20.448466 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.448359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vlvl\" (UniqueName: \"kubernetes.io/projected/56279ae6-812b-4a86-bfc3-26d590afa057-kube-api-access-8vlvl\") pod \"service-ca-658d7b7c78-dw9x8\" (UID: \"56279ae6-812b-4a86-bfc3-26d590afa057\") " pod="openshift-service-ca/service-ca-658d7b7c78-dw9x8" Jul 29 17:35:20.448466 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:20.448424 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 17:35:20.448466 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.448433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:20.448679 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.448494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:20.448679 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:20.448520 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 17:35:20.448679 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:20.448535 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-ccf666dcd-qxp75: secret "image-registry-tls" not found Jul 29 17:35:20.448679 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:20.448538 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls podName:9a80edd5-e73b-4e4f-8150-63d1eb55488a nodeName:}" failed. No retries permitted until 2026-07-29 17:35:21.448507707 +0000 UTC m=+37.053378872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls") pod "dns-default-n2mkr" (UID: "9a80edd5-e73b-4e4f-8150-63d1eb55488a") : secret "dns-default-metrics-tls" not found Jul 29 17:35:20.448679 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:20.448551 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 17:35:20.448679 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.448564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:20.448679 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:20.448590 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls podName:e2912615-db0a-4cab-9d36-820c669c7fc1 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:21.448574851 +0000 UTC m=+37.053445989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls") pod "image-registry-ccf666dcd-qxp75" (UID: "e2912615-db0a-4cab-9d36-820c669c7fc1") : secret "image-registry-tls" not found Jul 29 17:35:20.448679 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:20.448609 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-rbac-proxy-cm podName:156dbf97-91ef-4c18-95c6-a141ad86b210 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:21.44860084 +0000 UTC m=+37.053471979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-rbac-proxy-cm") pod "insights-runtime-extractor-smwjz" (UID: "156dbf97-91ef-4c18-95c6-a141ad86b210") : configmap "kube-rbac-proxy" not found Jul 29 17:35:20.448679 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:20.448634 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 17:35:20.448679 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.448641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/56279ae6-812b-4a86-bfc3-26d590afa057-signing-key\") pod \"service-ca-658d7b7c78-dw9x8\" (UID: \"56279ae6-812b-4a86-bfc3-26d590afa057\") " pod="openshift-service-ca/service-ca-658d7b7c78-dw9x8" Jul 29 17:35:20.448679 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:20.448661 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls podName:156dbf97-91ef-4c18-95c6-a141ad86b210 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:21.448653194 +0000 UTC m=+37.053524336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls") pod "insights-runtime-extractor-smwjz" (UID: "156dbf97-91ef-4c18-95c6-a141ad86b210") : secret "insights-runtime-extractor-tls" not found Jul 29 17:35:20.549284 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.549197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/56279ae6-812b-4a86-bfc3-26d590afa057-signing-key\") pod \"service-ca-658d7b7c78-dw9x8\" (UID: \"56279ae6-812b-4a86-bfc3-26d590afa057\") " pod="openshift-service-ca/service-ca-658d7b7c78-dw9x8" Jul 29 17:35:20.549448 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.549300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/56279ae6-812b-4a86-bfc3-26d590afa057-signing-cabundle\") pod \"service-ca-658d7b7c78-dw9x8\" (UID: \"56279ae6-812b-4a86-bfc3-26d590afa057\") " pod="openshift-service-ca/service-ca-658d7b7c78-dw9x8" Jul 29 17:35:20.549448 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.549330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vlvl\" (UniqueName: \"kubernetes.io/projected/56279ae6-812b-4a86-bfc3-26d590afa057-kube-api-access-8vlvl\") pod \"service-ca-658d7b7c78-dw9x8\" (UID: \"56279ae6-812b-4a86-bfc3-26d590afa057\") " pod="openshift-service-ca/service-ca-658d7b7c78-dw9x8" Jul 29 17:35:20.550074 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.550047 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/56279ae6-812b-4a86-bfc3-26d590afa057-signing-cabundle\") pod \"service-ca-658d7b7c78-dw9x8\" (UID: \"56279ae6-812b-4a86-bfc3-26d590afa057\") " pod="openshift-service-ca/service-ca-658d7b7c78-dw9x8" Jul 29 17:35:20.552163 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.552139 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/56279ae6-812b-4a86-bfc3-26d590afa057-signing-key\") pod \"service-ca-658d7b7c78-dw9x8\" (UID: \"56279ae6-812b-4a86-bfc3-26d590afa057\") " pod="openshift-service-ca/service-ca-658d7b7c78-dw9x8" Jul 29 17:35:20.557846 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.557820 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vlvl\" (UniqueName: \"kubernetes.io/projected/56279ae6-812b-4a86-bfc3-26d590afa057-kube-api-access-8vlvl\") pod \"service-ca-658d7b7c78-dw9x8\" (UID: \"56279ae6-812b-4a86-bfc3-26d590afa057\") " pod="openshift-service-ca/service-ca-658d7b7c78-dw9x8" Jul 29 17:35:20.607757 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.607701 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-dw9x8" Jul 29 17:35:20.673016 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:20.672988 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mfj6t_a6cf7e7d-5acd-42dd-8014-1eee405b5ab2/dns-node-resolver/0.log" Jul 29 17:35:21.354911 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:21.354865 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-dw9x8"] Jul 29 17:35:21.361275 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:35:21.361239 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56279ae6_812b_4a86_bfc3_26d590afa057.slice/crio-a9363c33c52db995e1c6706b89e79b764e9691f0baad96ee8780ac937525d83f WatchSource:0}: Error finding container a9363c33c52db995e1c6706b89e79b764e9691f0baad96ee8780ac937525d83f: Status 404 returned error can't find the container with id a9363c33c52db995e1c6706b89e79b764e9691f0baad96ee8780ac937525d83f Jul 29 17:35:21.364047 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:21.364022 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f8ccv"] Jul 29 17:35:21.368124 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:35:21.368097 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1651f98_f8ff_4c37_bc66_009f039c298d.slice/crio-3908a8f8899eb5c5ca772cdf22607344fa4f04631bdc82eab880952d58309209 WatchSource:0}: Error finding container 3908a8f8899eb5c5ca772cdf22607344fa4f04631bdc82eab880952d58309209: Status 404 returned error can't find the container with id 3908a8f8899eb5c5ca772cdf22607344fa4f04631bdc82eab880952d58309209 Jul 29 17:35:21.455693 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:21.455667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:21.455827 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:21.455703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:21.455827 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:21.455748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:21.455904 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:21.455840 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 17:35:21.455904 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:21.455890 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-rbac-proxy-cm podName:156dbf97-91ef-4c18-95c6-a141ad86b210 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:23.455876274 +0000 UTC m=+39.060747415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-rbac-proxy-cm") pod "insights-runtime-extractor-smwjz" (UID: "156dbf97-91ef-4c18-95c6-a141ad86b210") : configmap "kube-rbac-proxy" not found Jul 29 17:35:21.456116 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:21.455920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:21.456116 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:21.455990 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 17:35:21.456116 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:21.456045 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls podName:156dbf97-91ef-4c18-95c6-a141ad86b210 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:23.456028793 +0000 UTC m=+39.060899933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls") pod "insights-runtime-extractor-smwjz" (UID: "156dbf97-91ef-4c18-95c6-a141ad86b210") : secret "insights-runtime-extractor-tls" not found Jul 29 17:35:21.456116 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:21.456075 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 17:35:21.456116 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:21.456088 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 17:35:21.456116 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:21.456103 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-ccf666dcd-qxp75: secret "image-registry-tls" not found Jul 29 17:35:21.456116 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:21.456111 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls podName:9a80edd5-e73b-4e4f-8150-63d1eb55488a nodeName:}" failed. No retries permitted until 2026-07-29 17:35:23.456099461 +0000 UTC m=+39.060970618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls") pod "dns-default-n2mkr" (UID: "9a80edd5-e73b-4e4f-8150-63d1eb55488a") : secret "dns-default-metrics-tls" not found Jul 29 17:35:21.456331 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:21.456142 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls podName:e2912615-db0a-4cab-9d36-820c669c7fc1 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:23.456129578 +0000 UTC m=+39.061000721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls") pod "image-registry-ccf666dcd-qxp75" (UID: "e2912615-db0a-4cab-9d36-820c669c7fc1") : secret "image-registry-tls" not found Jul 29 17:35:21.856566 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:21.856534 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p7ncg_43c3182d-712b-43a5-a854-fa1be60e4a36/node-ca/0.log" Jul 29 17:35:22.106952 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:22.106872 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9f1bcbb-a128-4b58-a2b8-78060c048d1d" containerID="5415803266c6bfe48a77e61f087fe827b8ea408caa35a281664b58305e7c7126" exitCode=0 Jul 29 17:35:22.107094 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:22.106957 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkcmj" event={"ID":"d9f1bcbb-a128-4b58-a2b8-78060c048d1d","Type":"ContainerDied","Data":"5415803266c6bfe48a77e61f087fe827b8ea408caa35a281664b58305e7c7126"} Jul 29 17:35:22.108540 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:22.108063 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f8ccv" event={"ID":"d1651f98-f8ff-4c37-bc66-009f039c298d","Type":"ContainerStarted","Data":"3908a8f8899eb5c5ca772cdf22607344fa4f04631bdc82eab880952d58309209"} Jul 29 17:35:22.109194 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:22.109173 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-dw9x8" event={"ID":"56279ae6-812b-4a86-bfc3-26d590afa057","Type":"ContainerStarted","Data":"a9363c33c52db995e1c6706b89e79b764e9691f0baad96ee8780ac937525d83f"} Jul 29 17:35:23.117670 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:23.117384 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9f1bcbb-a128-4b58-a2b8-78060c048d1d" containerID="f52fa15fe205bfb2dcca81fb2e2a0308933619c791da374dce331d8949eb4e74" exitCode=0 Jul 29 17:35:23.117670 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:23.117516 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkcmj" event={"ID":"d9f1bcbb-a128-4b58-a2b8-78060c048d1d","Type":"ContainerDied","Data":"f52fa15fe205bfb2dcca81fb2e2a0308933619c791da374dce331d8949eb4e74"} Jul 29 17:35:23.475574 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:23.475525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:23.475574 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:23.475584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:23.475854 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:23.475617 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:23.475854 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:23.475687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:23.475854 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:23.475748 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 17:35:23.475854 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:23.475793 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 17:35:23.475854 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:23.475813 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-ccf666dcd-qxp75: secret "image-registry-tls" not found Jul 29 17:35:23.476073 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:23.475798 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls podName:156dbf97-91ef-4c18-95c6-a141ad86b210 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:27.475784489 +0000 UTC m=+43.080655629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls") pod "insights-runtime-extractor-smwjz" (UID: "156dbf97-91ef-4c18-95c6-a141ad86b210") : secret "insights-runtime-extractor-tls" not found Jul 29 17:35:23.476073 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:23.475801 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 17:35:23.476073 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:23.475890 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls podName:e2912615-db0a-4cab-9d36-820c669c7fc1 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:27.475872601 +0000 UTC m=+43.080743747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls") pod "image-registry-ccf666dcd-qxp75" (UID: "e2912615-db0a-4cab-9d36-820c669c7fc1") : secret "image-registry-tls" not found Jul 29 17:35:23.476073 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:23.475916 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls podName:9a80edd5-e73b-4e4f-8150-63d1eb55488a nodeName:}" failed. No retries permitted until 2026-07-29 17:35:27.475906522 +0000 UTC m=+43.080777661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls") pod "dns-default-n2mkr" (UID: "9a80edd5-e73b-4e4f-8150-63d1eb55488a") : secret "dns-default-metrics-tls" not found Jul 29 17:35:23.476328 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:23.476299 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/156dbf97-91ef-4c18-95c6-a141ad86b210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:25.125993 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:25.125960 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zkcmj" event={"ID":"d9f1bcbb-a128-4b58-a2b8-78060c048d1d","Type":"ContainerStarted","Data":"b073df499e07c634cbd8bc840af56cc3e7f986fab9c4ae47a7a5a24bfd42d537"} Jul 29 17:35:25.127466 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:25.127437 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f8ccv" event={"ID":"d1651f98-f8ff-4c37-bc66-009f039c298d","Type":"ContainerStarted","Data":"b578e89e383009a390657c44c2d22d465e024a7d49c0db4b3befe66e579f8bbe"} Jul 29 17:35:25.128881 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:25.128855 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-dw9x8" event={"ID":"56279ae6-812b-4a86-bfc3-26d590afa057","Type":"ContainerStarted","Data":"df5407358a653a131e0c4d2957871a64af14ddea1f496cc0d125fd8b9795ab7d"} Jul 29 17:35:25.149770 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:25.149688 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zkcmj" podStartSLOduration=11.988380529 podStartE2EDuration="41.149667281s" totalImagesPullingTime="29.161286752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:25.147895214 +0000 UTC m=+40.752766377" watchObservedRunningTime="2026-07-29 17:35:25.149667281 +0000 UTC m=+40.754538444" Jul 29 17:35:25.164690 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:25.164639 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f8ccv" podStartSLOduration=3.06192624 podStartE2EDuration="6.164623129s" totalImagesPullingTime="3.102696889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:25.163906549 +0000 UTC m=+40.768777709" watchObservedRunningTime="2026-07-29 17:35:25.164623129 +0000 UTC m=+40.769494290" Jul 29 17:35:25.178395 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:25.178348 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-dw9x8" podStartSLOduration=2.071960273 podStartE2EDuration="5.178332617s" totalImagesPullingTime="3.106372344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:25.177986578 +0000 UTC m=+40.782857740" watchObservedRunningTime="2026-07-29 17:35:25.178332617 +0000 UTC m=+40.783203854" Jul 29 17:35:27.511999 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:27.511955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:27.512474 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:27.512008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:27.512474 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:27.512137 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 17:35:27.512474 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:27.512155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:27.512474 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:27.512167 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-ccf666dcd-qxp75: secret "image-registry-tls" not found Jul 29 17:35:27.512474 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:27.512294 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 17:35:27.512474 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:27.512143 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 17:35:27.512474 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:27.512366 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls podName:9a80edd5-e73b-4e4f-8150-63d1eb55488a nodeName:}" failed. No retries permitted until 2026-07-29 17:35:35.512341792 +0000 UTC m=+51.117213008 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls") pod "dns-default-n2mkr" (UID: "9a80edd5-e73b-4e4f-8150-63d1eb55488a") : secret "dns-default-metrics-tls" not found Jul 29 17:35:27.512474 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:27.512392 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls podName:e2912615-db0a-4cab-9d36-820c669c7fc1 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:35.512381682 +0000 UTC m=+51.117252821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls") pod "image-registry-ccf666dcd-qxp75" (UID: "e2912615-db0a-4cab-9d36-820c669c7fc1") : secret "image-registry-tls" not found Jul 29 17:35:27.512474 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:35:27.512413 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls podName:156dbf97-91ef-4c18-95c6-a141ad86b210 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:35.512402519 +0000 UTC m=+51.117273792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls") pod "insights-runtime-extractor-smwjz" (UID: "156dbf97-91ef-4c18-95c6-a141ad86b210") : secret "insights-runtime-extractor-tls" not found Jul 29 17:35:35.576954 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:35.576908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:35.577482 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:35.577032 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:35.577482 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:35.577067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:35.581698 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:35.581668 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/156dbf97-91ef-4c18-95c6-a141ad86b210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjz\" (UID: \"156dbf97-91ef-4c18-95c6-a141ad86b210\") " pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:35.582065 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:35.582042 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a80edd5-e73b-4e4f-8150-63d1eb55488a-metrics-tls\") pod \"dns-default-n2mkr\" (UID: \"9a80edd5-e73b-4e4f-8150-63d1eb55488a\") " pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:35.582216 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:35.582200 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls\") pod \"image-registry-ccf666dcd-qxp75\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:35.626284 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:35.626245 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:35.634365 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:35.634335 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:35.670335 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:35.670308 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-smwjz" Jul 29 17:35:35.835178 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:35.835000 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-ccf666dcd-qxp75"] Jul 29 17:35:35.837875 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:35:35.837841 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2912615_db0a_4cab_9d36_820c669c7fc1.slice/crio-a9bfde7a9112e30dfb3914ee7f4910b1b34400e25155b55d81199e022eb06f78 WatchSource:0}: Error finding container a9bfde7a9112e30dfb3914ee7f4910b1b34400e25155b55d81199e022eb06f78: Status 404 returned error can't find the container with id a9bfde7a9112e30dfb3914ee7f4910b1b34400e25155b55d81199e022eb06f78 Jul 29 17:35:35.860588 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:35.860555 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-smwjz"] Jul 29 17:35:35.865564 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:35:35.865533 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod156dbf97_91ef_4c18_95c6_a141ad86b210.slice/crio-d865c42e156cc2936e0eb4c9322ed087815fb711769c5a636a955ee05fb198e4 WatchSource:0}: Error finding container d865c42e156cc2936e0eb4c9322ed087815fb711769c5a636a955ee05fb198e4: Status 404 returned error can't find the container with id d865c42e156cc2936e0eb4c9322ed087815fb711769c5a636a955ee05fb198e4 Jul 29 17:35:35.874890 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:35.874866 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n2mkr"] Jul 29 17:35:35.880231 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:35:35.880207 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a80edd5_e73b_4e4f_8150_63d1eb55488a.slice/crio-28d8c1d6d2fac4b1a484396fcccba6b3f063d336cfeabbbb3f2bb17fddabbc2f WatchSource:0}: Error finding container 28d8c1d6d2fac4b1a484396fcccba6b3f063d336cfeabbbb3f2bb17fddabbc2f: Status 404 returned error can't find the container with id 28d8c1d6d2fac4b1a484396fcccba6b3f063d336cfeabbbb3f2bb17fddabbc2f Jul 29 17:35:36.158578 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:36.158533 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" event={"ID":"e2912615-db0a-4cab-9d36-820c669c7fc1","Type":"ContainerStarted","Data":"9cda1a70d1485148a59eacd5d2e6d1ccfa90595218b8cdea1d7dd2e09c478af8"} Jul 29 17:35:36.158790 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:36.158605 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" event={"ID":"e2912615-db0a-4cab-9d36-820c669c7fc1","Type":"ContainerStarted","Data":"a9bfde7a9112e30dfb3914ee7f4910b1b34400e25155b55d81199e022eb06f78"} Jul 29 17:35:36.158790 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:36.158636 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:35:36.159772 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:36.159745 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smwjz" event={"ID":"156dbf97-91ef-4c18-95c6-a141ad86b210","Type":"ContainerStarted","Data":"d865c42e156cc2936e0eb4c9322ed087815fb711769c5a636a955ee05fb198e4"} Jul 29 17:35:36.160807 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:36.160782 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n2mkr" event={"ID":"9a80edd5-e73b-4e4f-8150-63d1eb55488a","Type":"ContainerStarted","Data":"28d8c1d6d2fac4b1a484396fcccba6b3f063d336cfeabbbb3f2bb17fddabbc2f"} Jul 29 17:35:36.178281 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:36.178234 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" podStartSLOduration=37.178219877 podStartE2EDuration="37.178219877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:36.177561731 +0000 UTC m=+51.782432893" watchObservedRunningTime="2026-07-29 17:35:36.178219877 +0000 UTC m=+51.783091016" Jul 29 17:35:39.170087 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:39.170046 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n2mkr" event={"ID":"9a80edd5-e73b-4e4f-8150-63d1eb55488a","Type":"ContainerStarted","Data":"922246660f809e2b50069e9a003e9260df9b366881099068c6d4a7da65b19a09"} Jul 29 17:35:41.562146 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.562063 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-ccf666dcd-qxp75"] Jul 29 17:35:41.572824 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.572794 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v"] Jul 29 17:35:41.574774 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.574755 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54dd779d-7zn6w"] Jul 29 17:35:41.574904 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.574871 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" Jul 29 17:35:41.576783 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.576764 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj"] Jul 29 17:35:41.576918 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.576874 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54dd779d-7zn6w" Jul 29 17:35:41.577279 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.577256 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 29 17:35:41.577401 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.577259 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 29 17:35:41.577461 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.577420 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 29 17:35:41.577914 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.577897 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 29 17:35:41.578882 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.578866 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.578964 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.578923 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7pkjt\"" Jul 29 17:35:41.579240 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.579199 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 29 17:35:41.581274 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.581255 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 29 17:35:41.581274 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.581269 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 29 17:35:41.581547 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.581530 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 29 17:35:41.581625 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.581606 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 29 17:35:41.586255 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.586234 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54dd779d-7zn6w"] Jul 29 17:35:41.589871 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.589847 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v"] Jul 29 17:35:41.602543 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.602517 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj"] Jul 29 17:35:41.629587 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.629558 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/edfea439-033a-4223-8b15-177023c7002b-ca\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.629777 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.629610 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/edfea439-033a-4223-8b15-177023c7002b-hub\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.629777 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.629637 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1315a65-a2d9-4239-a6cb-1cae2ad2406d-tmp\") pod \"klusterlet-addon-workmgr-69c6447958-p9d9v\" (UID: \"a1315a65-a2d9-4239-a6cb-1cae2ad2406d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" Jul 29 17:35:41.629777 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.629663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edfea439-033a-4223-8b15-177023c7002b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.629777 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.629696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l6k6\" (UniqueName: \"kubernetes.io/projected/a1315a65-a2d9-4239-a6cb-1cae2ad2406d-kube-api-access-2l6k6\") pod \"klusterlet-addon-workmgr-69c6447958-p9d9v\" (UID: \"a1315a65-a2d9-4239-a6cb-1cae2ad2406d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" Jul 29 17:35:41.629777 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.629737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b87xr\" (UniqueName: \"kubernetes.io/projected/5cf1a201-c867-4db5-be60-0555e0005574-kube-api-access-b87xr\") pod \"managed-serviceaccount-addon-agent-d54dd779d-7zn6w\" (UID: \"5cf1a201-c867-4db5-be60-0555e0005574\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54dd779d-7zn6w" Jul 29 17:35:41.629777 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.629777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a1315a65-a2d9-4239-a6cb-1cae2ad2406d-klusterlet-config\") pod \"klusterlet-addon-workmgr-69c6447958-p9d9v\" (UID: \"a1315a65-a2d9-4239-a6cb-1cae2ad2406d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" Jul 29 17:35:41.630063 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.629797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xk5q\" (UniqueName: \"kubernetes.io/projected/edfea439-033a-4223-8b15-177023c7002b-kube-api-access-2xk5q\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.630063 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.629835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/edfea439-033a-4223-8b15-177023c7002b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.630063 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.629870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cf1a201-c867-4db5-be60-0555e0005574-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d54dd779d-7zn6w\" (UID: \"5cf1a201-c867-4db5-be60-0555e0005574\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54dd779d-7zn6w" Jul 29 17:35:41.630063 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.629895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/edfea439-033a-4223-8b15-177023c7002b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.686939 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.686903 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb"] Jul 29 17:35:41.688869 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.688850 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.724263 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.724230 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb"] Jul 29 17:35:41.730807 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.730785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cf1a201-c867-4db5-be60-0555e0005574-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d54dd779d-7zn6w\" (UID: \"5cf1a201-c867-4db5-be60-0555e0005574\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54dd779d-7zn6w" Jul 29 17:35:41.730901 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.730818 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/edfea439-033a-4223-8b15-177023c7002b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.730901 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.730845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-ca-trust-extracted\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.730901 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.730869 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-trusted-ca\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.730999 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.730907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/edfea439-033a-4223-8b15-177023c7002b-ca\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.730999 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.730938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-registry-tls\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.730999 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.730977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-image-registry-private-configuration\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.731123 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.731003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/edfea439-033a-4223-8b15-177023c7002b-hub\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.731123 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.731029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1315a65-a2d9-4239-a6cb-1cae2ad2406d-tmp\") pod \"klusterlet-addon-workmgr-69c6447958-p9d9v\" (UID: \"a1315a65-a2d9-4239-a6cb-1cae2ad2406d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" Jul 29 17:35:41.731123 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.731050 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-bound-sa-token\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.731272 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.731139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edfea439-033a-4223-8b15-177023c7002b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.731272 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.731212 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-registry-certificates\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.731272 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.731246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l6k6\" (UniqueName: \"kubernetes.io/projected/a1315a65-a2d9-4239-a6cb-1cae2ad2406d-kube-api-access-2l6k6\") pod \"klusterlet-addon-workmgr-69c6447958-p9d9v\" (UID: \"a1315a65-a2d9-4239-a6cb-1cae2ad2406d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" Jul 29 17:35:41.731272 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.731270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b87xr\" (UniqueName: \"kubernetes.io/projected/5cf1a201-c867-4db5-be60-0555e0005574-kube-api-access-b87xr\") pod \"managed-serviceaccount-addon-agent-d54dd779d-7zn6w\" (UID: \"5cf1a201-c867-4db5-be60-0555e0005574\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54dd779d-7zn6w" Jul 29 17:35:41.731469 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.731301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skw6c\" (UniqueName: \"kubernetes.io/projected/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-kube-api-access-skw6c\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.731469 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.731339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a1315a65-a2d9-4239-a6cb-1cae2ad2406d-klusterlet-config\") pod \"klusterlet-addon-workmgr-69c6447958-p9d9v\" (UID: \"a1315a65-a2d9-4239-a6cb-1cae2ad2406d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" Jul 29 17:35:41.731469 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.731367 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xk5q\" (UniqueName: \"kubernetes.io/projected/edfea439-033a-4223-8b15-177023c7002b-kube-api-access-2xk5q\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.731469 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.731400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-installation-pull-secrets\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.731469 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.731456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/edfea439-033a-4223-8b15-177023c7002b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.731695 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.731483 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1315a65-a2d9-4239-a6cb-1cae2ad2406d-tmp\") pod \"klusterlet-addon-workmgr-69c6447958-p9d9v\" (UID: \"a1315a65-a2d9-4239-a6cb-1cae2ad2406d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" Jul 29 17:35:41.732758 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.732710 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/edfea439-033a-4223-8b15-177023c7002b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.734149 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.734123 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/edfea439-033a-4223-8b15-177023c7002b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.734581 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.734535 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/edfea439-033a-4223-8b15-177023c7002b-ca\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.734754 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.734731 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cf1a201-c867-4db5-be60-0555e0005574-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d54dd779d-7zn6w\" (UID: \"5cf1a201-c867-4db5-be60-0555e0005574\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54dd779d-7zn6w" Jul 29 17:35:41.734835 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.734738 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a1315a65-a2d9-4239-a6cb-1cae2ad2406d-klusterlet-config\") pod \"klusterlet-addon-workmgr-69c6447958-p9d9v\" (UID: \"a1315a65-a2d9-4239-a6cb-1cae2ad2406d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" Jul 29 17:35:41.734901 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.734859 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/edfea439-033a-4223-8b15-177023c7002b-hub\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.735150 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.735129 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edfea439-033a-4223-8b15-177023c7002b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.749282 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.749252 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xk5q\" (UniqueName: \"kubernetes.io/projected/edfea439-033a-4223-8b15-177023c7002b-kube-api-access-2xk5q\") pod \"cluster-proxy-proxy-agent-586c758b95-q99jj\" (UID: \"edfea439-033a-4223-8b15-177023c7002b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:41.749405 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.749327 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b87xr\" (UniqueName: \"kubernetes.io/projected/5cf1a201-c867-4db5-be60-0555e0005574-kube-api-access-b87xr\") pod \"managed-serviceaccount-addon-agent-d54dd779d-7zn6w\" (UID: \"5cf1a201-c867-4db5-be60-0555e0005574\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54dd779d-7zn6w" Jul 29 17:35:41.750107 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.750081 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l6k6\" (UniqueName: \"kubernetes.io/projected/a1315a65-a2d9-4239-a6cb-1cae2ad2406d-kube-api-access-2l6k6\") pod \"klusterlet-addon-workmgr-69c6447958-p9d9v\" (UID: \"a1315a65-a2d9-4239-a6cb-1cae2ad2406d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" Jul 29 17:35:41.832890 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.832797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-registry-certificates\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.832890 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.832833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skw6c\" (UniqueName: \"kubernetes.io/projected/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-kube-api-access-skw6c\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.832890 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.832855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-installation-pull-secrets\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.833179 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.832896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-ca-trust-extracted\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.833179 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.833005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-trusted-ca\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.833179 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.833065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-registry-tls\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.833179 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.833114 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-image-registry-private-configuration\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.833179 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.833148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-bound-sa-token\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.833417 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.833282 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-ca-trust-extracted\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.833709 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.833687 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-registry-certificates\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.833947 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.833917 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-trusted-ca\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.835408 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.835386 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-image-registry-private-configuration\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.835710 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.835691 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-registry-tls\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.835776 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.835759 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-installation-pull-secrets\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.846284 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.846256 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-bound-sa-token\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.847052 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.847034 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skw6c\" (UniqueName: \"kubernetes.io/projected/2ecc6ed2-0dc9-48bd-b293-2937f59c1732-kube-api-access-skw6c\") pod \"image-registry-5fb6dfcbd7-pjrsb\" (UID: \"2ecc6ed2-0dc9-48bd-b293-2937f59c1732\") " pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:41.886503 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.886466 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" Jul 29 17:35:41.903707 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.903680 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54dd779d-7zn6w" Jul 29 17:35:41.908897 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:41.908869 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" Jul 29 17:35:42.009279 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:42.008978 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:42.061117 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:42.061034 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v"] Jul 29 17:35:42.069824 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:35:42.069754 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1315a65_a2d9_4239_a6cb_1cae2ad2406d.slice/crio-57f4234b57c61cf46cbe6377fe3cc8da3abe0d45d7edb44d7016c8c48bb8e111 WatchSource:0}: Error finding container 57f4234b57c61cf46cbe6377fe3cc8da3abe0d45d7edb44d7016c8c48bb8e111: Status 404 returned error can't find the container with id 57f4234b57c61cf46cbe6377fe3cc8da3abe0d45d7edb44d7016c8c48bb8e111 Jul 29 17:35:42.105093 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:42.105013 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj"] Jul 29 17:35:42.110646 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:35:42.110565 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedfea439_033a_4223_8b15_177023c7002b.slice/crio-d77ffd6aa7037151636e6a2a9ddd8241a87f45476c821b5b5509bb75d8a10299 WatchSource:0}: Error finding container d77ffd6aa7037151636e6a2a9ddd8241a87f45476c821b5b5509bb75d8a10299: Status 404 returned error can't find the container with id d77ffd6aa7037151636e6a2a9ddd8241a87f45476c821b5b5509bb75d8a10299 Jul 29 17:35:42.117350 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:42.117252 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54dd779d-7zn6w"] Jul 29 17:35:42.120890 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:35:42.120815 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cf1a201_c867_4db5_be60_0555e0005574.slice/crio-0a7873f3968ef82f719605fec2482f61ee929cb279e4d385b2b8705276df7caf WatchSource:0}: Error finding container 0a7873f3968ef82f719605fec2482f61ee929cb279e4d385b2b8705276df7caf: Status 404 returned error can't find the container with id 0a7873f3968ef82f719605fec2482f61ee929cb279e4d385b2b8705276df7caf Jul 29 17:35:42.182916 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:42.182836 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n2mkr" event={"ID":"9a80edd5-e73b-4e4f-8150-63d1eb55488a","Type":"ContainerStarted","Data":"5ae4dd2d4c1bf4a10b9749cd19dda7e081374adb5943c5bd8bfa4c44b055d1fe"} Jul 29 17:35:42.183240 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:42.183191 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:42.184588 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:42.184562 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" event={"ID":"edfea439-033a-4223-8b15-177023c7002b","Type":"ContainerStarted","Data":"d77ffd6aa7037151636e6a2a9ddd8241a87f45476c821b5b5509bb75d8a10299"} Jul 29 17:35:42.186692 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:42.186633 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smwjz" event={"ID":"156dbf97-91ef-4c18-95c6-a141ad86b210","Type":"ContainerStarted","Data":"9c7dcaa35ccc0ed5c4d5ef6a1df19a5e8e179091cd268cc89a3ad8403c904f41"} Jul 29 17:35:42.188049 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:42.188024 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54dd779d-7zn6w" event={"ID":"5cf1a201-c867-4db5-be60-0555e0005574","Type":"ContainerStarted","Data":"0a7873f3968ef82f719605fec2482f61ee929cb279e4d385b2b8705276df7caf"} Jul 29 17:35:42.191131 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:42.191079 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb"] Jul 29 17:35:42.191923 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:42.191875 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" event={"ID":"a1315a65-a2d9-4239-a6cb-1cae2ad2406d","Type":"ContainerStarted","Data":"57f4234b57c61cf46cbe6377fe3cc8da3abe0d45d7edb44d7016c8c48bb8e111"} Jul 29 17:35:42.196536 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:35:42.196514 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ecc6ed2_0dc9_48bd_b293_2937f59c1732.slice/crio-b98b3378639043ee14200651d643b006ff6e0a3b77d640949832f0d71b4bec6e WatchSource:0}: Error finding container b98b3378639043ee14200651d643b006ff6e0a3b77d640949832f0d71b4bec6e: Status 404 returned error can't find the container with id b98b3378639043ee14200651d643b006ff6e0a3b77d640949832f0d71b4bec6e Jul 29 17:35:42.204023 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:42.203809 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n2mkr" podStartSLOduration=20.551783888 podStartE2EDuration="23.20379119s" totalImagesPullingTime="2.652007302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:42.202624988 +0000 UTC m=+57.807496150" watchObservedRunningTime="2026-07-29 17:35:42.20379119 +0000 UTC m=+57.808662354" Jul 29 17:35:43.201154 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:43.200708 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" event={"ID":"2ecc6ed2-0dc9-48bd-b293-2937f59c1732","Type":"ContainerStarted","Data":"b6a48fe0e8180afbafe57f29a35538417efc5cbea5e8c32cbb53831c8f24ac39"} Jul 29 17:35:43.201154 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:43.200951 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:35:43.201154 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:43.200975 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" event={"ID":"2ecc6ed2-0dc9-48bd-b293-2937f59c1732","Type":"ContainerStarted","Data":"b98b3378639043ee14200651d643b006ff6e0a3b77d640949832f0d71b4bec6e"} Jul 29 17:35:43.231069 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:43.230286 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" podStartSLOduration=2.230265323 podStartE2EDuration="2.230265323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:43.229581827 +0000 UTC m=+58.834452999" watchObservedRunningTime="2026-07-29 17:35:43.230265323 +0000 UTC m=+58.835136485" Jul 29 17:35:45.098961 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:45.098922 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2s78m" Jul 29 17:35:48.225769 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:48.225698 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smwjz" event={"ID":"156dbf97-91ef-4c18-95c6-a141ad86b210","Type":"ContainerStarted","Data":"4f9fbfd4a81ca675a5628422d7f9f38fbd2f68b0aa667e8789163652f7bac274"} Jul 29 17:35:48.228278 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:48.228039 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54dd779d-7zn6w" event={"ID":"5cf1a201-c867-4db5-be60-0555e0005574","Type":"ContainerStarted","Data":"e978193398ee9a63f43b93230e9ef96ff81036519aa76d25545cb238f69f02c8"} Jul 29 17:35:48.230585 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:48.230522 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" event={"ID":"a1315a65-a2d9-4239-a6cb-1cae2ad2406d","Type":"ContainerStarted","Data":"cb3fb5786a6870a6e444522abf26c4ed4a1638aca1fcde3bc80fcfaef3f25a07"} Jul 29 17:35:48.231117 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:48.230930 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" Jul 29 17:35:48.232867 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:48.232845 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" Jul 29 17:35:48.242432 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:48.242383 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54dd779d-7zn6w" podStartSLOduration=1.284152504 podStartE2EDuration="7.242365382s" totalImagesPullingTime="5.958212878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:48.241581131 +0000 UTC m=+63.846452292" watchObservedRunningTime="2026-07-29 17:35:48.242365382 +0000 UTC m=+63.847236546" Jul 29 17:35:48.258582 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:48.258538 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69c6447958-p9d9v" podStartSLOduration=1.254375126 podStartE2EDuration="7.258522421s" totalImagesPullingTime="6.004147295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:48.257742122 +0000 UTC m=+63.862613274" watchObservedRunningTime="2026-07-29 17:35:48.258522421 +0000 UTC m=+63.863393631" Jul 29 17:35:49.204104 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:49.204070 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n2mkr" Jul 29 17:35:50.615043 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.614991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs\") pod \"network-metrics-daemon-95tg5\" (UID: \"09c4bcf7-1764-48d5-9610-eaacef66e261\") " pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:50.617157 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.617129 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 17:35:50.628429 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.628397 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09c4bcf7-1764-48d5-9610-eaacef66e261-metrics-certs\") pod \"network-metrics-daemon-95tg5\" (UID: \"09c4bcf7-1764-48d5-9610-eaacef66e261\") " pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:50.715891 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.715853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:50.718110 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.718081 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 17:35:50.729216 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.729182 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f31b1811-35ad-4bd3-9c49-480e21c0131f-original-pull-secret\") pod \"global-pull-secret-syncer-lkrjd\" (UID: \"f31b1811-35ad-4bd3-9c49-480e21c0131f\") " pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:50.816847 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.816810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjbt5\" (UniqueName: \"kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5\") pod \"network-check-target-9hm87\" (UID: \"cd90b6a5-299f-4d06-98e5-f9d78e610c0c\") " pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:50.819527 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.819503 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 17:35:50.829442 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.829416 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 17:35:50.841066 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.841029 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjbt5\" (UniqueName: \"kubernetes.io/projected/cd90b6a5-299f-4d06-98e5-f9d78e610c0c-kube-api-access-jjbt5\") pod \"network-check-target-9hm87\" (UID: \"cd90b6a5-299f-4d06-98e5-f9d78e610c0c\") " pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:50.867935 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.867856 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkrjd" Jul 29 17:35:50.879178 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.879153 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tsgst\"" Jul 29 17:35:50.885140 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.885118 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mkqbv\"" Jul 29 17:35:50.887886 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.887867 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95tg5" Jul 29 17:35:50.893797 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:50.893777 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:51.569201 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:51.569155 2578 patch_prober.go:28] interesting pod/image-registry-ccf666dcd-qxp75 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 29 17:35:51.569372 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:51.569221 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" podUID="e2912615-db0a-4cab-9d36-820c669c7fc1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 17:35:53.686497 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:53.686433 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkrjd"] Jul 29 17:35:53.691643 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:35:53.691614 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf31b1811_35ad_4bd3_9c49_480e21c0131f.slice/crio-f3eda4ab5120a28e9c20c581c56447a35c6fe14f50ac24a0d9c515fe12879daf WatchSource:0}: Error finding container f3eda4ab5120a28e9c20c581c56447a35c6fe14f50ac24a0d9c515fe12879daf: Status 404 returned error can't find the container with id f3eda4ab5120a28e9c20c581c56447a35c6fe14f50ac24a0d9c515fe12879daf Jul 29 17:35:53.916928 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:53.916353 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9hm87"] Jul 29 17:35:53.917860 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:53.917777 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-95tg5"] Jul 29 17:35:53.920699 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:35:53.920671 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd90b6a5_299f_4d06_98e5_f9d78e610c0c.slice/crio-6643dc051fe2dbb7a408b1e16f0abcc8e083e35d5f4f41c0d29e1459e2ef30db WatchSource:0}: Error finding container 6643dc051fe2dbb7a408b1e16f0abcc8e083e35d5f4f41c0d29e1459e2ef30db: Status 404 returned error can't find the container with id 6643dc051fe2dbb7a408b1e16f0abcc8e083e35d5f4f41c0d29e1459e2ef30db Jul 29 17:35:53.921359 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:35:53.921344 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c4bcf7_1764_48d5_9610_eaacef66e261.slice/crio-7cb3738a7960cc438826cfc5e5daa9d7b426bedd4a89c7e1a7b835c1eff87605 WatchSource:0}: Error finding container 7cb3738a7960cc438826cfc5e5daa9d7b426bedd4a89c7e1a7b835c1eff87605: Status 404 returned error can't find the container with id 7cb3738a7960cc438826cfc5e5daa9d7b426bedd4a89c7e1a7b835c1eff87605 Jul 29 17:35:54.255910 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:54.255876 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smwjz" event={"ID":"156dbf97-91ef-4c18-95c6-a141ad86b210","Type":"ContainerStarted","Data":"74d8d3e2ce3178b8ac4f466812405f91aebbb486bd777bb4eac86d650e1b77f8"} Jul 29 17:35:54.257049 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:54.257024 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkrjd" event={"ID":"f31b1811-35ad-4bd3-9c49-480e21c0131f","Type":"ContainerStarted","Data":"f3eda4ab5120a28e9c20c581c56447a35c6fe14f50ac24a0d9c515fe12879daf"} Jul 29 17:35:54.258166 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:54.258143 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-95tg5" event={"ID":"09c4bcf7-1764-48d5-9610-eaacef66e261","Type":"ContainerStarted","Data":"7cb3738a7960cc438826cfc5e5daa9d7b426bedd4a89c7e1a7b835c1eff87605"} Jul 29 17:35:54.263840 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:54.263803 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" event={"ID":"edfea439-033a-4223-8b15-177023c7002b","Type":"ContainerStarted","Data":"c82417956c6bff94aa66ff5dba84bffdc361bab71a39cbd89fedbb2523baa0df"} Jul 29 17:35:54.263981 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:54.263853 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" event={"ID":"edfea439-033a-4223-8b15-177023c7002b","Type":"ContainerStarted","Data":"7915c79d6cffa87b8134ac06dd773f9f8975f47f4cc6db002ea8eaafa44fdb9b"} Jul 29 17:35:54.263981 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:54.263870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" event={"ID":"edfea439-033a-4223-8b15-177023c7002b","Type":"ContainerStarted","Data":"244f54ca7684c361c263cab6d378e907b30d198ba41eecac341244166fc39c38"} Jul 29 17:35:54.264926 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:54.264903 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9hm87" event={"ID":"cd90b6a5-299f-4d06-98e5-f9d78e610c0c","Type":"ContainerStarted","Data":"6643dc051fe2dbb7a408b1e16f0abcc8e083e35d5f4f41c0d29e1459e2ef30db"} Jul 29 17:35:54.275036 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:54.274985 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-smwjz" podStartSLOduration=17.735184288 podStartE2EDuration="35.274968793s" totalImagesPullingTime="17.539784505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:35:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:54.273582785 +0000 UTC m=+69.878453946" watchObservedRunningTime="2026-07-29 17:35:54.274968793 +0000 UTC m=+69.879839953" Jul 29 17:35:54.292553 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:54.292496 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-586c758b95-q99jj" podStartSLOduration=1.8735361579999998 podStartE2EDuration="13.292477015s" totalImagesPullingTime="11.418940857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:54.29123024 +0000 UTC m=+69.896101401" watchObservedRunningTime="2026-07-29 17:35:54.292477015 +0000 UTC m=+69.897348176" Jul 29 17:35:56.278642 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:56.278599 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-95tg5" event={"ID":"09c4bcf7-1764-48d5-9610-eaacef66e261","Type":"ContainerStarted","Data":"d5386379c4173d80ab70c896630dc461e5604e34eb713d9da15467ac982fce6d"} Jul 29 17:35:56.279291 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:56.278662 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-95tg5" event={"ID":"09c4bcf7-1764-48d5-9610-eaacef66e261","Type":"ContainerStarted","Data":"faa4724170910968990bc33e68e0c2bb0226fd8d494e434ec23c05c25e61fbe9"} Jul 29 17:35:56.305027 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:56.304978 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-95tg5" podStartSLOduration=69.694632213 podStartE2EDuration="1m11.304961053s" totalImagesPullingTime="1.61032884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:56.302093886 +0000 UTC m=+71.906965059" watchObservedRunningTime="2026-07-29 17:35:56.304961053 +0000 UTC m=+71.909832241" Jul 29 17:35:59.292029 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:59.291977 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9hm87" event={"ID":"cd90b6a5-299f-4d06-98e5-f9d78e610c0c","Type":"ContainerStarted","Data":"49ea74402947d8262a049bac583c833bcc399300d756de32b3e839d315902586"} Jul 29 17:35:59.292460 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:59.292059 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:35:59.293400 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:59.293373 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkrjd" event={"ID":"f31b1811-35ad-4bd3-9c49-480e21c0131f","Type":"ContainerStarted","Data":"62b2be7d82a383d12586ad213e7b013b7ccb3bceec07b542f4d979814b0cb79f"} Jul 29 17:35:59.305412 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:59.305358 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9hm87" podStartSLOduration=69.519365176 podStartE2EDuration="1m14.305340575s" totalImagesPullingTime="4.785975399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:59.305311478 +0000 UTC m=+74.910182638" watchObservedRunningTime="2026-07-29 17:35:59.305340575 +0000 UTC m=+74.910211737" Jul 29 17:35:59.320028 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:35:59.319979 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lkrjd" podStartSLOduration=69.300545601 podStartE2EDuration="1m14.319962029s" totalImagesPullingTime="5.019416428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:59.319076488 +0000 UTC m=+74.923947650" watchObservedRunningTime="2026-07-29 17:35:59.319962029 +0000 UTC m=+74.924833254" Jul 29 17:36:01.566949 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:01.566922 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:36:04.209887 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:04.209855 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fb6dfcbd7-pjrsb" Jul 29 17:36:06.019072 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.019031 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s5lcz"] Jul 29 17:36:06.021499 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.021471 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.023919 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.023894 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 17:36:06.024443 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.024420 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 17:36:06.024606 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.024482 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 17:36:06.024864 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.024798 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 17:36:06.025086 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.025072 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t4z2s\"" Jul 29 17:36:06.025362 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.025341 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 17:36:06.025691 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.025670 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 17:36:06.140553 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.140509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13342fad-67d3-4cfe-ac0d-03a230f609fa-sys\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.140761 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.140562 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-wtmp\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.140761 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.140591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.140761 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.140616 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/13342fad-67d3-4cfe-ac0d-03a230f609fa-root\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.140761 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.140642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz55s\" (UniqueName: \"kubernetes.io/projected/13342fad-67d3-4cfe-ac0d-03a230f609fa-kube-api-access-vz55s\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.140932 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.140749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-textfile\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.140932 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.140805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.140932 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.140836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13342fad-67d3-4cfe-ac0d-03a230f609fa-metrics-client-ca\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.140932 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.140870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-tls\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.242172 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.242025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13342fad-67d3-4cfe-ac0d-03a230f609fa-metrics-client-ca\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.242172 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.242128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-tls\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.242404 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.242217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13342fad-67d3-4cfe-ac0d-03a230f609fa-sys\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.242404 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.242248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-wtmp\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.242404 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.242277 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.242404 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.242314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/13342fad-67d3-4cfe-ac0d-03a230f609fa-root\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.242404 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.242345 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz55s\" (UniqueName: \"kubernetes.io/projected/13342fad-67d3-4cfe-ac0d-03a230f609fa-kube-api-access-vz55s\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.242653 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.242428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-textfile\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.242653 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.242468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.242653 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.242613 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/13342fad-67d3-4cfe-ac0d-03a230f609fa-root\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.242832 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.242678 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13342fad-67d3-4cfe-ac0d-03a230f609fa-sys\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.242885 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.242826 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-wtmp\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.242885 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.242843 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13342fad-67d3-4cfe-ac0d-03a230f609fa-metrics-client-ca\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.243330 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.243104 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-textfile\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.243425 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.243341 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.244966 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.244943 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-tls\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.245339 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.245320 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13342fad-67d3-4cfe-ac0d-03a230f609fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.253845 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.253823 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz55s\" (UniqueName: \"kubernetes.io/projected/13342fad-67d3-4cfe-ac0d-03a230f609fa-kube-api-access-vz55s\") pod \"node-exporter-s5lcz\" (UID: \"13342fad-67d3-4cfe-ac0d-03a230f609fa\") " pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.334657 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.334572 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s5lcz" Jul 29 17:36:06.349470 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:36:06.349433 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13342fad_67d3_4cfe_ac0d_03a230f609fa.slice/crio-e0e620c0c29f0729a5a0994e08548a8f999067e6d57da5e6123ecce188d4c148 WatchSource:0}: Error finding container e0e620c0c29f0729a5a0994e08548a8f999067e6d57da5e6123ecce188d4c148: Status 404 returned error can't find the container with id e0e620c0c29f0729a5a0994e08548a8f999067e6d57da5e6123ecce188d4c148 Jul 29 17:36:06.582160 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.582098 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" podUID="e2912615-db0a-4cab-9d36-820c669c7fc1" containerName="registry" containerID="cri-o://9cda1a70d1485148a59eacd5d2e6d1ccfa90595218b8cdea1d7dd2e09c478af8" gracePeriod=30 Jul 29 17:36:06.815491 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.815466 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:36:06.949579 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.949545 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2912615-db0a-4cab-9d36-820c669c7fc1-trusted-ca\") pod \"e2912615-db0a-4cab-9d36-820c669c7fc1\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " Jul 29 17:36:06.949771 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.949590 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-bound-sa-token\") pod \"e2912615-db0a-4cab-9d36-820c669c7fc1\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " Jul 29 17:36:06.949771 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.949639 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls\") pod \"e2912615-db0a-4cab-9d36-820c669c7fc1\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " Jul 29 17:36:06.949771 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.949703 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxzg9\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-kube-api-access-zxzg9\") pod \"e2912615-db0a-4cab-9d36-820c669c7fc1\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " Jul 29 17:36:06.949771 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.949744 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2912615-db0a-4cab-9d36-820c669c7fc1-image-registry-private-configuration\") pod \"e2912615-db0a-4cab-9d36-820c669c7fc1\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " Jul 29 17:36:06.950003 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.949780 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2912615-db0a-4cab-9d36-820c669c7fc1-installation-pull-secrets\") pod \"e2912615-db0a-4cab-9d36-820c669c7fc1\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " Jul 29 17:36:06.950003 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.949831 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-certificates\") pod \"e2912615-db0a-4cab-9d36-820c669c7fc1\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " Jul 29 17:36:06.950003 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.949858 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2912615-db0a-4cab-9d36-820c669c7fc1-ca-trust-extracted\") pod \"e2912615-db0a-4cab-9d36-820c669c7fc1\" (UID: \"e2912615-db0a-4cab-9d36-820c669c7fc1\") " Jul 29 17:36:06.950151 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.950054 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2912615-db0a-4cab-9d36-820c669c7fc1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e2912615-db0a-4cab-9d36-820c669c7fc1" (UID: "e2912615-db0a-4cab-9d36-820c669c7fc1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:36:06.950771 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.950709 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e2912615-db0a-4cab-9d36-820c669c7fc1" (UID: "e2912615-db0a-4cab-9d36-820c669c7fc1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:36:06.952795 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.952750 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-kube-api-access-zxzg9" (OuterVolumeSpecName: "kube-api-access-zxzg9") pod "e2912615-db0a-4cab-9d36-820c669c7fc1" (UID: "e2912615-db0a-4cab-9d36-820c669c7fc1"). InnerVolumeSpecName "kube-api-access-zxzg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:36:06.952930 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.952903 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e2912615-db0a-4cab-9d36-820c669c7fc1" (UID: "e2912615-db0a-4cab-9d36-820c669c7fc1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:36:06.953025 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.952939 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2912615-db0a-4cab-9d36-820c669c7fc1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e2912615-db0a-4cab-9d36-820c669c7fc1" (UID: "e2912615-db0a-4cab-9d36-820c669c7fc1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:36:06.953128 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.953112 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e2912615-db0a-4cab-9d36-820c669c7fc1" (UID: "e2912615-db0a-4cab-9d36-820c669c7fc1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:36:06.953704 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.953687 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2912615-db0a-4cab-9d36-820c669c7fc1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e2912615-db0a-4cab-9d36-820c669c7fc1" (UID: "e2912615-db0a-4cab-9d36-820c669c7fc1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:36:06.960989 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:06.960959 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2912615-db0a-4cab-9d36-820c669c7fc1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e2912615-db0a-4cab-9d36-820c669c7fc1" (UID: "e2912615-db0a-4cab-9d36-820c669c7fc1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:36:07.050626 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.050591 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2912615-db0a-4cab-9d36-820c669c7fc1-trusted-ca\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:36:07.050626 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.050620 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-bound-sa-token\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:36:07.050626 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.050629 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-tls\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:36:07.050626 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.050637 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxzg9\" (UniqueName: \"kubernetes.io/projected/e2912615-db0a-4cab-9d36-820c669c7fc1-kube-api-access-zxzg9\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:36:07.051202 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.050648 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2912615-db0a-4cab-9d36-820c669c7fc1-image-registry-private-configuration\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:36:07.051202 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.050657 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2912615-db0a-4cab-9d36-820c669c7fc1-installation-pull-secrets\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:36:07.051202 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.050665 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2912615-db0a-4cab-9d36-820c669c7fc1-registry-certificates\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:36:07.051202 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.050674 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2912615-db0a-4cab-9d36-820c669c7fc1-ca-trust-extracted\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:36:07.321913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.321876 2578 generic.go:356] "Generic (PLEG): container finished" podID="e2912615-db0a-4cab-9d36-820c669c7fc1" containerID="9cda1a70d1485148a59eacd5d2e6d1ccfa90595218b8cdea1d7dd2e09c478af8" exitCode=0 Jul 29 17:36:07.322116 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.321943 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" Jul 29 17:36:07.322116 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.321972 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" event={"ID":"e2912615-db0a-4cab-9d36-820c669c7fc1","Type":"ContainerDied","Data":"9cda1a70d1485148a59eacd5d2e6d1ccfa90595218b8cdea1d7dd2e09c478af8"} Jul 29 17:36:07.322116 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.322036 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ccf666dcd-qxp75" event={"ID":"e2912615-db0a-4cab-9d36-820c669c7fc1","Type":"ContainerDied","Data":"a9bfde7a9112e30dfb3914ee7f4910b1b34400e25155b55d81199e022eb06f78"} Jul 29 17:36:07.322116 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.322068 2578 scope.go:117] "RemoveContainer" containerID="9cda1a70d1485148a59eacd5d2e6d1ccfa90595218b8cdea1d7dd2e09c478af8" Jul 29 17:36:07.323421 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.323311 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s5lcz" event={"ID":"13342fad-67d3-4cfe-ac0d-03a230f609fa","Type":"ContainerStarted","Data":"e0e620c0c29f0729a5a0994e08548a8f999067e6d57da5e6123ecce188d4c148"} Jul 29 17:36:07.343775 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.343725 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-ccf666dcd-qxp75"] Jul 29 17:36:07.347167 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.347111 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-ccf666dcd-qxp75"] Jul 29 17:36:07.423799 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.423638 2578 scope.go:117] "RemoveContainer" containerID="9cda1a70d1485148a59eacd5d2e6d1ccfa90595218b8cdea1d7dd2e09c478af8" Jul 29 17:36:07.424033 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:36:07.424011 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cda1a70d1485148a59eacd5d2e6d1ccfa90595218b8cdea1d7dd2e09c478af8\": container with ID starting with 9cda1a70d1485148a59eacd5d2e6d1ccfa90595218b8cdea1d7dd2e09c478af8 not found: ID does not exist" containerID="9cda1a70d1485148a59eacd5d2e6d1ccfa90595218b8cdea1d7dd2e09c478af8" Jul 29 17:36:07.424088 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:07.424047 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cda1a70d1485148a59eacd5d2e6d1ccfa90595218b8cdea1d7dd2e09c478af8"} err="failed to get container status \"9cda1a70d1485148a59eacd5d2e6d1ccfa90595218b8cdea1d7dd2e09c478af8\": rpc error: code = NotFound desc = could not find container \"9cda1a70d1485148a59eacd5d2e6d1ccfa90595218b8cdea1d7dd2e09c478af8\": container with ID starting with 9cda1a70d1485148a59eacd5d2e6d1ccfa90595218b8cdea1d7dd2e09c478af8 not found: ID does not exist" Jul 29 17:36:08.328532 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:08.328496 2578 generic.go:356] "Generic (PLEG): container finished" podID="13342fad-67d3-4cfe-ac0d-03a230f609fa" containerID="085d80f039b1bfb3eb6bca80a5c6077865810e9129d0b762a3ba4706cdec4f17" exitCode=0 Jul 29 17:36:08.328986 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:08.328582 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s5lcz" event={"ID":"13342fad-67d3-4cfe-ac0d-03a230f609fa","Type":"ContainerDied","Data":"085d80f039b1bfb3eb6bca80a5c6077865810e9129d0b762a3ba4706cdec4f17"} Jul 29 17:36:08.943696 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:08.943662 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2912615-db0a-4cab-9d36-820c669c7fc1" path="/var/lib/kubelet/pods/e2912615-db0a-4cab-9d36-820c669c7fc1/volumes" Jul 29 17:36:09.335002 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:09.334917 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s5lcz" event={"ID":"13342fad-67d3-4cfe-ac0d-03a230f609fa","Type":"ContainerStarted","Data":"542f270726aa05273e4ae45f9469c262b1b431981728bb527222166111dc55bf"} Jul 29 17:36:09.335002 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:09.334970 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s5lcz" event={"ID":"13342fad-67d3-4cfe-ac0d-03a230f609fa","Type":"ContainerStarted","Data":"e0460766b5546e9e3acdeabe24f036738400839502bcb5cc2f29d5c0c75b213f"} Jul 29 17:36:09.358994 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:09.358946 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s5lcz" podStartSLOduration=3.197107188 podStartE2EDuration="4.358929693s" totalImagesPullingTime="1.097151046s" totalInitContainerRuntime="64.671459ms" isStatefulPod=true podCreationTimestamp="2026-07-29 17:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:09.358167675 +0000 UTC m=+84.963038836" watchObservedRunningTime="2026-07-29 17:36:09.358929693 +0000 UTC m=+84.963800854" Jul 29 17:36:30.299618 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:36:30.299584 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9hm87" Jul 29 17:39:44.789901 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:44.789873 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 17:39:49.950307 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:49.950269 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5"] Jul 29 17:39:49.951588 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:49.950501 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2912615-db0a-4cab-9d36-820c669c7fc1" containerName="registry" Jul 29 17:39:49.951588 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:49.950511 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2912615-db0a-4cab-9d36-820c669c7fc1" containerName="registry" Jul 29 17:39:49.951588 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:49.950577 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2912615-db0a-4cab-9d36-820c669c7fc1" containerName="registry" Jul 29 17:39:49.952153 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:49.952138 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:49.955377 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:49.955201 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 29 17:39:49.955516 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:49.955392 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 29 17:39:49.955618 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:49.955601 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2czn8\"" Jul 29 17:39:49.955912 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:49.955894 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 29 17:39:49.956538 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:49.956520 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 29 17:39:49.979728 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:49.979689 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5"] Jul 29 17:39:50.138582 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.138546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/59036ae9-21be-4f8c-b333-a62d167e1f3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.138790 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.138593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59036ae9-21be-4f8c-b333-a62d167e1f3c-tmp\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.138790 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.138621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59036ae9-21be-4f8c-b333-a62d167e1f3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.138790 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.138660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/59036ae9-21be-4f8c-b333-a62d167e1f3c-manifests\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.138790 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.138682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jxx5\" (UniqueName: \"kubernetes.io/projected/59036ae9-21be-4f8c-b333-a62d167e1f3c-kube-api-access-7jxx5\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.239748 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.239624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/59036ae9-21be-4f8c-b333-a62d167e1f3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.239748 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.239683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59036ae9-21be-4f8c-b333-a62d167e1f3c-tmp\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.239748 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.239735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59036ae9-21be-4f8c-b333-a62d167e1f3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.240048 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.239771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/59036ae9-21be-4f8c-b333-a62d167e1f3c-manifests\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.240048 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.239799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jxx5\" (UniqueName: \"kubernetes.io/projected/59036ae9-21be-4f8c-b333-a62d167e1f3c-kube-api-access-7jxx5\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.240217 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.240187 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/59036ae9-21be-4f8c-b333-a62d167e1f3c-manifests\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.242173 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.242138 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59036ae9-21be-4f8c-b333-a62d167e1f3c-tmp\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.242301 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.242285 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59036ae9-21be-4f8c-b333-a62d167e1f3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.242343 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.242331 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/59036ae9-21be-4f8c-b333-a62d167e1f3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.248378 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.248349 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jxx5\" (UniqueName: \"kubernetes.io/projected/59036ae9-21be-4f8c-b333-a62d167e1f3c-kube-api-access-7jxx5\") pod \"opendatahub-operator-controller-manager-78ccbc8659-5qfg5\" (UID: \"59036ae9-21be-4f8c-b333-a62d167e1f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.262264 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.262239 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:50.404243 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.404215 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5"] Jul 29 17:39:50.407371 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:39:50.407344 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59036ae9_21be_4f8c_b333_a62d167e1f3c.slice/crio-c4a529d03d541edf0d5e63ab0a6075e4b16fde313ae6bac679a004be4c9b59e7 WatchSource:0}: Error finding container c4a529d03d541edf0d5e63ab0a6075e4b16fde313ae6bac679a004be4c9b59e7: Status 404 returned error can't find the container with id c4a529d03d541edf0d5e63ab0a6075e4b16fde313ae6bac679a004be4c9b59e7 Jul 29 17:39:50.409470 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:50.409450 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 17:39:51.074707 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:51.074663 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" event={"ID":"59036ae9-21be-4f8c-b333-a62d167e1f3c","Type":"ContainerStarted","Data":"c4a529d03d541edf0d5e63ab0a6075e4b16fde313ae6bac679a004be4c9b59e7"} Jul 29 17:39:54.090151 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:54.090109 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" event={"ID":"59036ae9-21be-4f8c-b333-a62d167e1f3c","Type":"ContainerStarted","Data":"3619d63cb410969b47fd7a2b581f1c839e57d86287be0f68b69a24dec9943fc5"} Jul 29 17:39:55.094300 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:55.094265 2578 generic.go:356] "Generic (PLEG): container finished" podID="59036ae9-21be-4f8c-b333-a62d167e1f3c" containerID="3619d63cb410969b47fd7a2b581f1c839e57d86287be0f68b69a24dec9943fc5" exitCode=0 Jul 29 17:39:55.094849 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:55.094357 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" event={"ID":"59036ae9-21be-4f8c-b333-a62d167e1f3c","Type":"ContainerDied","Data":"3619d63cb410969b47fd7a2b581f1c839e57d86287be0f68b69a24dec9943fc5"} Jul 29 17:39:56.099866 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:56.099832 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" event={"ID":"59036ae9-21be-4f8c-b333-a62d167e1f3c","Type":"ContainerStarted","Data":"5a1be20bbd472b2c56425aa5fee06d4f39f91d8a260396aad9a540ccd3c73e23"} Jul 29 17:39:56.100276 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:56.099986 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:39:56.121552 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:39:56.121493 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" podStartSLOduration=2.830031026 podStartE2EDuration="7.121471651s" totalImagesPullingTime="3.211501318s" totalInitContainerRuntime="1.079939307s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:39:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:39:56.120174358 +0000 UTC m=+311.725045522" watchObservedRunningTime="2026-07-29 17:39:56.121471651 +0000 UTC m=+311.726342814" Jul 29 17:40:07.105072 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:07.105042 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-5qfg5" Jul 29 17:40:09.597059 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.597023 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb"] Jul 29 17:40:09.603158 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.603135 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb" Jul 29 17:40:09.606409 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.606386 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 29 17:40:09.606559 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.606429 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zndbs\"" Jul 29 17:40:09.606559 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.606461 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 29 17:40:09.606749 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.606734 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 29 17:40:09.607375 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.607342 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 29 17:40:09.620476 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.620447 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb"] Jul 29 17:40:09.677246 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.677210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/428d05b5-7467-4d7c-b5ce-2d495fa4c6b0-tls-certs\") pod \"kube-auth-proxy-5c7886b686-n2bsb\" (UID: \"428d05b5-7467-4d7c-b5ce-2d495fa4c6b0\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb" Jul 29 17:40:09.677424 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.677260 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhn9z\" (UniqueName: \"kubernetes.io/projected/428d05b5-7467-4d7c-b5ce-2d495fa4c6b0-kube-api-access-mhn9z\") pod \"kube-auth-proxy-5c7886b686-n2bsb\" (UID: \"428d05b5-7467-4d7c-b5ce-2d495fa4c6b0\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb" Jul 29 17:40:09.677424 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.677335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/428d05b5-7467-4d7c-b5ce-2d495fa4c6b0-tmp\") pod \"kube-auth-proxy-5c7886b686-n2bsb\" (UID: \"428d05b5-7467-4d7c-b5ce-2d495fa4c6b0\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb" Jul 29 17:40:09.778042 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.777981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/428d05b5-7467-4d7c-b5ce-2d495fa4c6b0-tls-certs\") pod \"kube-auth-proxy-5c7886b686-n2bsb\" (UID: \"428d05b5-7467-4d7c-b5ce-2d495fa4c6b0\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb" Jul 29 17:40:09.778270 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.778050 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhn9z\" (UniqueName: \"kubernetes.io/projected/428d05b5-7467-4d7c-b5ce-2d495fa4c6b0-kube-api-access-mhn9z\") pod \"kube-auth-proxy-5c7886b686-n2bsb\" (UID: \"428d05b5-7467-4d7c-b5ce-2d495fa4c6b0\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb" Jul 29 17:40:09.778270 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.778085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/428d05b5-7467-4d7c-b5ce-2d495fa4c6b0-tmp\") pod \"kube-auth-proxy-5c7886b686-n2bsb\" (UID: \"428d05b5-7467-4d7c-b5ce-2d495fa4c6b0\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb" Jul 29 17:40:09.780522 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.780495 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/428d05b5-7467-4d7c-b5ce-2d495fa4c6b0-tmp\") pod \"kube-auth-proxy-5c7886b686-n2bsb\" (UID: \"428d05b5-7467-4d7c-b5ce-2d495fa4c6b0\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb" Jul 29 17:40:09.780838 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.780815 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/428d05b5-7467-4d7c-b5ce-2d495fa4c6b0-tls-certs\") pod \"kube-auth-proxy-5c7886b686-n2bsb\" (UID: \"428d05b5-7467-4d7c-b5ce-2d495fa4c6b0\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb" Jul 29 17:40:09.789346 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.789318 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhn9z\" (UniqueName: \"kubernetes.io/projected/428d05b5-7467-4d7c-b5ce-2d495fa4c6b0-kube-api-access-mhn9z\") pod \"kube-auth-proxy-5c7886b686-n2bsb\" (UID: \"428d05b5-7467-4d7c-b5ce-2d495fa4c6b0\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb" Jul 29 17:40:09.913340 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:09.913302 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb" Jul 29 17:40:10.075439 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:10.075400 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb"] Jul 29 17:40:10.085053 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:40:10.085026 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428d05b5_7467_4d7c_b5ce_2d495fa4c6b0.slice/crio-a063b97068eb6bc68411bf8e06096608aba9b997047cf8dd5f30ccd6c868da23 WatchSource:0}: Error finding container a063b97068eb6bc68411bf8e06096608aba9b997047cf8dd5f30ccd6c868da23: Status 404 returned error can't find the container with id a063b97068eb6bc68411bf8e06096608aba9b997047cf8dd5f30ccd6c868da23 Jul 29 17:40:10.145913 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:10.145882 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb" event={"ID":"428d05b5-7467-4d7c-b5ce-2d495fa4c6b0","Type":"ContainerStarted","Data":"a063b97068eb6bc68411bf8e06096608aba9b997047cf8dd5f30ccd6c868da23"} Jul 29 17:40:13.159346 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:13.159308 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb" event={"ID":"428d05b5-7467-4d7c-b5ce-2d495fa4c6b0","Type":"ContainerStarted","Data":"b02b4fb59907c25b13df867b1951a72faa932c556612993c58d3ee3e56b749ab"} Jul 29 17:40:13.178627 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:13.178564 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5c7886b686-n2bsb" podStartSLOduration=1.570174466 podStartE2EDuration="4.178543067s" totalImagesPullingTime="2.608368601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:40:13.176166376 +0000 UTC m=+328.781037537" watchObservedRunningTime="2026-07-29 17:40:13.178543067 +0000 UTC m=+328.783414230" Jul 29 17:40:16.553237 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.553204 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt"] Jul 29 17:40:16.555834 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.555812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.558518 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.558496 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-frl2n\"" Jul 29 17:40:16.562882 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.562414 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 29 17:40:16.581489 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.581461 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt"] Jul 29 17:40:16.630245 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.630212 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.630245 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.630248 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g57v\" (UniqueName: \"kubernetes.io/projected/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-kube-api-access-6g57v\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.630480 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.630281 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.630480 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.630312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.630480 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.630335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.630480 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.630350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.630480 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.630375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.630480 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.630427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.630480 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.630459 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.731497 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.731462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.731497 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.731510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.731793 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.731536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.731793 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.731562 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.731793 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.731593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.731793 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.731629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.731996 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.731796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.731996 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.731880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.731996 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.731909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g57v\" (UniqueName: \"kubernetes.io/projected/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-kube-api-access-6g57v\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.731996 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.731971 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.732348 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.732317 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.732461 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.732353 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.732461 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.732402 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.732569 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.732505 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.734267 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.734245 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.734500 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.734476 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.742663 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.742633 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g57v\" (UniqueName: \"kubernetes.io/projected/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-kube-api-access-6g57v\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.743272 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.743251 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:16.867306 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:16.867226 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:17.018592 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.018375 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt"] Jul 29 17:40:17.180249 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.180209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" event={"ID":"7dd702e4-9b4b-4968-9d7b-28178e11ae8e","Type":"ContainerStarted","Data":"11b2c7cbe9503aa1e3f532e6d66f699a5a82c311fb4a85cd5cd89d13a6cbee9d"} Jul 29 17:40:17.753409 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.753371 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr"] Jul 29 17:40:17.756184 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.756168 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.758502 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.758478 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 29 17:40:17.759236 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.759215 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 29 17:40:17.759368 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.759300 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cld5s\"" Jul 29 17:40:17.759427 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.759375 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 29 17:40:17.773623 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.773597 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr"] Jul 29 17:40:17.843221 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.843182 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.843221 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.843224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.843461 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.843259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgtnx\" (UniqueName: \"kubernetes.io/projected/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-kube-api-access-hgtnx\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.843461 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.843294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.843461 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.843336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.843461 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.843370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.843461 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.843390 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.944125 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.944090 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.944292 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.944145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.944292 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.944183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.944292 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.944207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.944622 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.944431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.944622 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.944476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.944622 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.944514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgtnx\" (UniqueName: \"kubernetes.io/projected/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-kube-api-access-hgtnx\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.945368 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.945314 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.947003 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.946973 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.947003 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.946999 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.947137 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.946977 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.947137 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.947082 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.952968 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.952945 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:17.953076 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:17.953044 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgtnx\" (UniqueName: \"kubernetes.io/projected/8dfbb46f-4dac-4fe7-a906-35fca3a339a7-kube-api-access-hgtnx\") pod \"istiod-openshift-gateway-5677ccb49b-p6nfr\" (UID: \"8dfbb46f-4dac-4fe7-a906-35fca3a339a7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:18.066365 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:18.066041 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:18.245257 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:18.245222 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr"] Jul 29 17:40:18.411625 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:40:18.411596 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dfbb46f_4dac_4fe7_a906_35fca3a339a7.slice/crio-1956ed862cb2a38fb58424a4105d87dacd5fb72172417919baeac7975779b3a9 WatchSource:0}: Error finding container 1956ed862cb2a38fb58424a4105d87dacd5fb72172417919baeac7975779b3a9: Status 404 returned error can't find the container with id 1956ed862cb2a38fb58424a4105d87dacd5fb72172417919baeac7975779b3a9 Jul 29 17:40:19.194966 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:19.194920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" event={"ID":"8dfbb46f-4dac-4fe7-a906-35fca3a339a7","Type":"ContainerStarted","Data":"1956ed862cb2a38fb58424a4105d87dacd5fb72172417919baeac7975779b3a9"} Jul 29 17:40:21.247738 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:21.247691 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 29 17:40:21.248069 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:21.247769 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 29 17:40:21.652754 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:21.652651 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt"] Jul 29 17:40:22.214089 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:22.214052 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" event={"ID":"8dfbb46f-4dac-4fe7-a906-35fca3a339a7","Type":"ContainerStarted","Data":"61826708c89ac97a62d0f9761e9cd394212f3caa6689a24943f079bf66c8cd58"} Jul 29 17:40:22.243639 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:22.243568 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" podStartSLOduration=2.409740472 podStartE2EDuration="5.243547088s" totalImagesPullingTime="2.833806616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:40:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:40:22.240175816 +0000 UTC m=+337.845046981" watchObservedRunningTime="2026-07-29 17:40:22.243547088 +0000 UTC m=+337.848418250" Jul 29 17:40:22.408140 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:22.408101 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 29 17:40:22.408431 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:22.408178 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 29 17:40:22.408431 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:22.408213 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 29 17:40:23.219119 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:23.219077 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" event={"ID":"7dd702e4-9b4b-4968-9d7b-28178e11ae8e","Type":"ContainerStarted","Data":"58f80dc07eafc1b54b767525f1cf1afb06b24b5d7d2d0718eea65f0ba2ae6a72"} Jul 29 17:40:23.219309 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:23.219175 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" podUID="7dd702e4-9b4b-4968-9d7b-28178e11ae8e" containerName="istio-proxy" containerID="cri-o://58f80dc07eafc1b54b767525f1cf1afb06b24b5d7d2d0718eea65f0ba2ae6a72" gracePeriod=30 Jul 29 17:40:23.219525 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:23.219508 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:23.221107 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:23.221087 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-p6nfr" Jul 29 17:40:23.241040 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:23.240988 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" podStartSLOduration=1.853323249 podStartE2EDuration="7.2409732s" totalImagesPullingTime="5.387649951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:40:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:40:23.239600018 +0000 UTC m=+338.844471179" watchObservedRunningTime="2026-07-29 17:40:23.2409732 +0000 UTC m=+338.845844364" Jul 29 17:40:28.463033 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.463007 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:28.560337 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.560236 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-podinfo\") pod \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " Jul 29 17:40:28.560337 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.560293 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-workload-certs\") pod \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " Jul 29 17:40:28.560337 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.560328 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g57v\" (UniqueName: \"kubernetes.io/projected/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-kube-api-access-6g57v\") pod \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " Jul 29 17:40:28.560582 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.560347 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-data\") pod \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " Jul 29 17:40:28.560582 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.560381 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-workload-socket\") pod \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " Jul 29 17:40:28.560582 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.560431 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-credential-socket\") pod \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " Jul 29 17:40:28.560582 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.560454 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-token\") pod \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " Jul 29 17:40:28.560582 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.560488 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istiod-ca-cert\") pod \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " Jul 29 17:40:28.560582 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.560512 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-envoy\") pod \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\" (UID: \"7dd702e4-9b4b-4968-9d7b-28178e11ae8e\") " Jul 29 17:40:28.562061 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.562004 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7dd702e4-9b4b-4968-9d7b-28178e11ae8e" (UID: "7dd702e4-9b4b-4968-9d7b-28178e11ae8e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:40:28.562061 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.562032 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7dd702e4-9b4b-4968-9d7b-28178e11ae8e" (UID: "7dd702e4-9b4b-4968-9d7b-28178e11ae8e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:40:28.562061 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.562057 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7dd702e4-9b4b-4968-9d7b-28178e11ae8e" (UID: "7dd702e4-9b4b-4968-9d7b-28178e11ae8e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:40:28.562288 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.562043 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-data" (OuterVolumeSpecName: "istio-data") pod "7dd702e4-9b4b-4968-9d7b-28178e11ae8e" (UID: "7dd702e4-9b4b-4968-9d7b-28178e11ae8e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:40:28.562402 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.562378 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7dd702e4-9b4b-4968-9d7b-28178e11ae8e" (UID: "7dd702e4-9b4b-4968-9d7b-28178e11ae8e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:40:28.563891 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.563867 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7dd702e4-9b4b-4968-9d7b-28178e11ae8e" (UID: "7dd702e4-9b4b-4968-9d7b-28178e11ae8e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 17:40:28.564015 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.563979 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-token" (OuterVolumeSpecName: "istio-token") pod "7dd702e4-9b4b-4968-9d7b-28178e11ae8e" (UID: "7dd702e4-9b4b-4968-9d7b-28178e11ae8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:40:28.564288 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.564264 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7dd702e4-9b4b-4968-9d7b-28178e11ae8e" (UID: "7dd702e4-9b4b-4968-9d7b-28178e11ae8e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:40:28.564288 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.564267 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-kube-api-access-6g57v" (OuterVolumeSpecName: "kube-api-access-6g57v") pod "7dd702e4-9b4b-4968-9d7b-28178e11ae8e" (UID: "7dd702e4-9b4b-4968-9d7b-28178e11ae8e"). InnerVolumeSpecName "kube-api-access-6g57v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:40:28.661870 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.661822 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-credential-socket\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:40:28.661870 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.661862 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-token\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:40:28.661870 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.661872 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istiod-ca-cert\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:40:28.661870 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.661879 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-envoy\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:40:28.662130 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.661887 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-podinfo\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:40:28.662130 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.661894 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-workload-certs\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:40:28.662130 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.661903 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g57v\" (UniqueName: \"kubernetes.io/projected/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-kube-api-access-6g57v\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:40:28.662130 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.661911 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-istio-data\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:40:28.662130 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:28.661920 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd702e4-9b4b-4968-9d7b-28178e11ae8e-workload-socket\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:40:29.242082 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:29.241994 2578 generic.go:356] "Generic (PLEG): container finished" podID="7dd702e4-9b4b-4968-9d7b-28178e11ae8e" containerID="58f80dc07eafc1b54b767525f1cf1afb06b24b5d7d2d0718eea65f0ba2ae6a72" exitCode=0 Jul 29 17:40:29.242082 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:29.242037 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" Jul 29 17:40:29.242082 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:29.242043 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" event={"ID":"7dd702e4-9b4b-4968-9d7b-28178e11ae8e","Type":"ContainerDied","Data":"58f80dc07eafc1b54b767525f1cf1afb06b24b5d7d2d0718eea65f0ba2ae6a72"} Jul 29 17:40:29.242316 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:29.242094 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt" event={"ID":"7dd702e4-9b4b-4968-9d7b-28178e11ae8e","Type":"ContainerDied","Data":"11b2c7cbe9503aa1e3f532e6d66f699a5a82c311fb4a85cd5cd89d13a6cbee9d"} Jul 29 17:40:29.242316 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:29.242118 2578 scope.go:117] "RemoveContainer" containerID="58f80dc07eafc1b54b767525f1cf1afb06b24b5d7d2d0718eea65f0ba2ae6a72" Jul 29 17:40:29.252198 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:29.252182 2578 scope.go:117] "RemoveContainer" containerID="58f80dc07eafc1b54b767525f1cf1afb06b24b5d7d2d0718eea65f0ba2ae6a72" Jul 29 17:40:29.252470 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:40:29.252449 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58f80dc07eafc1b54b767525f1cf1afb06b24b5d7d2d0718eea65f0ba2ae6a72\": container with ID starting with 58f80dc07eafc1b54b767525f1cf1afb06b24b5d7d2d0718eea65f0ba2ae6a72 not found: ID does not exist" containerID="58f80dc07eafc1b54b767525f1cf1afb06b24b5d7d2d0718eea65f0ba2ae6a72" Jul 29 17:40:29.252515 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:29.252480 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58f80dc07eafc1b54b767525f1cf1afb06b24b5d7d2d0718eea65f0ba2ae6a72"} err="failed to get container status \"58f80dc07eafc1b54b767525f1cf1afb06b24b5d7d2d0718eea65f0ba2ae6a72\": rpc error: code = NotFound desc = could not find container \"58f80dc07eafc1b54b767525f1cf1afb06b24b5d7d2d0718eea65f0ba2ae6a72\": container with ID starting with 58f80dc07eafc1b54b767525f1cf1afb06b24b5d7d2d0718eea65f0ba2ae6a72 not found: ID does not exist" Jul 29 17:40:29.259943 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:29.259922 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt"] Jul 29 17:40:29.264545 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:29.264521 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcmnbbt"] Jul 29 17:40:30.942308 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:40:30.942279 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dd702e4-9b4b-4968-9d7b-28178e11ae8e" path="/var/lib/kubelet/pods/7dd702e4-9b4b-4968-9d7b-28178e11ae8e/volumes" Jul 29 17:41:10.711170 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:10.711136 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vmn5c"] Jul 29 17:41:10.711651 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:10.711442 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dd702e4-9b4b-4968-9d7b-28178e11ae8e" containerName="istio-proxy" Jul 29 17:41:10.711651 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:10.711455 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dd702e4-9b4b-4968-9d7b-28178e11ae8e" containerName="istio-proxy" Jul 29 17:41:10.711651 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:10.711519 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dd702e4-9b4b-4968-9d7b-28178e11ae8e" containerName="istio-proxy" Jul 29 17:41:10.713509 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:10.713492 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vmn5c" Jul 29 17:41:10.715962 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:10.715941 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 29 17:41:10.716126 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:10.716106 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 29 17:41:10.716194 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:10.716175 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vdr99\"" Jul 29 17:41:10.723349 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:10.723319 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vmn5c"] Jul 29 17:41:10.790838 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:10.790800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7psb\" (UniqueName: \"kubernetes.io/projected/50bb23e6-2ea6-4e12-82e3-a89312fcc4df-kube-api-access-s7psb\") pod \"kuadrant-operator-catalog-vmn5c\" (UID: \"50bb23e6-2ea6-4e12-82e3-a89312fcc4df\") " pod="kuadrant-system/kuadrant-operator-catalog-vmn5c" Jul 29 17:41:10.892161 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:10.892125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7psb\" (UniqueName: \"kubernetes.io/projected/50bb23e6-2ea6-4e12-82e3-a89312fcc4df-kube-api-access-s7psb\") pod \"kuadrant-operator-catalog-vmn5c\" (UID: \"50bb23e6-2ea6-4e12-82e3-a89312fcc4df\") " pod="kuadrant-system/kuadrant-operator-catalog-vmn5c" Jul 29 17:41:10.900070 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:10.900037 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7psb\" (UniqueName: \"kubernetes.io/projected/50bb23e6-2ea6-4e12-82e3-a89312fcc4df-kube-api-access-s7psb\") pod \"kuadrant-operator-catalog-vmn5c\" (UID: \"50bb23e6-2ea6-4e12-82e3-a89312fcc4df\") " pod="kuadrant-system/kuadrant-operator-catalog-vmn5c" Jul 29 17:41:11.024264 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:11.024175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vmn5c" Jul 29 17:41:11.079987 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:11.079946 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vmn5c"] Jul 29 17:41:11.153891 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:11.153839 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vmn5c"] Jul 29 17:41:11.156396 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:41:11.156371 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50bb23e6_2ea6_4e12_82e3_a89312fcc4df.slice/crio-6ca1db2803f5554602b835c4eb2b02a4961c47be68e5f634b406834832c70339 WatchSource:0}: Error finding container 6ca1db2803f5554602b835c4eb2b02a4961c47be68e5f634b406834832c70339: Status 404 returned error can't find the container with id 6ca1db2803f5554602b835c4eb2b02a4961c47be68e5f634b406834832c70339 Jul 29 17:41:11.289348 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:11.289257 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brlr5"] Jul 29 17:41:11.292211 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:11.292187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-brlr5" Jul 29 17:41:11.300103 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:11.300080 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brlr5"] Jul 29 17:41:11.390435 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:11.390399 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vmn5c" event={"ID":"50bb23e6-2ea6-4e12-82e3-a89312fcc4df","Type":"ContainerStarted","Data":"6ca1db2803f5554602b835c4eb2b02a4961c47be68e5f634b406834832c70339"} Jul 29 17:41:11.396793 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:11.396759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz7hn\" (UniqueName: \"kubernetes.io/projected/a6df4794-a766-491f-a674-ce34405cc954-kube-api-access-bz7hn\") pod \"kuadrant-operator-catalog-brlr5\" (UID: \"a6df4794-a766-491f-a674-ce34405cc954\") " pod="kuadrant-system/kuadrant-operator-catalog-brlr5" Jul 29 17:41:11.498174 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:11.498145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz7hn\" (UniqueName: \"kubernetes.io/projected/a6df4794-a766-491f-a674-ce34405cc954-kube-api-access-bz7hn\") pod \"kuadrant-operator-catalog-brlr5\" (UID: \"a6df4794-a766-491f-a674-ce34405cc954\") " pod="kuadrant-system/kuadrant-operator-catalog-brlr5" Jul 29 17:41:11.505644 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:11.505608 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz7hn\" (UniqueName: \"kubernetes.io/projected/a6df4794-a766-491f-a674-ce34405cc954-kube-api-access-bz7hn\") pod \"kuadrant-operator-catalog-brlr5\" (UID: \"a6df4794-a766-491f-a674-ce34405cc954\") " pod="kuadrant-system/kuadrant-operator-catalog-brlr5" Jul 29 17:41:11.602046 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:11.601947 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-brlr5" Jul 29 17:41:11.731745 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:11.731697 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brlr5"] Jul 29 17:41:11.734727 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:41:11.734682 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6df4794_a766_491f_a674_ce34405cc954.slice/crio-bdce6404d1e8fd9343a817fc04ab8badf497c367a69d98c7b6260b49f95e6b19 WatchSource:0}: Error finding container bdce6404d1e8fd9343a817fc04ab8badf497c367a69d98c7b6260b49f95e6b19: Status 404 returned error can't find the container with id bdce6404d1e8fd9343a817fc04ab8badf497c367a69d98c7b6260b49f95e6b19 Jul 29 17:41:12.397843 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:12.397793 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-brlr5" event={"ID":"a6df4794-a766-491f-a674-ce34405cc954","Type":"ContainerStarted","Data":"bdce6404d1e8fd9343a817fc04ab8badf497c367a69d98c7b6260b49f95e6b19"} Jul 29 17:41:13.404559 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:13.404511 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-brlr5" event={"ID":"a6df4794-a766-491f-a674-ce34405cc954","Type":"ContainerStarted","Data":"f91b2bebbdc0777a4a099935433210de8ecd8f9a298d4747372e32d1a2f2c0c3"} Jul 29 17:41:13.406513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:13.406486 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vmn5c" event={"ID":"50bb23e6-2ea6-4e12-82e3-a89312fcc4df","Type":"ContainerStarted","Data":"f8a6f7e0f986f8325891fecf45a94f2b2ee2c4c4f9197a9b3c4e8aa0e8071b77"} Jul 29 17:41:13.406649 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:13.406545 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-vmn5c" podUID="50bb23e6-2ea6-4e12-82e3-a89312fcc4df" containerName="registry-server" containerID="cri-o://f8a6f7e0f986f8325891fecf45a94f2b2ee2c4c4f9197a9b3c4e8aa0e8071b77" gracePeriod=2 Jul 29 17:41:13.422338 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:13.422151 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-brlr5" podStartSLOduration=0.851574673 podStartE2EDuration="2.422128708s" totalImagesPullingTime="1.570554035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:41:13.421395693 +0000 UTC m=+389.026266856" watchObservedRunningTime="2026-07-29 17:41:13.422128708 +0000 UTC m=+389.026999872" Jul 29 17:41:13.439422 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:13.439372 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vmn5c" podStartSLOduration=1.293541939 podStartE2EDuration="3.439354042s" totalImagesPullingTime="2.145812103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:41:13.437996974 +0000 UTC m=+389.042868136" watchObservedRunningTime="2026-07-29 17:41:13.439354042 +0000 UTC m=+389.044225202" Jul 29 17:41:13.653700 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:13.653673 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vmn5c_50bb23e6-2ea6-4e12-82e3-a89312fcc4df/registry-server/0.log" Jul 29 17:41:13.655924 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:13.655908 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vmn5c" Jul 29 17:41:13.720440 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:13.720410 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7psb\" (UniqueName: \"kubernetes.io/projected/50bb23e6-2ea6-4e12-82e3-a89312fcc4df-kube-api-access-s7psb\") pod \"50bb23e6-2ea6-4e12-82e3-a89312fcc4df\" (UID: \"50bb23e6-2ea6-4e12-82e3-a89312fcc4df\") " Jul 29 17:41:13.722615 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:13.722585 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50bb23e6-2ea6-4e12-82e3-a89312fcc4df-kube-api-access-s7psb" (OuterVolumeSpecName: "kube-api-access-s7psb") pod "50bb23e6-2ea6-4e12-82e3-a89312fcc4df" (UID: "50bb23e6-2ea6-4e12-82e3-a89312fcc4df"). InnerVolumeSpecName "kube-api-access-s7psb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:41:13.821967 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:13.821930 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7psb\" (UniqueName: \"kubernetes.io/projected/50bb23e6-2ea6-4e12-82e3-a89312fcc4df-kube-api-access-s7psb\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:41:14.411723 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:14.411694 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vmn5c_50bb23e6-2ea6-4e12-82e3-a89312fcc4df/registry-server/0.log" Jul 29 17:41:14.412117 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:14.411754 2578 generic.go:356] "Generic (PLEG): container finished" podID="50bb23e6-2ea6-4e12-82e3-a89312fcc4df" containerID="f8a6f7e0f986f8325891fecf45a94f2b2ee2c4c4f9197a9b3c4e8aa0e8071b77" exitCode=2 Jul 29 17:41:14.412117 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:14.411802 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vmn5c" Jul 29 17:41:14.412117 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:14.411843 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vmn5c" event={"ID":"50bb23e6-2ea6-4e12-82e3-a89312fcc4df","Type":"ContainerDied","Data":"f8a6f7e0f986f8325891fecf45a94f2b2ee2c4c4f9197a9b3c4e8aa0e8071b77"} Jul 29 17:41:14.412117 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:14.411893 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vmn5c" event={"ID":"50bb23e6-2ea6-4e12-82e3-a89312fcc4df","Type":"ContainerDied","Data":"6ca1db2803f5554602b835c4eb2b02a4961c47be68e5f634b406834832c70339"} Jul 29 17:41:14.412117 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:14.411917 2578 scope.go:117] "RemoveContainer" containerID="f8a6f7e0f986f8325891fecf45a94f2b2ee2c4c4f9197a9b3c4e8aa0e8071b77" Jul 29 17:41:14.420184 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:14.420166 2578 scope.go:117] "RemoveContainer" containerID="f8a6f7e0f986f8325891fecf45a94f2b2ee2c4c4f9197a9b3c4e8aa0e8071b77" Jul 29 17:41:14.420445 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:41:14.420425 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8a6f7e0f986f8325891fecf45a94f2b2ee2c4c4f9197a9b3c4e8aa0e8071b77\": container with ID starting with f8a6f7e0f986f8325891fecf45a94f2b2ee2c4c4f9197a9b3c4e8aa0e8071b77 not found: ID does not exist" containerID="f8a6f7e0f986f8325891fecf45a94f2b2ee2c4c4f9197a9b3c4e8aa0e8071b77" Jul 29 17:41:14.420503 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:14.420457 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8a6f7e0f986f8325891fecf45a94f2b2ee2c4c4f9197a9b3c4e8aa0e8071b77"} err="failed to get container status \"f8a6f7e0f986f8325891fecf45a94f2b2ee2c4c4f9197a9b3c4e8aa0e8071b77\": rpc error: code = NotFound desc = could not find container \"f8a6f7e0f986f8325891fecf45a94f2b2ee2c4c4f9197a9b3c4e8aa0e8071b77\": container with ID starting with f8a6f7e0f986f8325891fecf45a94f2b2ee2c4c4f9197a9b3c4e8aa0e8071b77 not found: ID does not exist" Jul 29 17:41:14.433019 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:14.432993 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vmn5c"] Jul 29 17:41:14.442977 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:14.440874 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vmn5c"] Jul 29 17:41:14.942155 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:14.942115 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50bb23e6-2ea6-4e12-82e3-a89312fcc4df" path="/var/lib/kubelet/pods/50bb23e6-2ea6-4e12-82e3-a89312fcc4df/volumes" Jul 29 17:41:21.602486 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:21.602451 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-brlr5" Jul 29 17:41:21.603023 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:21.602504 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-brlr5" Jul 29 17:41:21.623681 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:21.623647 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-brlr5" Jul 29 17:41:22.461876 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:22.461839 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-brlr5" Jul 29 17:41:44.033156 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:44.033118 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4bqxx"] Jul 29 17:41:44.033632 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:44.033407 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50bb23e6-2ea6-4e12-82e3-a89312fcc4df" containerName="registry-server" Jul 29 17:41:44.033632 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:44.033418 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="50bb23e6-2ea6-4e12-82e3-a89312fcc4df" containerName="registry-server" Jul 29 17:41:44.033632 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:44.033484 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="50bb23e6-2ea6-4e12-82e3-a89312fcc4df" containerName="registry-server" Jul 29 17:41:44.039126 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:44.039105 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4bqxx" Jul 29 17:41:44.041896 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:44.041870 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vvr2p\"" Jul 29 17:41:44.048464 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:44.048441 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4bqxx"] Jul 29 17:41:44.163827 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:44.163781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmzl9\" (UniqueName: \"kubernetes.io/projected/b668e312-b0fb-4676-bc39-86f7d08e5e97-kube-api-access-pmzl9\") pod \"authorino-operator-75cc8d5cb7-4bqxx\" (UID: \"b668e312-b0fb-4676-bc39-86f7d08e5e97\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4bqxx" Jul 29 17:41:44.264325 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:44.264286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmzl9\" (UniqueName: \"kubernetes.io/projected/b668e312-b0fb-4676-bc39-86f7d08e5e97-kube-api-access-pmzl9\") pod \"authorino-operator-75cc8d5cb7-4bqxx\" (UID: \"b668e312-b0fb-4676-bc39-86f7d08e5e97\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4bqxx" Jul 29 17:41:44.276317 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:44.276279 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmzl9\" (UniqueName: \"kubernetes.io/projected/b668e312-b0fb-4676-bc39-86f7d08e5e97-kube-api-access-pmzl9\") pod \"authorino-operator-75cc8d5cb7-4bqxx\" (UID: \"b668e312-b0fb-4676-bc39-86f7d08e5e97\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4bqxx" Jul 29 17:41:44.349770 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:44.349649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4bqxx" Jul 29 17:41:44.478894 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:44.478861 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4bqxx"] Jul 29 17:41:44.482216 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:41:44.482190 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb668e312_b0fb_4676_bc39_86f7d08e5e97.slice/crio-e69f68b5d18ff3f93f7f6edc6246a431b62b21673596778865d4bde966d0b384 WatchSource:0}: Error finding container e69f68b5d18ff3f93f7f6edc6246a431b62b21673596778865d4bde966d0b384: Status 404 returned error can't find the container with id e69f68b5d18ff3f93f7f6edc6246a431b62b21673596778865d4bde966d0b384 Jul 29 17:41:44.525135 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:44.525104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4bqxx" event={"ID":"b668e312-b0fb-4676-bc39-86f7d08e5e97","Type":"ContainerStarted","Data":"e69f68b5d18ff3f93f7f6edc6246a431b62b21673596778865d4bde966d0b384"} Jul 29 17:41:47.540114 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:47.540076 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4bqxx" event={"ID":"b668e312-b0fb-4676-bc39-86f7d08e5e97","Type":"ContainerStarted","Data":"461d3f51ef16ba210aaad51ea9c60789474fff3c3fa74ad26db3cc0cc546541b"} Jul 29 17:41:47.540507 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:47.540220 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4bqxx" Jul 29 17:41:47.561385 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:47.561303 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4bqxx" podStartSLOduration=1.343000994 podStartE2EDuration="3.561288742s" totalImagesPullingTime="2.218287748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:41:47.560811945 +0000 UTC m=+423.165683141" watchObservedRunningTime="2026-07-29 17:41:47.561288742 +0000 UTC m=+423.166159962" Jul 29 17:41:51.951108 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:51.951072 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k"] Jul 29 17:41:51.954380 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:51.954363 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:41:51.959074 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:51.959050 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fw8cp\"" Jul 29 17:41:51.971367 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:51.971335 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k"] Jul 29 17:41:52.131563 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:52.131520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc93366a-178b-4ec6-93ea-b3b41e5a22cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" (UID: \"bc93366a-178b-4ec6-93ea-b3b41e5a22cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:41:52.131754 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:52.131579 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8875k\" (UniqueName: \"kubernetes.io/projected/bc93366a-178b-4ec6-93ea-b3b41e5a22cf-kube-api-access-8875k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" (UID: \"bc93366a-178b-4ec6-93ea-b3b41e5a22cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:41:52.232871 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:52.232744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc93366a-178b-4ec6-93ea-b3b41e5a22cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" (UID: \"bc93366a-178b-4ec6-93ea-b3b41e5a22cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:41:52.232871 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:52.232843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8875k\" (UniqueName: \"kubernetes.io/projected/bc93366a-178b-4ec6-93ea-b3b41e5a22cf-kube-api-access-8875k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" (UID: \"bc93366a-178b-4ec6-93ea-b3b41e5a22cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:41:52.233199 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:52.233174 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc93366a-178b-4ec6-93ea-b3b41e5a22cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" (UID: \"bc93366a-178b-4ec6-93ea-b3b41e5a22cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:41:52.241474 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:52.241447 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8875k\" (UniqueName: \"kubernetes.io/projected/bc93366a-178b-4ec6-93ea-b3b41e5a22cf-kube-api-access-8875k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" (UID: \"bc93366a-178b-4ec6-93ea-b3b41e5a22cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:41:52.264633 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:52.264594 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:41:52.403173 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:52.402997 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k"] Jul 29 17:41:52.406191 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:41:52.406163 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc93366a_178b_4ec6_93ea_b3b41e5a22cf.slice/crio-d0df4b38915b36299f6e5145468b6685051f531245a2b1d346f7206440295ce7 WatchSource:0}: Error finding container d0df4b38915b36299f6e5145468b6685051f531245a2b1d346f7206440295ce7: Status 404 returned error can't find the container with id d0df4b38915b36299f6e5145468b6685051f531245a2b1d346f7206440295ce7 Jul 29 17:41:52.559483 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:52.559401 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" event={"ID":"bc93366a-178b-4ec6-93ea-b3b41e5a22cf","Type":"ContainerStarted","Data":"d0df4b38915b36299f6e5145468b6685051f531245a2b1d346f7206440295ce7"} Jul 29 17:41:58.546091 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:58.546058 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4bqxx" Jul 29 17:41:58.587021 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:58.586986 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" event={"ID":"bc93366a-178b-4ec6-93ea-b3b41e5a22cf","Type":"ContainerStarted","Data":"5b640d815c3f58f588455704e81892f35a7721501630d5a236f5cb5a6304a637"} Jul 29 17:41:58.587218 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:58.587073 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:41:58.609728 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:41:58.609671 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" podStartSLOduration=2.252419106 podStartE2EDuration="7.60965534s" totalImagesPullingTime="5.357236234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:41:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:41:58.60880578 +0000 UTC m=+434.213676941" watchObservedRunningTime="2026-07-29 17:41:58.60965534 +0000 UTC m=+434.214526501" Jul 29 17:42:09.593750 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:09.593647 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:42:10.716534 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:10.716496 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm"] Jul 29 17:42:10.719555 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:10.719537 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:10.735099 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:10.735070 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm"] Jul 29 17:42:10.783689 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:10.783651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfgrz\" (UniqueName: \"kubernetes.io/projected/3c9c20d7-c075-4860-bece-c9f54527c81c-kube-api-access-sfgrz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-45mgm\" (UID: \"3c9c20d7-c075-4860-bece-c9f54527c81c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:10.783689 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:10.783693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c9c20d7-c075-4860-bece-c9f54527c81c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-45mgm\" (UID: \"3c9c20d7-c075-4860-bece-c9f54527c81c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:10.884203 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:10.884164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfgrz\" (UniqueName: \"kubernetes.io/projected/3c9c20d7-c075-4860-bece-c9f54527c81c-kube-api-access-sfgrz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-45mgm\" (UID: \"3c9c20d7-c075-4860-bece-c9f54527c81c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:10.884203 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:10.884209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c9c20d7-c075-4860-bece-c9f54527c81c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-45mgm\" (UID: \"3c9c20d7-c075-4860-bece-c9f54527c81c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:10.884653 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:10.884633 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c9c20d7-c075-4860-bece-c9f54527c81c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-45mgm\" (UID: \"3c9c20d7-c075-4860-bece-c9f54527c81c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:10.892553 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:10.892525 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfgrz\" (UniqueName: \"kubernetes.io/projected/3c9c20d7-c075-4860-bece-c9f54527c81c-kube-api-access-sfgrz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-45mgm\" (UID: \"3c9c20d7-c075-4860-bece-c9f54527c81c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:11.030468 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.030372 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:11.170435 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.170409 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm"] Jul 29 17:42:11.172241 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:42:11.172213 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9c20d7_c075_4860_bece_c9f54527c81c.slice/crio-143f2b0443686660557ef629713db771cb637bb1973a044b0fd5ae13c2b98cd5 WatchSource:0}: Error finding container 143f2b0443686660557ef629713db771cb637bb1973a044b0fd5ae13c2b98cd5: Status 404 returned error can't find the container with id 143f2b0443686660557ef629713db771cb637bb1973a044b0fd5ae13c2b98cd5 Jul 29 17:42:11.367485 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.367400 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm"] Jul 29 17:42:11.371575 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.371543 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm"] Jul 29 17:42:11.384144 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.384111 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k"] Jul 29 17:42:11.384364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.384337 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" podUID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" containerName="manager" containerID="cri-o://5b640d815c3f58f588455704e81892f35a7721501630d5a236f5cb5a6304a637" gracePeriod=2 Jul 29 17:42:11.389998 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.389972 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw"] Jul 29 17:42:11.390325 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.390310 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9c20d7-c075-4860-bece-c9f54527c81c" containerName="manager" Jul 29 17:42:11.390407 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.390329 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9c20d7-c075-4860-bece-c9f54527c81c" containerName="manager" Jul 29 17:42:11.390407 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.390400 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c9c20d7-c075-4860-bece-c9f54527c81c" containerName="manager" Jul 29 17:42:11.394952 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.394918 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k"] Jul 29 17:42:11.395066 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.395045 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" Jul 29 17:42:11.408868 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:11.407177 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"bc93366a-178b-4ec6-93ea-b3b41e5a22cf\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\": pods \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:42:11.410073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.410045 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw"] Jul 29 17:42:11.410576 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:11.410547 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:42:11.417637 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.417603 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84"] Jul 29 17:42:11.418096 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.418074 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" containerName="manager" Jul 29 17:42:11.418096 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.418096 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" containerName="manager" Jul 29 17:42:11.418248 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.418159 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" containerName="manager" Jul 29 17:42:11.422839 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.422814 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" Jul 29 17:42:11.439814 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.439789 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84"] Jul 29 17:42:11.440952 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:11.440777 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:42:11.489102 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.489059 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa03880-966b-45a7-89fb-88b0092200af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2jp84\" (UID: \"eaa03880-966b-45a7-89fb-88b0092200af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" Jul 29 17:42:11.489291 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.489112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc6fd\" (UniqueName: \"kubernetes.io/projected/7886f97a-c0ec-4b07-a179-a82100cb78c5-kube-api-access-dc6fd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vfzsw\" (UID: \"7886f97a-c0ec-4b07-a179-a82100cb78c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" Jul 29 17:42:11.489291 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.489156 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7886f97a-c0ec-4b07-a179-a82100cb78c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vfzsw\" (UID: \"7886f97a-c0ec-4b07-a179-a82100cb78c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" Jul 29 17:42:11.489291 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.489195 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n595n\" (UniqueName: \"kubernetes.io/projected/eaa03880-966b-45a7-89fb-88b0092200af-kube-api-access-n595n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2jp84\" (UID: \"eaa03880-966b-45a7-89fb-88b0092200af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" Jul 29 17:42:11.590355 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.590313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa03880-966b-45a7-89fb-88b0092200af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2jp84\" (UID: \"eaa03880-966b-45a7-89fb-88b0092200af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" Jul 29 17:42:11.590541 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.590364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc6fd\" (UniqueName: \"kubernetes.io/projected/7886f97a-c0ec-4b07-a179-a82100cb78c5-kube-api-access-dc6fd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vfzsw\" (UID: \"7886f97a-c0ec-4b07-a179-a82100cb78c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" Jul 29 17:42:11.590541 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.590403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7886f97a-c0ec-4b07-a179-a82100cb78c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vfzsw\" (UID: \"7886f97a-c0ec-4b07-a179-a82100cb78c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" Jul 29 17:42:11.590541 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.590447 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n595n\" (UniqueName: \"kubernetes.io/projected/eaa03880-966b-45a7-89fb-88b0092200af-kube-api-access-n595n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2jp84\" (UID: \"eaa03880-966b-45a7-89fb-88b0092200af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" Jul 29 17:42:11.590792 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.590770 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa03880-966b-45a7-89fb-88b0092200af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2jp84\" (UID: \"eaa03880-966b-45a7-89fb-88b0092200af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" Jul 29 17:42:11.590895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.590870 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7886f97a-c0ec-4b07-a179-a82100cb78c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vfzsw\" (UID: \"7886f97a-c0ec-4b07-a179-a82100cb78c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" Jul 29 17:42:11.607617 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.607586 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n595n\" (UniqueName: \"kubernetes.io/projected/eaa03880-966b-45a7-89fb-88b0092200af-kube-api-access-n595n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2jp84\" (UID: \"eaa03880-966b-45a7-89fb-88b0092200af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" Jul 29 17:42:11.612148 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.612122 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc6fd\" (UniqueName: \"kubernetes.io/projected/7886f97a-c0ec-4b07-a179-a82100cb78c5-kube-api-access-dc6fd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vfzsw\" (UID: \"7886f97a-c0ec-4b07-a179-a82100cb78c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" Jul 29 17:42:11.622752 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.622680 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:42:11.625491 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:11.625463 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:42:11.637180 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.637150 2578 generic.go:356] "Generic (PLEG): container finished" podID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" containerID="5b640d815c3f58f588455704e81892f35a7721501630d5a236f5cb5a6304a637" exitCode=0 Jul 29 17:42:11.637342 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.637198 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:42:11.637342 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.637201 2578 scope.go:117] "RemoveContainer" containerID="5b640d815c3f58f588455704e81892f35a7721501630d5a236f5cb5a6304a637" Jul 29 17:42:11.639020 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:11.639005 2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" container="manager" Jul 29 17:42:11.639790 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:11.639767 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:42:11.642441 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:11.642416 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-45mgm\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="3c9c20d7-c075-4860-bece-c9f54527c81c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:11.644421 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:11.644400 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:42:11.645386 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.645370 2578 scope.go:117] "RemoveContainer" containerID="5b640d815c3f58f588455704e81892f35a7721501630d5a236f5cb5a6304a637" Jul 29 17:42:11.645637 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:11.645618 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b640d815c3f58f588455704e81892f35a7721501630d5a236f5cb5a6304a637\": container with ID starting with 5b640d815c3f58f588455704e81892f35a7721501630d5a236f5cb5a6304a637 not found: ID does not exist" containerID="5b640d815c3f58f588455704e81892f35a7721501630d5a236f5cb5a6304a637" Jul 29 17:42:11.645685 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.645644 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b640d815c3f58f588455704e81892f35a7721501630d5a236f5cb5a6304a637"} err="failed to get container status \"5b640d815c3f58f588455704e81892f35a7721501630d5a236f5cb5a6304a637\": rpc error: code = NotFound desc = could not find container \"5b640d815c3f58f588455704e81892f35a7721501630d5a236f5cb5a6304a637\": container with ID starting with 5b640d815c3f58f588455704e81892f35a7721501630d5a236f5cb5a6304a637 not found: ID does not exist" Jul 29 17:42:11.691560 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.691526 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc93366a-178b-4ec6-93ea-b3b41e5a22cf-extensions-socket-volume\") pod \"bc93366a-178b-4ec6-93ea-b3b41e5a22cf\" (UID: \"bc93366a-178b-4ec6-93ea-b3b41e5a22cf\") " Jul 29 17:42:11.691774 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.691621 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8875k\" (UniqueName: \"kubernetes.io/projected/bc93366a-178b-4ec6-93ea-b3b41e5a22cf-kube-api-access-8875k\") pod \"bc93366a-178b-4ec6-93ea-b3b41e5a22cf\" (UID: \"bc93366a-178b-4ec6-93ea-b3b41e5a22cf\") " Jul 29 17:42:11.692038 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.692015 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc93366a-178b-4ec6-93ea-b3b41e5a22cf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bc93366a-178b-4ec6-93ea-b3b41e5a22cf" (UID: "bc93366a-178b-4ec6-93ea-b3b41e5a22cf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:42:11.693581 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.693562 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc93366a-178b-4ec6-93ea-b3b41e5a22cf-kube-api-access-8875k" (OuterVolumeSpecName: "kube-api-access-8875k") pod "bc93366a-178b-4ec6-93ea-b3b41e5a22cf" (UID: "bc93366a-178b-4ec6-93ea-b3b41e5a22cf"). InnerVolumeSpecName "kube-api-access-8875k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:42:11.749491 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.749454 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" Jul 29 17:42:11.755445 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.755419 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" Jul 29 17:42:11.792411 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.792378 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8875k\" (UniqueName: \"kubernetes.io/projected/bc93366a-178b-4ec6-93ea-b3b41e5a22cf-kube-api-access-8875k\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:42:11.792411 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.792409 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc93366a-178b-4ec6-93ea-b3b41e5a22cf-extensions-socket-volume\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:42:11.893077 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.893051 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw"] Jul 29 17:42:11.895932 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:42:11.895903 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7886f97a_c0ec_4b07_a179_a82100cb78c5.slice/crio-93ef67e33d24c9a4aeb0711b27e9768b0355242f72afcfcf8ff40f9f5a38d19b WatchSource:0}: Error finding container 93ef67e33d24c9a4aeb0711b27e9768b0355242f72afcfcf8ff40f9f5a38d19b: Status 404 returned error can't find the container with id 93ef67e33d24c9a4aeb0711b27e9768b0355242f72afcfcf8ff40f9f5a38d19b Jul 29 17:42:11.913414 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:11.913385 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84"] Jul 29 17:42:11.916165 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:42:11.916134 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa03880_966b_45a7_89fb_88b0092200af.slice/crio-852b265ecbef04c6bcc864fbd0fb1cb8d633642a06a1a8c6044f28731e2947af WatchSource:0}: Error finding container 852b265ecbef04c6bcc864fbd0fb1cb8d633642a06a1a8c6044f28731e2947af: Status 404 returned error can't find the container with id 852b265ecbef04c6bcc864fbd0fb1cb8d633642a06a1a8c6044f28731e2947af Jul 29 17:42:11.962482 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:11.962438 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-45mgm\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="3c9c20d7-c075-4860-bece-c9f54527c81c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:11.964318 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:11.964272 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:42:12.645227 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.645187 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" event={"ID":"eaa03880-966b-45a7-89fb-88b0092200af","Type":"ContainerStarted","Data":"d992dd0a19eac813949705c1b66ce4a2662da80563f91f4a76a212f126303ab8"} Jul 29 17:42:12.645450 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.645282 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" Jul 29 17:42:12.645450 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.645302 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" event={"ID":"eaa03880-966b-45a7-89fb-88b0092200af","Type":"ContainerStarted","Data":"852b265ecbef04c6bcc864fbd0fb1cb8d633642a06a1a8c6044f28731e2947af"} Jul 29 17:42:12.646855 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.646826 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" podUID="3c9c20d7-c075-4860-bece-c9f54527c81c" containerName="manager" containerID="cri-o://2888b999ebb6bd33650e84b6effa0ea2f07071021911258ac0b8289e7547cdc4" gracePeriod=2 Jul 29 17:42:12.647395 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:12.647186 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:42:12.648373 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.648346 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" event={"ID":"7886f97a-c0ec-4b07-a179-a82100cb78c5","Type":"ContainerStarted","Data":"be311376a9c84cabe60f1f80c4741ea64fdee96feceda4d3f11e25b1320ac9bd"} Jul 29 17:42:12.648476 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.648399 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" event={"ID":"7886f97a-c0ec-4b07-a179-a82100cb78c5","Type":"ContainerStarted","Data":"93ef67e33d24c9a4aeb0711b27e9768b0355242f72afcfcf8ff40f9f5a38d19b"} Jul 29 17:42:12.648476 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.648447 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" Jul 29 17:42:12.664645 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.664591 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" podStartSLOduration=1.664575725 podStartE2EDuration="1.664575725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:42:12.664302782 +0000 UTC m=+448.269173946" watchObservedRunningTime="2026-07-29 17:42:12.664575725 +0000 UTC m=+448.269446887" Jul 29 17:42:12.666242 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:12.666210 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-45mgm\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="3c9c20d7-c075-4860-bece-c9f54527c81c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:12.667936 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:12.667914 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:42:12.687871 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:12.687829 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-45mgm\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="3c9c20d7-c075-4860-bece-c9f54527c81c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:12.877155 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.877130 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:12.879188 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:12.879157 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8ds4k\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ds4k" Jul 29 17:42:12.880880 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:12.880853 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-45mgm\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="3c9c20d7-c075-4860-bece-c9f54527c81c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:12.900163 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.900138 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c9c20d7-c075-4860-bece-c9f54527c81c-extensions-socket-volume\") pod \"3c9c20d7-c075-4860-bece-c9f54527c81c\" (UID: \"3c9c20d7-c075-4860-bece-c9f54527c81c\") " Jul 29 17:42:12.900256 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.900177 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfgrz\" (UniqueName: \"kubernetes.io/projected/3c9c20d7-c075-4860-bece-c9f54527c81c-kube-api-access-sfgrz\") pod \"3c9c20d7-c075-4860-bece-c9f54527c81c\" (UID: \"3c9c20d7-c075-4860-bece-c9f54527c81c\") " Jul 29 17:42:12.900394 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.900372 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9c20d7-c075-4860-bece-c9f54527c81c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3c9c20d7-c075-4860-bece-c9f54527c81c" (UID: "3c9c20d7-c075-4860-bece-c9f54527c81c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:42:12.902210 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.902186 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c9c20d7-c075-4860-bece-c9f54527c81c-kube-api-access-sfgrz" (OuterVolumeSpecName: "kube-api-access-sfgrz") pod "3c9c20d7-c075-4860-bece-c9f54527c81c" (UID: "3c9c20d7-c075-4860-bece-c9f54527c81c"). InnerVolumeSpecName "kube-api-access-sfgrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:42:12.942635 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.942598 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c9c20d7-c075-4860-bece-c9f54527c81c" path="/var/lib/kubelet/pods/3c9c20d7-c075-4860-bece-c9f54527c81c/volumes" Jul 29 17:42:12.942980 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:12.942966 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc93366a-178b-4ec6-93ea-b3b41e5a22cf" path="/var/lib/kubelet/pods/bc93366a-178b-4ec6-93ea-b3b41e5a22cf/volumes" Jul 29 17:42:13.001026 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:13.000989 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c9c20d7-c075-4860-bece-c9f54527c81c-extensions-socket-volume\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:42:13.001026 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:13.001018 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfgrz\" (UniqueName: \"kubernetes.io/projected/3c9c20d7-c075-4860-bece-c9f54527c81c-kube-api-access-sfgrz\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:42:13.653573 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:13.653540 2578 generic.go:356] "Generic (PLEG): container finished" podID="3c9c20d7-c075-4860-bece-c9f54527c81c" containerID="2888b999ebb6bd33650e84b6effa0ea2f07071021911258ac0b8289e7547cdc4" exitCode=2 Jul 29 17:42:13.653792 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:13.653584 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:13.653792 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:13.653644 2578 scope.go:117] "RemoveContainer" containerID="2888b999ebb6bd33650e84b6effa0ea2f07071021911258ac0b8289e7547cdc4" Jul 29 17:42:13.657819 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:13.657788 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-45mgm\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="3c9c20d7-c075-4860-bece-c9f54527c81c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:13.661421 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:13.661407 2578 scope.go:117] "RemoveContainer" containerID="2888b999ebb6bd33650e84b6effa0ea2f07071021911258ac0b8289e7547cdc4" Jul 29 17:42:13.661681 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:13.661663 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2888b999ebb6bd33650e84b6effa0ea2f07071021911258ac0b8289e7547cdc4\": container with ID starting with 2888b999ebb6bd33650e84b6effa0ea2f07071021911258ac0b8289e7547cdc4 not found: ID does not exist" containerID="2888b999ebb6bd33650e84b6effa0ea2f07071021911258ac0b8289e7547cdc4" Jul 29 17:42:13.661745 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:13.661688 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2888b999ebb6bd33650e84b6effa0ea2f07071021911258ac0b8289e7547cdc4"} err="failed to get container status \"2888b999ebb6bd33650e84b6effa0ea2f07071021911258ac0b8289e7547cdc4\": rpc error: code = NotFound desc = could not find container \"2888b999ebb6bd33650e84b6effa0ea2f07071021911258ac0b8289e7547cdc4\": container with ID starting with 2888b999ebb6bd33650e84b6effa0ea2f07071021911258ac0b8289e7547cdc4 not found: ID does not exist" Jul 29 17:42:14.941987 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:14.941956 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-45mgm\" is forbidden: User \"system:node:ip-10-0-131-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-247.ec2.internal' and this object" podUID="3c9c20d7-c075-4860-bece-c9f54527c81c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-45mgm" Jul 29 17:42:23.655770 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:23.655740 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" Jul 29 17:42:23.656150 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:23.655816 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" Jul 29 17:42:23.676160 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:23.676112 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" podStartSLOduration=12.676095521 podStartE2EDuration="12.676095521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:42:12.685866034 +0000 UTC m=+448.290737195" watchObservedRunningTime="2026-07-29 17:42:23.676095521 +0000 UTC m=+459.280966710" Jul 29 17:42:23.732705 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:23.732670 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84"] Jul 29 17:42:23.732946 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:23.732921 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" podUID="eaa03880-966b-45a7-89fb-88b0092200af" containerName="manager" containerID="cri-o://d992dd0a19eac813949705c1b66ce4a2662da80563f91f4a76a212f126303ab8" gracePeriod=10 Jul 29 17:42:23.983553 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:23.983525 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" Jul 29 17:42:24.089323 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.089286 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n595n\" (UniqueName: \"kubernetes.io/projected/eaa03880-966b-45a7-89fb-88b0092200af-kube-api-access-n595n\") pod \"eaa03880-966b-45a7-89fb-88b0092200af\" (UID: \"eaa03880-966b-45a7-89fb-88b0092200af\") " Jul 29 17:42:24.089528 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.089404 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa03880-966b-45a7-89fb-88b0092200af-extensions-socket-volume\") pod \"eaa03880-966b-45a7-89fb-88b0092200af\" (UID: \"eaa03880-966b-45a7-89fb-88b0092200af\") " Jul 29 17:42:24.089807 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.089778 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaa03880-966b-45a7-89fb-88b0092200af-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eaa03880-966b-45a7-89fb-88b0092200af" (UID: "eaa03880-966b-45a7-89fb-88b0092200af"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:42:24.091387 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.091363 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaa03880-966b-45a7-89fb-88b0092200af-kube-api-access-n595n" (OuterVolumeSpecName: "kube-api-access-n595n") pod "eaa03880-966b-45a7-89fb-88b0092200af" (UID: "eaa03880-966b-45a7-89fb-88b0092200af"). InnerVolumeSpecName "kube-api-access-n595n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:42:24.190682 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.190648 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa03880-966b-45a7-89fb-88b0092200af-extensions-socket-volume\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:42:24.190682 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.190676 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n595n\" (UniqueName: \"kubernetes.io/projected/eaa03880-966b-45a7-89fb-88b0092200af-kube-api-access-n595n\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:42:24.701495 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.701456 2578 generic.go:356] "Generic (PLEG): container finished" podID="eaa03880-966b-45a7-89fb-88b0092200af" containerID="d992dd0a19eac813949705c1b66ce4a2662da80563f91f4a76a212f126303ab8" exitCode=0 Jul 29 17:42:24.701941 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.701514 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" Jul 29 17:42:24.701941 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.701536 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" event={"ID":"eaa03880-966b-45a7-89fb-88b0092200af","Type":"ContainerDied","Data":"d992dd0a19eac813949705c1b66ce4a2662da80563f91f4a76a212f126303ab8"} Jul 29 17:42:24.701941 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.701607 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84" event={"ID":"eaa03880-966b-45a7-89fb-88b0092200af","Type":"ContainerDied","Data":"852b265ecbef04c6bcc864fbd0fb1cb8d633642a06a1a8c6044f28731e2947af"} Jul 29 17:42:24.701941 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.701628 2578 scope.go:117] "RemoveContainer" containerID="d992dd0a19eac813949705c1b66ce4a2662da80563f91f4a76a212f126303ab8" Jul 29 17:42:24.710229 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.710211 2578 scope.go:117] "RemoveContainer" containerID="d992dd0a19eac813949705c1b66ce4a2662da80563f91f4a76a212f126303ab8" Jul 29 17:42:24.710496 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:24.710479 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d992dd0a19eac813949705c1b66ce4a2662da80563f91f4a76a212f126303ab8\": container with ID starting with d992dd0a19eac813949705c1b66ce4a2662da80563f91f4a76a212f126303ab8 not found: ID does not exist" containerID="d992dd0a19eac813949705c1b66ce4a2662da80563f91f4a76a212f126303ab8" Jul 29 17:42:24.710542 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.710507 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d992dd0a19eac813949705c1b66ce4a2662da80563f91f4a76a212f126303ab8"} err="failed to get container status \"d992dd0a19eac813949705c1b66ce4a2662da80563f91f4a76a212f126303ab8\": rpc error: code = NotFound desc = could not find container \"d992dd0a19eac813949705c1b66ce4a2662da80563f91f4a76a212f126303ab8\": container with ID starting with d992dd0a19eac813949705c1b66ce4a2662da80563f91f4a76a212f126303ab8 not found: ID does not exist" Jul 29 17:42:24.722433 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.722406 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84"] Jul 29 17:42:24.728833 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.728810 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2jp84"] Jul 29 17:42:24.942789 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:24.942752 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaa03880-966b-45a7-89fb-88b0092200af" path="/var/lib/kubelet/pods/eaa03880-966b-45a7-89fb-88b0092200af/volumes" Jul 29 17:42:40.091854 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.091818 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4"] Jul 29 17:42:40.092294 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.092082 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaa03880-966b-45a7-89fb-88b0092200af" containerName="manager" Jul 29 17:42:40.092294 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.092093 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaa03880-966b-45a7-89fb-88b0092200af" containerName="manager" Jul 29 17:42:40.092294 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.092150 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaa03880-966b-45a7-89fb-88b0092200af" containerName="manager" Jul 29 17:42:40.094058 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.094034 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.096940 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.096914 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5bzqc\"" Jul 29 17:42:40.101572 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.101543 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4"] Jul 29 17:42:40.228287 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.228254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.228513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.228305 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.228513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.228339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq2cn\" (UniqueName: \"kubernetes.io/projected/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-kube-api-access-lq2cn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.228513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.228363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.228513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.228382 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.228513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.228416 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.228513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.228450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.228513 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.228480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.228809 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.228582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.260233 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.260201 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw"] Jul 29 17:42:40.260463 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.260425 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" podUID="7886f97a-c0ec-4b07-a179-a82100cb78c5" containerName="manager" containerID="cri-o://be311376a9c84cabe60f1f80c4741ea64fdee96feceda4d3f11e25b1320ac9bd" gracePeriod=10 Jul 29 17:42:40.329840 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.329798 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.330056 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.329869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.330056 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.329904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.330056 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.329934 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq2cn\" (UniqueName: \"kubernetes.io/projected/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-kube-api-access-lq2cn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.330056 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.329962 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.330337 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.330084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.330337 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.330131 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.330337 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.330170 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.330337 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.330201 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.330535 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.330424 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.330797 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.330773 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.330907 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.330846 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.330907 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.330854 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.331022 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.330992 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.334752 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.332705 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.334752 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.332925 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.342047 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.341985 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.342408 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.342381 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq2cn\" (UniqueName: \"kubernetes.io/projected/c3328ef8-221c-4a8a-bfe8-a7711ea25a7d-kube-api-access-lq2cn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-52cm4\" (UID: \"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.405928 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.405893 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:40.523605 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.523577 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" Jul 29 17:42:40.549088 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.549063 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4"] Jul 29 17:42:40.551627 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:42:40.551601 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3328ef8_221c_4a8a_bfe8_a7711ea25a7d.slice/crio-51ca1bafbd8a178770138f39ad7539d04148c347698e558044f6d1b62d3cc424 WatchSource:0}: Error finding container 51ca1bafbd8a178770138f39ad7539d04148c347698e558044f6d1b62d3cc424: Status 404 returned error can't find the container with id 51ca1bafbd8a178770138f39ad7539d04148c347698e558044f6d1b62d3cc424 Jul 29 17:42:40.553807 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.553767 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 29 17:42:40.553905 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.553846 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 29 17:42:40.553905 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.553892 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 29 17:42:40.632663 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.632633 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc6fd\" (UniqueName: \"kubernetes.io/projected/7886f97a-c0ec-4b07-a179-a82100cb78c5-kube-api-access-dc6fd\") pod \"7886f97a-c0ec-4b07-a179-a82100cb78c5\" (UID: \"7886f97a-c0ec-4b07-a179-a82100cb78c5\") " Jul 29 17:42:40.632833 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.632729 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7886f97a-c0ec-4b07-a179-a82100cb78c5-extensions-socket-volume\") pod \"7886f97a-c0ec-4b07-a179-a82100cb78c5\" (UID: \"7886f97a-c0ec-4b07-a179-a82100cb78c5\") " Jul 29 17:42:40.633119 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.633097 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7886f97a-c0ec-4b07-a179-a82100cb78c5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7886f97a-c0ec-4b07-a179-a82100cb78c5" (UID: "7886f97a-c0ec-4b07-a179-a82100cb78c5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:42:40.634780 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.634747 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7886f97a-c0ec-4b07-a179-a82100cb78c5-kube-api-access-dc6fd" (OuterVolumeSpecName: "kube-api-access-dc6fd") pod "7886f97a-c0ec-4b07-a179-a82100cb78c5" (UID: "7886f97a-c0ec-4b07-a179-a82100cb78c5"). InnerVolumeSpecName "kube-api-access-dc6fd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:42:40.733522 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.733487 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc6fd\" (UniqueName: \"kubernetes.io/projected/7886f97a-c0ec-4b07-a179-a82100cb78c5-kube-api-access-dc6fd\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:42:40.733522 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.733517 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7886f97a-c0ec-4b07-a179-a82100cb78c5-extensions-socket-volume\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:42:40.769255 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.769218 2578 generic.go:356] "Generic (PLEG): container finished" podID="7886f97a-c0ec-4b07-a179-a82100cb78c5" containerID="be311376a9c84cabe60f1f80c4741ea64fdee96feceda4d3f11e25b1320ac9bd" exitCode=0 Jul 29 17:42:40.769413 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.769264 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" Jul 29 17:42:40.769413 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.769298 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" event={"ID":"7886f97a-c0ec-4b07-a179-a82100cb78c5","Type":"ContainerDied","Data":"be311376a9c84cabe60f1f80c4741ea64fdee96feceda4d3f11e25b1320ac9bd"} Jul 29 17:42:40.769413 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.769364 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw" event={"ID":"7886f97a-c0ec-4b07-a179-a82100cb78c5","Type":"ContainerDied","Data":"93ef67e33d24c9a4aeb0711b27e9768b0355242f72afcfcf8ff40f9f5a38d19b"} Jul 29 17:42:40.769413 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.769393 2578 scope.go:117] "RemoveContainer" containerID="be311376a9c84cabe60f1f80c4741ea64fdee96feceda4d3f11e25b1320ac9bd" Jul 29 17:42:40.771132 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.771090 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" event={"ID":"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d","Type":"ContainerStarted","Data":"7e59c43a86ef30f2f5ad5af0ef309d872c79beb783140b9568eab5faa4b6436b"} Jul 29 17:42:40.771261 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.771138 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" event={"ID":"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d","Type":"ContainerStarted","Data":"51ca1bafbd8a178770138f39ad7539d04148c347698e558044f6d1b62d3cc424"} Jul 29 17:42:40.778880 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.778862 2578 scope.go:117] "RemoveContainer" containerID="be311376a9c84cabe60f1f80c4741ea64fdee96feceda4d3f11e25b1320ac9bd" Jul 29 17:42:40.779159 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:42:40.779141 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be311376a9c84cabe60f1f80c4741ea64fdee96feceda4d3f11e25b1320ac9bd\": container with ID starting with be311376a9c84cabe60f1f80c4741ea64fdee96feceda4d3f11e25b1320ac9bd not found: ID does not exist" containerID="be311376a9c84cabe60f1f80c4741ea64fdee96feceda4d3f11e25b1320ac9bd" Jul 29 17:42:40.779224 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.779165 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be311376a9c84cabe60f1f80c4741ea64fdee96feceda4d3f11e25b1320ac9bd"} err="failed to get container status \"be311376a9c84cabe60f1f80c4741ea64fdee96feceda4d3f11e25b1320ac9bd\": rpc error: code = NotFound desc = could not find container \"be311376a9c84cabe60f1f80c4741ea64fdee96feceda4d3f11e25b1320ac9bd\": container with ID starting with be311376a9c84cabe60f1f80c4741ea64fdee96feceda4d3f11e25b1320ac9bd not found: ID does not exist" Jul 29 17:42:40.792198 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.792143 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" podStartSLOduration=0.792126155 podStartE2EDuration="792.126155ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:42:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:42:40.790614819 +0000 UTC m=+476.395485981" watchObservedRunningTime="2026-07-29 17:42:40.792126155 +0000 UTC m=+476.396997315" Jul 29 17:42:40.804733 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.804695 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw"] Jul 29 17:42:40.810819 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.810793 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vfzsw"] Jul 29 17:42:40.942562 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:40.942527 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7886f97a-c0ec-4b07-a179-a82100cb78c5" path="/var/lib/kubelet/pods/7886f97a-c0ec-4b07-a179-a82100cb78c5/volumes" Jul 29 17:42:41.406489 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:41.406457 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:41.411022 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:41.410997 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:41.776608 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:41.776579 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:41.777523 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:41.777506 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:42:58.436055 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.436020 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9574c"] Jul 29 17:42:58.436555 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.436302 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7886f97a-c0ec-4b07-a179-a82100cb78c5" containerName="manager" Jul 29 17:42:58.436555 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.436313 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7886f97a-c0ec-4b07-a179-a82100cb78c5" containerName="manager" Jul 29 17:42:58.436555 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.436360 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7886f97a-c0ec-4b07-a179-a82100cb78c5" containerName="manager" Jul 29 17:42:58.439321 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.439295 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" Jul 29 17:42:58.441699 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.441667 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vxxdv\"" Jul 29 17:42:58.441699 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.441669 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 29 17:42:58.448412 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.448387 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9574c"] Jul 29 17:42:58.476502 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.476465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc9b6228-a4da-4ce7-8de5-b4271e47427d-config-file\") pod \"limitador-limitador-64c94fd64f-9574c\" (UID: \"fc9b6228-a4da-4ce7-8de5-b4271e47427d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" Jul 29 17:42:58.476679 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.476518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hpfr\" (UniqueName: \"kubernetes.io/projected/fc9b6228-a4da-4ce7-8de5-b4271e47427d-kube-api-access-4hpfr\") pod \"limitador-limitador-64c94fd64f-9574c\" (UID: \"fc9b6228-a4da-4ce7-8de5-b4271e47427d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" Jul 29 17:42:58.530054 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.530017 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9574c"] Jul 29 17:42:58.577643 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.577603 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hpfr\" (UniqueName: \"kubernetes.io/projected/fc9b6228-a4da-4ce7-8de5-b4271e47427d-kube-api-access-4hpfr\") pod \"limitador-limitador-64c94fd64f-9574c\" (UID: \"fc9b6228-a4da-4ce7-8de5-b4271e47427d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" Jul 29 17:42:58.577849 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.577668 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc9b6228-a4da-4ce7-8de5-b4271e47427d-config-file\") pod \"limitador-limitador-64c94fd64f-9574c\" (UID: \"fc9b6228-a4da-4ce7-8de5-b4271e47427d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" Jul 29 17:42:58.578255 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.578235 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc9b6228-a4da-4ce7-8de5-b4271e47427d-config-file\") pod \"limitador-limitador-64c94fd64f-9574c\" (UID: \"fc9b6228-a4da-4ce7-8de5-b4271e47427d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" Jul 29 17:42:58.585694 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.585670 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hpfr\" (UniqueName: \"kubernetes.io/projected/fc9b6228-a4da-4ce7-8de5-b4271e47427d-kube-api-access-4hpfr\") pod \"limitador-limitador-64c94fd64f-9574c\" (UID: \"fc9b6228-a4da-4ce7-8de5-b4271e47427d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" Jul 29 17:42:58.749988 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.749893 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" Jul 29 17:42:58.883321 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:58.883292 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9574c"] Jul 29 17:42:58.886157 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:42:58.886128 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9b6228_a4da_4ce7_8de5_b4271e47427d.slice/crio-21a673e082ac97a9a2f5345f66199cd45f49445a55a545812ba6a183ee4cc769 WatchSource:0}: Error finding container 21a673e082ac97a9a2f5345f66199cd45f49445a55a545812ba6a183ee4cc769: Status 404 returned error can't find the container with id 21a673e082ac97a9a2f5345f66199cd45f49445a55a545812ba6a183ee4cc769 Jul 29 17:42:59.853525 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:42:59.853447 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" event={"ID":"fc9b6228-a4da-4ce7-8de5-b4271e47427d","Type":"ContainerStarted","Data":"21a673e082ac97a9a2f5345f66199cd45f49445a55a545812ba6a183ee4cc769"} Jul 29 17:43:01.863976 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:01.863940 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" event={"ID":"fc9b6228-a4da-4ce7-8de5-b4271e47427d","Type":"ContainerStarted","Data":"5a0b282e499b2e43f96e83ff1e60d50f2c1f230930fa7442652629eb6c92b885"} Jul 29 17:43:01.864363 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:01.864087 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" Jul 29 17:43:01.881389 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:01.881333 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" podStartSLOduration=1.111230101 podStartE2EDuration="3.881317959s" totalImagesPullingTime="2.770087858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:43:01.879530517 +0000 UTC m=+497.484401677" watchObservedRunningTime="2026-07-29 17:43:01.881317959 +0000 UTC m=+497.486189120" Jul 29 17:43:12.868903 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:12.868870 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" Jul 29 17:43:14.425017 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:14.424985 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9574c"] Jul 29 17:43:14.425431 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:14.425165 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" podUID="fc9b6228-a4da-4ce7-8de5-b4271e47427d" containerName="limitador" containerID="cri-o://5a0b282e499b2e43f96e83ff1e60d50f2c1f230930fa7442652629eb6c92b885" gracePeriod=30 Jul 29 17:43:14.917202 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:14.917166 2578 generic.go:356] "Generic (PLEG): container finished" podID="fc9b6228-a4da-4ce7-8de5-b4271e47427d" containerID="5a0b282e499b2e43f96e83ff1e60d50f2c1f230930fa7442652629eb6c92b885" exitCode=0 Jul 29 17:43:14.917367 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:14.917241 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" event={"ID":"fc9b6228-a4da-4ce7-8de5-b4271e47427d","Type":"ContainerDied","Data":"5a0b282e499b2e43f96e83ff1e60d50f2c1f230930fa7442652629eb6c92b885"} Jul 29 17:43:15.368307 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:15.368276 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" Jul 29 17:43:15.392096 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:15.392068 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc9b6228-a4da-4ce7-8de5-b4271e47427d-config-file\") pod \"fc9b6228-a4da-4ce7-8de5-b4271e47427d\" (UID: \"fc9b6228-a4da-4ce7-8de5-b4271e47427d\") " Jul 29 17:43:15.392314 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:15.392117 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hpfr\" (UniqueName: \"kubernetes.io/projected/fc9b6228-a4da-4ce7-8de5-b4271e47427d-kube-api-access-4hpfr\") pod \"fc9b6228-a4da-4ce7-8de5-b4271e47427d\" (UID: \"fc9b6228-a4da-4ce7-8de5-b4271e47427d\") " Jul 29 17:43:15.392483 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:15.392448 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc9b6228-a4da-4ce7-8de5-b4271e47427d-config-file" (OuterVolumeSpecName: "config-file") pod "fc9b6228-a4da-4ce7-8de5-b4271e47427d" (UID: "fc9b6228-a4da-4ce7-8de5-b4271e47427d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:43:15.394165 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:15.394138 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc9b6228-a4da-4ce7-8de5-b4271e47427d-kube-api-access-4hpfr" (OuterVolumeSpecName: "kube-api-access-4hpfr") pod "fc9b6228-a4da-4ce7-8de5-b4271e47427d" (UID: "fc9b6228-a4da-4ce7-8de5-b4271e47427d"). InnerVolumeSpecName "kube-api-access-4hpfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:43:15.493705 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:15.493615 2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc9b6228-a4da-4ce7-8de5-b4271e47427d-config-file\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:43:15.493705 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:15.493660 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hpfr\" (UniqueName: \"kubernetes.io/projected/fc9b6228-a4da-4ce7-8de5-b4271e47427d-kube-api-access-4hpfr\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:43:15.922628 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:15.922594 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" event={"ID":"fc9b6228-a4da-4ce7-8de5-b4271e47427d","Type":"ContainerDied","Data":"21a673e082ac97a9a2f5345f66199cd45f49445a55a545812ba6a183ee4cc769"} Jul 29 17:43:15.922628 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:15.922610 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9574c" Jul 29 17:43:15.922896 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:15.922660 2578 scope.go:117] "RemoveContainer" containerID="5a0b282e499b2e43f96e83ff1e60d50f2c1f230930fa7442652629eb6c92b885" Jul 29 17:43:15.943225 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:15.943201 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9574c"] Jul 29 17:43:15.946595 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:15.946570 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9574c"] Jul 29 17:43:16.946957 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:16.946925 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc9b6228-a4da-4ce7-8de5-b4271e47427d" path="/var/lib/kubelet/pods/fc9b6228-a4da-4ce7-8de5-b4271e47427d/volumes" Jul 29 17:43:18.881662 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:18.881606 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4"] Jul 29 17:43:18.882045 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:18.881920 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc9b6228-a4da-4ce7-8de5-b4271e47427d" containerName="limitador" Jul 29 17:43:18.882045 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:18.881932 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc9b6228-a4da-4ce7-8de5-b4271e47427d" containerName="limitador" Jul 29 17:43:18.882045 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:18.881979 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc9b6228-a4da-4ce7-8de5-b4271e47427d" containerName="limitador" Jul 29 17:43:18.886228 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:18.886208 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4" Jul 29 17:43:18.888608 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:18.888581 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 29 17:43:18.888791 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:18.888640 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 29 17:43:18.888875 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:18.888821 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 29 17:43:18.889575 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:18.889561 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rghrh\"" Jul 29 17:43:18.893181 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:18.893158 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4"] Jul 29 17:43:18.920108 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:18.920069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/916d54b9-4baa-4188-b7c9-0182b54348ba-data\") pod \"postgres-69fb4594cf-5vtj4\" (UID: \"916d54b9-4baa-4188-b7c9-0182b54348ba\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4" Jul 29 17:43:18.920284 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:18.920130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk487\" (UniqueName: \"kubernetes.io/projected/916d54b9-4baa-4188-b7c9-0182b54348ba-kube-api-access-pk487\") pod \"postgres-69fb4594cf-5vtj4\" (UID: \"916d54b9-4baa-4188-b7c9-0182b54348ba\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4" Jul 29 17:43:19.020963 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:19.020918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk487\" (UniqueName: \"kubernetes.io/projected/916d54b9-4baa-4188-b7c9-0182b54348ba-kube-api-access-pk487\") pod \"postgres-69fb4594cf-5vtj4\" (UID: \"916d54b9-4baa-4188-b7c9-0182b54348ba\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4" Jul 29 17:43:19.021146 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:19.021023 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/916d54b9-4baa-4188-b7c9-0182b54348ba-data\") pod \"postgres-69fb4594cf-5vtj4\" (UID: \"916d54b9-4baa-4188-b7c9-0182b54348ba\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4" Jul 29 17:43:19.021456 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:19.021437 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/916d54b9-4baa-4188-b7c9-0182b54348ba-data\") pod \"postgres-69fb4594cf-5vtj4\" (UID: \"916d54b9-4baa-4188-b7c9-0182b54348ba\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4" Jul 29 17:43:19.029482 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:19.029452 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk487\" (UniqueName: \"kubernetes.io/projected/916d54b9-4baa-4188-b7c9-0182b54348ba-kube-api-access-pk487\") pod \"postgres-69fb4594cf-5vtj4\" (UID: \"916d54b9-4baa-4188-b7c9-0182b54348ba\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4" Jul 29 17:43:19.197883 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:19.197848 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4" Jul 29 17:43:19.326365 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:19.326328 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4"] Jul 29 17:43:19.329105 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:43:19.329077 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916d54b9_4baa_4188_b7c9_0182b54348ba.slice/crio-fb2888bf8cfdc81e0b7d7da8670bbff3222281809ae13c716b9299b910b0c84a WatchSource:0}: Error finding container fb2888bf8cfdc81e0b7d7da8670bbff3222281809ae13c716b9299b910b0c84a: Status 404 returned error can't find the container with id fb2888bf8cfdc81e0b7d7da8670bbff3222281809ae13c716b9299b910b0c84a Jul 29 17:43:19.939891 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:19.939855 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4" event={"ID":"916d54b9-4baa-4188-b7c9-0182b54348ba","Type":"ContainerStarted","Data":"fb2888bf8cfdc81e0b7d7da8670bbff3222281809ae13c716b9299b910b0c84a"} Jul 29 17:43:25.966131 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:25.966091 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4" event={"ID":"916d54b9-4baa-4188-b7c9-0182b54348ba","Type":"ContainerStarted","Data":"6bd93479affc701dce20b2d74947be64791cf53bf4a7ddeb7df29bbdfe5f51ca"} Jul 29 17:43:25.966507 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:25.966222 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4" Jul 29 17:43:25.982654 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:25.982599 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4" podStartSLOduration=1.9820893320000001 podStartE2EDuration="7.982583287s" totalImagesPullingTime="6.000493955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:43:25.982013681 +0000 UTC m=+521.586884841" watchObservedRunningTime="2026-07-29 17:43:25.982583287 +0000 UTC m=+521.587454447" Jul 29 17:43:31.998106 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:31.998075 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5vtj4" Jul 29 17:43:32.562396 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:32.562359 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9rk4"] Jul 29 17:43:32.565169 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:32.565145 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x9rk4" Jul 29 17:43:32.567436 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:32.567415 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r6spp\"" Jul 29 17:43:32.573093 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:32.573069 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9rk4"] Jul 29 17:43:32.631090 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:32.631053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phg69\" (UniqueName: \"kubernetes.io/projected/64981edf-c21d-473b-94c1-29684a366705-kube-api-access-phg69\") pod \"authorino-5d4b67c446-x9rk4\" (UID: \"64981edf-c21d-473b-94c1-29684a366705\") " pod="kuadrant-system/authorino-5d4b67c446-x9rk4" Jul 29 17:43:32.732153 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:32.732115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phg69\" (UniqueName: \"kubernetes.io/projected/64981edf-c21d-473b-94c1-29684a366705-kube-api-access-phg69\") pod \"authorino-5d4b67c446-x9rk4\" (UID: \"64981edf-c21d-473b-94c1-29684a366705\") " pod="kuadrant-system/authorino-5d4b67c446-x9rk4" Jul 29 17:43:32.739918 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:32.739887 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phg69\" (UniqueName: \"kubernetes.io/projected/64981edf-c21d-473b-94c1-29684a366705-kube-api-access-phg69\") pod \"authorino-5d4b67c446-x9rk4\" (UID: \"64981edf-c21d-473b-94c1-29684a366705\") " pod="kuadrant-system/authorino-5d4b67c446-x9rk4" Jul 29 17:43:32.804962 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:32.804926 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9rk4"] Jul 29 17:43:32.805164 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:32.805153 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x9rk4" Jul 29 17:43:32.932076 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:32.932036 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9rk4"] Jul 29 17:43:32.934821 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:43:32.934787 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64981edf_c21d_473b_94c1_29684a366705.slice/crio-9df89384950337a2bcdbf8b8b9207bec1f21f9c6ed4db0dfcf1bf39452bdf42d WatchSource:0}: Error finding container 9df89384950337a2bcdbf8b8b9207bec1f21f9c6ed4db0dfcf1bf39452bdf42d: Status 404 returned error can't find the container with id 9df89384950337a2bcdbf8b8b9207bec1f21f9c6ed4db0dfcf1bf39452bdf42d Jul 29 17:43:32.997467 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:32.997431 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x9rk4" event={"ID":"64981edf-c21d-473b-94c1-29684a366705","Type":"ContainerStarted","Data":"9df89384950337a2bcdbf8b8b9207bec1f21f9c6ed4db0dfcf1bf39452bdf42d"} Jul 29 17:43:36.015169 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:36.015139 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x9rk4" event={"ID":"64981edf-c21d-473b-94c1-29684a366705","Type":"ContainerStarted","Data":"599f522512dd2f3444af303430250da7747daa1fb4f718a228df28145bf55125"} Jul 29 17:43:36.015626 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:36.015250 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-x9rk4" podUID="64981edf-c21d-473b-94c1-29684a366705" containerName="authorino" containerID="cri-o://599f522512dd2f3444af303430250da7747daa1fb4f718a228df28145bf55125" gracePeriod=30 Jul 29 17:43:36.029534 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:36.029491 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-x9rk4" podStartSLOduration=1.168064871 podStartE2EDuration="4.02947501s" totalImagesPullingTime="2.861410139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:43:36.028449264 +0000 UTC m=+531.633320426" watchObservedRunningTime="2026-07-29 17:43:36.02947501 +0000 UTC m=+531.634346170" Jul 29 17:43:36.256732 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:36.256693 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x9rk4" Jul 29 17:43:36.364746 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:36.364680 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phg69\" (UniqueName: \"kubernetes.io/projected/64981edf-c21d-473b-94c1-29684a366705-kube-api-access-phg69\") pod \"64981edf-c21d-473b-94c1-29684a366705\" (UID: \"64981edf-c21d-473b-94c1-29684a366705\") " Jul 29 17:43:36.366791 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:36.366759 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64981edf-c21d-473b-94c1-29684a366705-kube-api-access-phg69" (OuterVolumeSpecName: "kube-api-access-phg69") pod "64981edf-c21d-473b-94c1-29684a366705" (UID: "64981edf-c21d-473b-94c1-29684a366705"). InnerVolumeSpecName "kube-api-access-phg69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:43:36.465429 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:36.465386 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phg69\" (UniqueName: \"kubernetes.io/projected/64981edf-c21d-473b-94c1-29684a366705-kube-api-access-phg69\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:43:37.020608 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:37.020577 2578 generic.go:356] "Generic (PLEG): container finished" podID="64981edf-c21d-473b-94c1-29684a366705" containerID="599f522512dd2f3444af303430250da7747daa1fb4f718a228df28145bf55125" exitCode=0 Jul 29 17:43:37.021060 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:37.020621 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x9rk4" Jul 29 17:43:37.021060 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:37.020696 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x9rk4" event={"ID":"64981edf-c21d-473b-94c1-29684a366705","Type":"ContainerDied","Data":"599f522512dd2f3444af303430250da7747daa1fb4f718a228df28145bf55125"} Jul 29 17:43:37.021060 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:37.020750 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x9rk4" event={"ID":"64981edf-c21d-473b-94c1-29684a366705","Type":"ContainerDied","Data":"9df89384950337a2bcdbf8b8b9207bec1f21f9c6ed4db0dfcf1bf39452bdf42d"} Jul 29 17:43:37.021060 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:37.020769 2578 scope.go:117] "RemoveContainer" containerID="599f522512dd2f3444af303430250da7747daa1fb4f718a228df28145bf55125" Jul 29 17:43:37.028637 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:37.028615 2578 scope.go:117] "RemoveContainer" containerID="599f522512dd2f3444af303430250da7747daa1fb4f718a228df28145bf55125" Jul 29 17:43:37.028989 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:43:37.028971 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"599f522512dd2f3444af303430250da7747daa1fb4f718a228df28145bf55125\": container with ID starting with 599f522512dd2f3444af303430250da7747daa1fb4f718a228df28145bf55125 not found: ID does not exist" containerID="599f522512dd2f3444af303430250da7747daa1fb4f718a228df28145bf55125" Jul 29 17:43:37.029056 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:37.028999 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"599f522512dd2f3444af303430250da7747daa1fb4f718a228df28145bf55125"} err="failed to get container status \"599f522512dd2f3444af303430250da7747daa1fb4f718a228df28145bf55125\": rpc error: code = NotFound desc = could not find container \"599f522512dd2f3444af303430250da7747daa1fb4f718a228df28145bf55125\": container with ID starting with 599f522512dd2f3444af303430250da7747daa1fb4f718a228df28145bf55125 not found: ID does not exist" Jul 29 17:43:37.035693 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:37.035667 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9rk4"] Jul 29 17:43:37.039257 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:37.039236 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9rk4"] Jul 29 17:43:38.942888 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:38.942857 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64981edf-c21d-473b-94c1-29684a366705" path="/var/lib/kubelet/pods/64981edf-c21d-473b-94c1-29684a366705/volumes" Jul 29 17:43:38.976730 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:38.976665 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-788bdc9f67-5xdnl"] Jul 29 17:43:38.977054 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:38.977029 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64981edf-c21d-473b-94c1-29684a366705" containerName="authorino" Jul 29 17:43:38.977054 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:38.977049 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64981edf-c21d-473b-94c1-29684a366705" containerName="authorino" Jul 29 17:43:38.977234 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:38.977112 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="64981edf-c21d-473b-94c1-29684a366705" containerName="authorino" Jul 29 17:43:38.979006 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:38.978984 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-788bdc9f67-5xdnl" Jul 29 17:43:38.981568 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:38.981544 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bns65\"" Jul 29 17:43:38.981781 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:38.981767 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 29 17:43:38.982194 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:38.982180 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 29 17:43:38.993294 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:38.993274 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-788bdc9f67-5xdnl"] Jul 29 17:43:39.086013 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.085973 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-webhook-cert\") pod \"maas-controller-788bdc9f67-5xdnl\" (UID: \"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3\") " pod="opendatahub/maas-controller-788bdc9f67-5xdnl" Jul 29 17:43:39.086209 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.086031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsb6g\" (UniqueName: \"kubernetes.io/projected/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-kube-api-access-qsb6g\") pod \"maas-controller-788bdc9f67-5xdnl\" (UID: \"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3\") " pod="opendatahub/maas-controller-788bdc9f67-5xdnl" Jul 29 17:43:39.138671 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.138635 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68f6858cb9-52s5l"] Jul 29 17:43:39.141303 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.141280 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68f6858cb9-52s5l" Jul 29 17:43:39.155959 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.155916 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68f6858cb9-52s5l"] Jul 29 17:43:39.186575 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.186542 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1cffe66-94e1-4fa6-847f-c353c4a6fa97-webhook-cert\") pod \"maas-controller-68f6858cb9-52s5l\" (UID: \"d1cffe66-94e1-4fa6-847f-c353c4a6fa97\") " pod="opendatahub/maas-controller-68f6858cb9-52s5l" Jul 29 17:43:39.186575 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.186588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsb6g\" (UniqueName: \"kubernetes.io/projected/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-kube-api-access-qsb6g\") pod \"maas-controller-788bdc9f67-5xdnl\" (UID: \"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3\") " pod="opendatahub/maas-controller-788bdc9f67-5xdnl" Jul 29 17:43:39.186847 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.186650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47dd9\" (UniqueName: \"kubernetes.io/projected/d1cffe66-94e1-4fa6-847f-c353c4a6fa97-kube-api-access-47dd9\") pod \"maas-controller-68f6858cb9-52s5l\" (UID: \"d1cffe66-94e1-4fa6-847f-c353c4a6fa97\") " pod="opendatahub/maas-controller-68f6858cb9-52s5l" Jul 29 17:43:39.186847 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.186756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-webhook-cert\") pod \"maas-controller-788bdc9f67-5xdnl\" (UID: \"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3\") " pod="opendatahub/maas-controller-788bdc9f67-5xdnl" Jul 29 17:43:39.186930 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:43:39.186871 2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 29 17:43:39.186968 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:43:39.186933 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-webhook-cert podName:f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3 nodeName:}" failed. No retries permitted until 2026-07-29 17:43:39.686916652 +0000 UTC m=+535.291787791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-webhook-cert") pod "maas-controller-788bdc9f67-5xdnl" (UID: "f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3") : secret "maas-controller-webhook-cert" not found Jul 29 17:43:39.197818 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.197736 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsb6g\" (UniqueName: \"kubernetes.io/projected/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-kube-api-access-qsb6g\") pod \"maas-controller-788bdc9f67-5xdnl\" (UID: \"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3\") " pod="opendatahub/maas-controller-788bdc9f67-5xdnl" Jul 29 17:43:39.287560 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.287515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1cffe66-94e1-4fa6-847f-c353c4a6fa97-webhook-cert\") pod \"maas-controller-68f6858cb9-52s5l\" (UID: \"d1cffe66-94e1-4fa6-847f-c353c4a6fa97\") " pod="opendatahub/maas-controller-68f6858cb9-52s5l" Jul 29 17:43:39.287793 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.287584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47dd9\" (UniqueName: \"kubernetes.io/projected/d1cffe66-94e1-4fa6-847f-c353c4a6fa97-kube-api-access-47dd9\") pod \"maas-controller-68f6858cb9-52s5l\" (UID: \"d1cffe66-94e1-4fa6-847f-c353c4a6fa97\") " pod="opendatahub/maas-controller-68f6858cb9-52s5l" Jul 29 17:43:39.290066 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.290041 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1cffe66-94e1-4fa6-847f-c353c4a6fa97-webhook-cert\") pod \"maas-controller-68f6858cb9-52s5l\" (UID: \"d1cffe66-94e1-4fa6-847f-c353c4a6fa97\") " pod="opendatahub/maas-controller-68f6858cb9-52s5l" Jul 29 17:43:39.296454 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.296418 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47dd9\" (UniqueName: \"kubernetes.io/projected/d1cffe66-94e1-4fa6-847f-c353c4a6fa97-kube-api-access-47dd9\") pod \"maas-controller-68f6858cb9-52s5l\" (UID: \"d1cffe66-94e1-4fa6-847f-c353c4a6fa97\") " pod="opendatahub/maas-controller-68f6858cb9-52s5l" Jul 29 17:43:39.451670 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.451561 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68f6858cb9-52s5l" Jul 29 17:43:39.580634 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.580538 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68f6858cb9-52s5l"] Jul 29 17:43:39.583180 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:43:39.583151 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1cffe66_94e1_4fa6_847f_c353c4a6fa97.slice/crio-111116c6297d876ae280724f577707b068de657f1a3ecc860b9ed5db4e702e19 WatchSource:0}: Error finding container 111116c6297d876ae280724f577707b068de657f1a3ecc860b9ed5db4e702e19: Status 404 returned error can't find the container with id 111116c6297d876ae280724f577707b068de657f1a3ecc860b9ed5db4e702e19 Jul 29 17:43:39.692207 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.692169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-webhook-cert\") pod \"maas-controller-788bdc9f67-5xdnl\" (UID: \"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3\") " pod="opendatahub/maas-controller-788bdc9f67-5xdnl" Jul 29 17:43:39.694530 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.694499 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-webhook-cert\") pod \"maas-controller-788bdc9f67-5xdnl\" (UID: \"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3\") " pod="opendatahub/maas-controller-788bdc9f67-5xdnl" Jul 29 17:43:39.889055 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:39.888973 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-788bdc9f67-5xdnl" Jul 29 17:43:40.021022 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:40.020880 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-788bdc9f67-5xdnl"] Jul 29 17:43:40.023225 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:43:40.023199 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8fcb4cb_2c9a_4e2c_a0ef_e2b02eced5b3.slice/crio-aac1ff0806641e035ad4991dc518d6b08a953124b366034b79383a9b491841fb WatchSource:0}: Error finding container aac1ff0806641e035ad4991dc518d6b08a953124b366034b79383a9b491841fb: Status 404 returned error can't find the container with id aac1ff0806641e035ad4991dc518d6b08a953124b366034b79383a9b491841fb Jul 29 17:43:40.035590 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:40.035556 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-788bdc9f67-5xdnl" event={"ID":"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3","Type":"ContainerStarted","Data":"aac1ff0806641e035ad4991dc518d6b08a953124b366034b79383a9b491841fb"} Jul 29 17:43:40.036621 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:40.036595 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68f6858cb9-52s5l" event={"ID":"d1cffe66-94e1-4fa6-847f-c353c4a6fa97","Type":"ContainerStarted","Data":"111116c6297d876ae280724f577707b068de657f1a3ecc860b9ed5db4e702e19"} Jul 29 17:43:43.056410 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:43.056372 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-788bdc9f67-5xdnl" event={"ID":"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3","Type":"ContainerStarted","Data":"d9ae6692adf2878a78c6069357397df64e810c1e2b26f346058fa34c105861ba"} Jul 29 17:43:43.056915 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:43.056496 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-788bdc9f67-5xdnl" Jul 29 17:43:43.058086 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:43.058064 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68f6858cb9-52s5l" event={"ID":"d1cffe66-94e1-4fa6-847f-c353c4a6fa97","Type":"ContainerStarted","Data":"7835ae4ba95c55a79367903e2e181547cb0d7b7654dedd97c1ff4733d1798c35"} Jul 29 17:43:43.058194 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:43.058143 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68f6858cb9-52s5l" Jul 29 17:43:43.072809 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:43.072761 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-788bdc9f67-5xdnl" podStartSLOduration=2.903429423 podStartE2EDuration="5.072746835s" totalImagesPullingTime="2.169317412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:43:43.071820018 +0000 UTC m=+538.676691181" watchObservedRunningTime="2026-07-29 17:43:43.072746835 +0000 UTC m=+538.677617995" Jul 29 17:43:43.089252 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:43.089198 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68f6858cb9-52s5l" podStartSLOduration=1.4860195 podStartE2EDuration="4.089178977s" totalImagesPullingTime="2.603159477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:43:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:43:43.08810626 +0000 UTC m=+538.692977424" watchObservedRunningTime="2026-07-29 17:43:43.089178977 +0000 UTC m=+538.694050138" Jul 29 17:43:54.064384 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:54.064352 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68f6858cb9-52s5l" Jul 29 17:43:54.064791 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:54.064516 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-788bdc9f67-5xdnl" Jul 29 17:43:54.135006 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:54.134969 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-788bdc9f67-5xdnl"] Jul 29 17:43:54.135204 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:54.135180 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-788bdc9f67-5xdnl" podUID="f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3" containerName="manager" containerID="cri-o://d9ae6692adf2878a78c6069357397df64e810c1e2b26f346058fa34c105861ba" gracePeriod=30 Jul 29 17:43:54.377140 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:54.377111 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-788bdc9f67-5xdnl" Jul 29 17:43:54.525125 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:54.525083 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-webhook-cert\") pod \"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3\" (UID: \"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3\") " Jul 29 17:43:54.525290 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:54.525172 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsb6g\" (UniqueName: \"kubernetes.io/projected/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-kube-api-access-qsb6g\") pod \"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3\" (UID: \"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3\") " Jul 29 17:43:54.527320 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:54.527286 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3" (UID: "f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:43:54.527425 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:54.527317 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-kube-api-access-qsb6g" (OuterVolumeSpecName: "kube-api-access-qsb6g") pod "f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3" (UID: "f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3"). InnerVolumeSpecName "kube-api-access-qsb6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:43:54.625788 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:54.625686 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-webhook-cert\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:43:54.625788 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:54.625739 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsb6g\" (UniqueName: \"kubernetes.io/projected/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3-kube-api-access-qsb6g\") on node \"ip-10-0-131-247.ec2.internal\" DevicePath \"\"" Jul 29 17:43:55.108405 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:55.108371 2578 generic.go:356] "Generic (PLEG): container finished" podID="f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3" containerID="d9ae6692adf2878a78c6069357397df64e810c1e2b26f346058fa34c105861ba" exitCode=0 Jul 29 17:43:55.108834 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:55.108414 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-788bdc9f67-5xdnl" Jul 29 17:43:55.108834 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:55.108458 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-788bdc9f67-5xdnl" event={"ID":"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3","Type":"ContainerDied","Data":"d9ae6692adf2878a78c6069357397df64e810c1e2b26f346058fa34c105861ba"} Jul 29 17:43:55.108834 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:55.108509 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-788bdc9f67-5xdnl" event={"ID":"f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3","Type":"ContainerDied","Data":"aac1ff0806641e035ad4991dc518d6b08a953124b366034b79383a9b491841fb"} Jul 29 17:43:55.108834 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:55.108537 2578 scope.go:117] "RemoveContainer" containerID="d9ae6692adf2878a78c6069357397df64e810c1e2b26f346058fa34c105861ba" Jul 29 17:43:55.116785 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:55.116765 2578 scope.go:117] "RemoveContainer" containerID="d9ae6692adf2878a78c6069357397df64e810c1e2b26f346058fa34c105861ba" Jul 29 17:43:55.117078 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:43:55.117057 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9ae6692adf2878a78c6069357397df64e810c1e2b26f346058fa34c105861ba\": container with ID starting with d9ae6692adf2878a78c6069357397df64e810c1e2b26f346058fa34c105861ba not found: ID does not exist" containerID="d9ae6692adf2878a78c6069357397df64e810c1e2b26f346058fa34c105861ba" Jul 29 17:43:55.117147 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:55.117092 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ae6692adf2878a78c6069357397df64e810c1e2b26f346058fa34c105861ba"} err="failed to get container status \"d9ae6692adf2878a78c6069357397df64e810c1e2b26f346058fa34c105861ba\": rpc error: code = NotFound desc = could not find container \"d9ae6692adf2878a78c6069357397df64e810c1e2b26f346058fa34c105861ba\": container with ID starting with d9ae6692adf2878a78c6069357397df64e810c1e2b26f346058fa34c105861ba not found: ID does not exist" Jul 29 17:43:55.123371 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:55.123343 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-788bdc9f67-5xdnl"] Jul 29 17:43:55.127176 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:55.127152 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-788bdc9f67-5xdnl"] Jul 29 17:43:56.942603 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:43:56.942556 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3" path="/var/lib/kubelet/pods/f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3/volumes" Jul 29 17:44:17.051013 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.050972 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq"] Jul 29 17:44:17.051523 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.051318 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3" containerName="manager" Jul 29 17:44:17.051523 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.051332 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3" containerName="manager" Jul 29 17:44:17.051523 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.051394 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8fcb4cb-2c9a-4e2c-a0ef-e2b02eced5b3" containerName="manager" Jul 29 17:44:17.061431 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.061408 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" Jul 29 17:44:17.066402 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.066375 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 29 17:44:17.066705 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.066510 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5nzgc\"" Jul 29 17:44:17.067642 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.067614 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq"] Jul 29 17:44:17.118480 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.118441 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80750741-ae4e-4283-b7b8-b74e30c2a3fc-maas-api-tls\") pod \"maas-api-84d5cb6765-bfvhq\" (UID: \"80750741-ae4e-4283-b7b8-b74e30c2a3fc\") " pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" Jul 29 17:44:17.118664 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.118494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc55z\" (UniqueName: \"kubernetes.io/projected/80750741-ae4e-4283-b7b8-b74e30c2a3fc-kube-api-access-cc55z\") pod \"maas-api-84d5cb6765-bfvhq\" (UID: \"80750741-ae4e-4283-b7b8-b74e30c2a3fc\") " pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" Jul 29 17:44:17.118664 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.118519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80750741-ae4e-4283-b7b8-b74e30c2a3fc-openshift-service-ca\") pod \"maas-api-84d5cb6765-bfvhq\" (UID: \"80750741-ae4e-4283-b7b8-b74e30c2a3fc\") " pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" Jul 29 17:44:17.219541 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.219500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80750741-ae4e-4283-b7b8-b74e30c2a3fc-maas-api-tls\") pod \"maas-api-84d5cb6765-bfvhq\" (UID: \"80750741-ae4e-4283-b7b8-b74e30c2a3fc\") " pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" Jul 29 17:44:17.219778 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.219649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc55z\" (UniqueName: \"kubernetes.io/projected/80750741-ae4e-4283-b7b8-b74e30c2a3fc-kube-api-access-cc55z\") pod \"maas-api-84d5cb6765-bfvhq\" (UID: \"80750741-ae4e-4283-b7b8-b74e30c2a3fc\") " pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" Jul 29 17:44:17.219778 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.219691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80750741-ae4e-4283-b7b8-b74e30c2a3fc-openshift-service-ca\") pod \"maas-api-84d5cb6765-bfvhq\" (UID: \"80750741-ae4e-4283-b7b8-b74e30c2a3fc\") " pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" Jul 29 17:44:17.220333 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.220312 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80750741-ae4e-4283-b7b8-b74e30c2a3fc-openshift-service-ca\") pod \"maas-api-84d5cb6765-bfvhq\" (UID: \"80750741-ae4e-4283-b7b8-b74e30c2a3fc\") " pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" Jul 29 17:44:17.222301 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.222276 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80750741-ae4e-4283-b7b8-b74e30c2a3fc-maas-api-tls\") pod \"maas-api-84d5cb6765-bfvhq\" (UID: \"80750741-ae4e-4283-b7b8-b74e30c2a3fc\") " pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" Jul 29 17:44:17.227316 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.227295 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc55z\" (UniqueName: \"kubernetes.io/projected/80750741-ae4e-4283-b7b8-b74e30c2a3fc-kube-api-access-cc55z\") pod \"maas-api-84d5cb6765-bfvhq\" (UID: \"80750741-ae4e-4283-b7b8-b74e30c2a3fc\") " pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" Jul 29 17:44:17.373959 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.373879 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" Jul 29 17:44:17.511945 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.511921 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq"] Jul 29 17:44:17.514760 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:44:17.514702 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80750741_ae4e_4283_b7b8_b74e30c2a3fc.slice/crio-4bde809b6f1e7a0e85d29fb153ae82fdfa6e56848f34836b02590cd53e6c9901 WatchSource:0}: Error finding container 4bde809b6f1e7a0e85d29fb153ae82fdfa6e56848f34836b02590cd53e6c9901: Status 404 returned error can't find the container with id 4bde809b6f1e7a0e85d29fb153ae82fdfa6e56848f34836b02590cd53e6c9901 Jul 29 17:44:17.574871 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.574836 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7"] Jul 29 17:44:17.579760 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.579741 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7" Jul 29 17:44:17.582338 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.582318 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 29 17:44:17.591359 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.591303 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7"] Jul 29 17:44:17.622976 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.622936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68r54\" (UniqueName: \"kubernetes.io/projected/e9f538a5-ace4-4be2-a2b1-4a6ee0429929-kube-api-access-68r54\") pod \"payload-pre-processing-687dbb6cf6-lgmd7\" (UID: \"e9f538a5-ace4-4be2-a2b1-4a6ee0429929\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7" Jul 29 17:44:17.623142 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.623107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9f538a5-ace4-4be2-a2b1-4a6ee0429929-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-lgmd7\" (UID: \"e9f538a5-ace4-4be2-a2b1-4a6ee0429929\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7" Jul 29 17:44:17.723740 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.723682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9f538a5-ace4-4be2-a2b1-4a6ee0429929-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-lgmd7\" (UID: \"e9f538a5-ace4-4be2-a2b1-4a6ee0429929\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7" Jul 29 17:44:17.723933 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.723800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68r54\" (UniqueName: \"kubernetes.io/projected/e9f538a5-ace4-4be2-a2b1-4a6ee0429929-kube-api-access-68r54\") pod \"payload-pre-processing-687dbb6cf6-lgmd7\" (UID: \"e9f538a5-ace4-4be2-a2b1-4a6ee0429929\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7" Jul 29 17:44:17.724407 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.724382 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9f538a5-ace4-4be2-a2b1-4a6ee0429929-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-lgmd7\" (UID: \"e9f538a5-ace4-4be2-a2b1-4a6ee0429929\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7" Jul 29 17:44:17.725114 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.725090 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-mzc4q"] Jul 29 17:44:17.728417 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.728398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:44:17.730836 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.730813 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-76t4w\"" Jul 29 17:44:17.739930 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.739002 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-mzc4q"] Jul 29 17:44:17.744856 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.744832 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68r54\" (UniqueName: \"kubernetes.io/projected/e9f538a5-ace4-4be2-a2b1-4a6ee0429929-kube-api-access-68r54\") pod \"payload-pre-processing-687dbb6cf6-lgmd7\" (UID: \"e9f538a5-ace4-4be2-a2b1-4a6ee0429929\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7" Jul 29 17:44:17.824394 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.824360 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfqzc\" (UniqueName: \"kubernetes.io/projected/9392d97f-8446-4cc4-b1ff-242989596b74-kube-api-access-qfqzc\") pod \"payload-processing-5cc6cd444b-mzc4q\" (UID: \"9392d97f-8446-4cc4-b1ff-242989596b74\") " pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:44:17.824589 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.824419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9392d97f-8446-4cc4-b1ff-242989596b74-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-mzc4q\" (UID: \"9392d97f-8446-4cc4-b1ff-242989596b74\") " pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:44:17.891994 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.891957 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7" Jul 29 17:44:17.925671 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.925641 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfqzc\" (UniqueName: \"kubernetes.io/projected/9392d97f-8446-4cc4-b1ff-242989596b74-kube-api-access-qfqzc\") pod \"payload-processing-5cc6cd444b-mzc4q\" (UID: \"9392d97f-8446-4cc4-b1ff-242989596b74\") " pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:44:17.925890 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.925697 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9392d97f-8446-4cc4-b1ff-242989596b74-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-mzc4q\" (UID: \"9392d97f-8446-4cc4-b1ff-242989596b74\") " pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:44:17.926381 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.926360 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9392d97f-8446-4cc4-b1ff-242989596b74-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-mzc4q\" (UID: \"9392d97f-8446-4cc4-b1ff-242989596b74\") " pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:44:17.934587 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:17.934560 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfqzc\" (UniqueName: \"kubernetes.io/projected/9392d97f-8446-4cc4-b1ff-242989596b74-kube-api-access-qfqzc\") pod \"payload-processing-5cc6cd444b-mzc4q\" (UID: \"9392d97f-8446-4cc4-b1ff-242989596b74\") " pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:44:18.021690 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:18.021662 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7"] Jul 29 17:44:18.024201 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:44:18.024171 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f538a5_ace4_4be2_a2b1_4a6ee0429929.slice/crio-472bb8900c13f06107ddc3396c4f1ccf164021a842c9f39ae2554d88f0cf6060 WatchSource:0}: Error finding container 472bb8900c13f06107ddc3396c4f1ccf164021a842c9f39ae2554d88f0cf6060: Status 404 returned error can't find the container with id 472bb8900c13f06107ddc3396c4f1ccf164021a842c9f39ae2554d88f0cf6060 Jul 29 17:44:18.045648 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:18.045620 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:44:18.184474 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:18.184381 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-mzc4q"] Jul 29 17:44:18.195485 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:44:18.195440 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9392d97f_8446_4cc4_b1ff_242989596b74.slice/crio-6c7439c054e5c53608397121c34e0723fd872285094ed7408d09a1e2f4f4c09e WatchSource:0}: Error finding container 6c7439c054e5c53608397121c34e0723fd872285094ed7408d09a1e2f4f4c09e: Status 404 returned error can't find the container with id 6c7439c054e5c53608397121c34e0723fd872285094ed7408d09a1e2f4f4c09e Jul 29 17:44:18.200290 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:18.200261 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7" event={"ID":"e9f538a5-ace4-4be2-a2b1-4a6ee0429929","Type":"ContainerStarted","Data":"472bb8900c13f06107ddc3396c4f1ccf164021a842c9f39ae2554d88f0cf6060"} Jul 29 17:44:18.201508 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:18.201484 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" event={"ID":"80750741-ae4e-4283-b7b8-b74e30c2a3fc","Type":"ContainerStarted","Data":"4bde809b6f1e7a0e85d29fb153ae82fdfa6e56848f34836b02590cd53e6c9901"} Jul 29 17:44:19.212249 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:19.211004 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" event={"ID":"9392d97f-8446-4cc4-b1ff-242989596b74","Type":"ContainerStarted","Data":"6c7439c054e5c53608397121c34e0723fd872285094ed7408d09a1e2f4f4c09e"} Jul 29 17:44:20.225749 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:20.225315 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" event={"ID":"80750741-ae4e-4283-b7b8-b74e30c2a3fc","Type":"ContainerStarted","Data":"eece7a7bf13a9c79f6253a69690fb62142ee0e07ba8bf3463ddd22823a51c018"} Jul 29 17:44:20.226225 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:20.226158 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" Jul 29 17:44:20.249163 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:20.249091 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" podStartSLOduration=0.719763011 podStartE2EDuration="3.249066039s" totalImagesPullingTime="2.529303028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:44:20.248178363 +0000 UTC m=+575.853049525" watchObservedRunningTime="2026-07-29 17:44:20.249066039 +0000 UTC m=+575.853937202" Jul 29 17:44:22.251207 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:22.251167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7" event={"ID":"e9f538a5-ace4-4be2-a2b1-4a6ee0429929","Type":"ContainerStarted","Data":"6c4f6a2562bc9bcb2eac3d32a1862d9ac7a719ef9dfc59d9f1b4db174692baa5"} Jul 29 17:44:22.251673 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:22.251233 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7" Jul 29 17:44:22.252585 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:22.252563 2578 generic.go:356] "Generic (PLEG): container finished" podID="9392d97f-8446-4cc4-b1ff-242989596b74" containerID="7119e342318bf04818890a6f1b81a71085c59863f588e00e33b9c847b854fd88" exitCode=1 Jul 29 17:44:22.252688 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:22.252650 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" event={"ID":"9392d97f-8446-4cc4-b1ff-242989596b74","Type":"ContainerDied","Data":"7119e342318bf04818890a6f1b81a71085c59863f588e00e33b9c847b854fd88"} Jul 29 17:44:22.252839 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:22.252824 2578 scope.go:117] "RemoveContainer" containerID="7119e342318bf04818890a6f1b81a71085c59863f588e00e33b9c847b854fd88" Jul 29 17:44:22.266189 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:22.266135 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7" podStartSLOduration=1.800251335 podStartE2EDuration="5.266114157s" totalImagesPullingTime="3.465862822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:44:22.265222753 +0000 UTC m=+577.870093915" watchObservedRunningTime="2026-07-29 17:44:22.266114157 +0000 UTC m=+577.870985319" Jul 29 17:44:23.259290 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:23.259249 2578 generic.go:356] "Generic (PLEG): container finished" podID="9392d97f-8446-4cc4-b1ff-242989596b74" containerID="cbddf5fe6b80f98600dc761354bcb986ca869e64f33ca140ae03e6870b3d9c1b" exitCode=1 Jul 29 17:44:23.259809 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:23.259309 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" event={"ID":"9392d97f-8446-4cc4-b1ff-242989596b74","Type":"ContainerDied","Data":"cbddf5fe6b80f98600dc761354bcb986ca869e64f33ca140ae03e6870b3d9c1b"} Jul 29 17:44:23.259809 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:23.259363 2578 scope.go:117] "RemoveContainer" containerID="7119e342318bf04818890a6f1b81a71085c59863f588e00e33b9c847b854fd88" Jul 29 17:44:23.259809 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:23.259677 2578 scope.go:117] "RemoveContainer" containerID="cbddf5fe6b80f98600dc761354bcb986ca869e64f33ca140ae03e6870b3d9c1b" Jul 29 17:44:23.259982 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:44:23.259910 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:44:24.267980 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:24.267955 2578 scope.go:117] "RemoveContainer" containerID="cbddf5fe6b80f98600dc761354bcb986ca869e64f33ca140ae03e6870b3d9c1b" Jul 29 17:44:24.268359 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:44:24.268156 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:44:25.273252 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:25.273216 2578 generic.go:356] "Generic (PLEG): container finished" podID="c3328ef8-221c-4a8a-bfe8-a7711ea25a7d" containerID="7e59c43a86ef30f2f5ad5af0ef309d872c79beb783140b9568eab5faa4b6436b" exitCode=0 Jul 29 17:44:25.273659 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:25.273292 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" event={"ID":"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d","Type":"ContainerDied","Data":"7e59c43a86ef30f2f5ad5af0ef309d872c79beb783140b9568eab5faa4b6436b"} Jul 29 17:44:25.273700 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:25.273674 2578 scope.go:117] "RemoveContainer" containerID="7e59c43a86ef30f2f5ad5af0ef309d872c79beb783140b9568eab5faa4b6436b" Jul 29 17:44:25.274598 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:25.274574 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 29 17:44:25.274678 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:25.274638 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 29 17:44:25.274678 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:25.274675 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 29 17:44:26.279875 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:26.279840 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" event={"ID":"c3328ef8-221c-4a8a-bfe8-a7711ea25a7d","Type":"ContainerStarted","Data":"4cf6a0ac686886af57195a5b8b270d19b6d9e67fa473115533f5a940546a756c"} Jul 29 17:44:26.406536 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:26.406500 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:44:26.407603 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:26.407575 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-52cm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 29 17:44:26.407749 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:26.407625 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" podUID="c3328ef8-221c-4a8a-bfe8-a7711ea25a7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 29 17:44:26.777324 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:26.777267 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:44:27.258453 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:27.258419 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-84d5cb6765-bfvhq" Jul 29 17:44:27.406520 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:27.406485 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-52cm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 29 17:44:27.406934 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:27.406540 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" podUID="c3328ef8-221c-4a8a-bfe8-a7711ea25a7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 29 17:44:28.046535 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:28.046483 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:44:28.046920 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:28.046906 2578 scope.go:117] "RemoveContainer" containerID="cbddf5fe6b80f98600dc761354bcb986ca869e64f33ca140ae03e6870b3d9c1b" Jul 29 17:44:28.047109 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:44:28.047090 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:44:28.407291 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:28.407260 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-52cm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 29 17:44:28.407658 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:28.407321 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" podUID="c3328ef8-221c-4a8a-bfe8-a7711ea25a7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 29 17:44:29.407315 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:29.407271 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-52cm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 29 17:44:29.407808 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:29.407344 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" podUID="c3328ef8-221c-4a8a-bfe8-a7711ea25a7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 29 17:44:30.410638 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:30.410609 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:44:30.411774 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:30.411751 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-52cm4" Jul 29 17:44:33.261649 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:33.261617 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lgmd7" Jul 29 17:44:35.951899 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:35.951866 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx"] Jul 29 17:44:35.954500 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:35.954476 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:35.956938 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:35.956912 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 29 17:44:35.957069 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:35.957038 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-psnzp\"" Jul 29 17:44:35.957172 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:35.957158 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 29 17:44:35.957645 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:35.957622 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 29 17:44:35.966910 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:35.966887 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx"] Jul 29 17:44:35.997209 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:35.997172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcmtx\" (UniqueName: \"kubernetes.io/projected/d9275d3b-1388-4332-a1f2-c18de2e20974-kube-api-access-qcmtx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:35.997412 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:35.997293 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9275d3b-1388-4332-a1f2-c18de2e20974-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:35.997412 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:35.997327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9275d3b-1388-4332-a1f2-c18de2e20974-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:35.997412 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:35.997354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9275d3b-1388-4332-a1f2-c18de2e20974-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:35.997412 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:35.997370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9275d3b-1388-4332-a1f2-c18de2e20974-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:35.997412 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:35.997403 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9275d3b-1388-4332-a1f2-c18de2e20974-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:36.098061 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:36.098017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9275d3b-1388-4332-a1f2-c18de2e20974-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:36.098247 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:36.098076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9275d3b-1388-4332-a1f2-c18de2e20974-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:36.098247 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:36.098115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9275d3b-1388-4332-a1f2-c18de2e20974-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:36.098247 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:36.098138 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9275d3b-1388-4332-a1f2-c18de2e20974-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:36.098247 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:36.098162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9275d3b-1388-4332-a1f2-c18de2e20974-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:36.098247 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:36.098195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcmtx\" (UniqueName: \"kubernetes.io/projected/d9275d3b-1388-4332-a1f2-c18de2e20974-kube-api-access-qcmtx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:36.098528 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:36.098407 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9275d3b-1388-4332-a1f2-c18de2e20974-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:36.098528 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:36.098478 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9275d3b-1388-4332-a1f2-c18de2e20974-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:36.098609 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:36.098548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9275d3b-1388-4332-a1f2-c18de2e20974-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:36.100417 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:36.100395 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9275d3b-1388-4332-a1f2-c18de2e20974-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:36.100661 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:36.100644 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9275d3b-1388-4332-a1f2-c18de2e20974-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:36.106369 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:36.106343 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcmtx\" (UniqueName: \"kubernetes.io/projected/d9275d3b-1388-4332-a1f2-c18de2e20974-kube-api-access-qcmtx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx\" (UID: \"d9275d3b-1388-4332-a1f2-c18de2e20974\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:36.265056 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:36.264959 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:36.397039 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:36.397003 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx"] Jul 29 17:44:36.400127 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:44:36.400101 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9275d3b_1388_4332_a1f2_c18de2e20974.slice/crio-c51dfdc181e6f64863db016401a5c0aabaadce9a2dd3abe311799394f4dc6dd9 WatchSource:0}: Error finding container c51dfdc181e6f64863db016401a5c0aabaadce9a2dd3abe311799394f4dc6dd9: Status 404 returned error can't find the container with id c51dfdc181e6f64863db016401a5c0aabaadce9a2dd3abe311799394f4dc6dd9 Jul 29 17:44:37.332285 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:37.332248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" event={"ID":"d9275d3b-1388-4332-a1f2-c18de2e20974","Type":"ContainerStarted","Data":"c51dfdc181e6f64863db016401a5c0aabaadce9a2dd3abe311799394f4dc6dd9"} Jul 29 17:44:38.046535 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:38.046497 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:44:38.046936 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:38.046921 2578 scope.go:117] "RemoveContainer" containerID="cbddf5fe6b80f98600dc761354bcb986ca869e64f33ca140ae03e6870b3d9c1b" Jul 29 17:44:38.338333 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:38.338243 2578 generic.go:356] "Generic (PLEG): container finished" podID="9392d97f-8446-4cc4-b1ff-242989596b74" containerID="bd93b10b14991be351195138f77e79ba5c18c8f79b9c0e7976729fcb7fceb0b2" exitCode=1 Jul 29 17:44:38.338779 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:38.338322 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" event={"ID":"9392d97f-8446-4cc4-b1ff-242989596b74","Type":"ContainerDied","Data":"bd93b10b14991be351195138f77e79ba5c18c8f79b9c0e7976729fcb7fceb0b2"} Jul 29 17:44:38.338779 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:38.338385 2578 scope.go:117] "RemoveContainer" containerID="cbddf5fe6b80f98600dc761354bcb986ca869e64f33ca140ae03e6870b3d9c1b" Jul 29 17:44:38.338779 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:38.338752 2578 scope.go:117] "RemoveContainer" containerID="bd93b10b14991be351195138f77e79ba5c18c8f79b9c0e7976729fcb7fceb0b2" Jul 29 17:44:38.339024 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:44:38.338994 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:44:38.340143 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:38.340119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" event={"ID":"d9275d3b-1388-4332-a1f2-c18de2e20974","Type":"ContainerStarted","Data":"da6139b99142f2471d205c1d2c33497740c8c4392a69cf434a6f48e3179c4ba8"} Jul 29 17:44:38.371538 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:38.371487 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" podStartSLOduration=2.330543395 podStartE2EDuration="3.371471372s" totalImagesPullingTime="1.040927977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:44:38.369512678 +0000 UTC m=+593.974383850" watchObservedRunningTime="2026-07-29 17:44:38.371471372 +0000 UTC m=+593.976342533" Jul 29 17:44:46.265416 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:46.265374 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:46.265848 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:46.265452 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:46.277949 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:46.277924 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:46.386708 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:46.386675 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx" Jul 29 17:44:48.046665 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:48.046627 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:44:48.047125 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:48.047009 2578 scope.go:117] "RemoveContainer" containerID="bd93b10b14991be351195138f77e79ba5c18c8f79b9c0e7976729fcb7fceb0b2" Jul 29 17:44:48.047211 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:44:48.047192 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:44:58.045890 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:58.045851 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:44:58.046369 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:44:58.046207 2578 scope.go:117] "RemoveContainer" containerID="bd93b10b14991be351195138f77e79ba5c18c8f79b9c0e7976729fcb7fceb0b2" Jul 29 17:44:58.046421 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:44:58.046401 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:45:00.141352 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:00.141315 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755785-bwvb5"] Jul 29 17:45:00.146369 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:00.146350 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755785-bwvb5" Jul 29 17:45:00.149112 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:00.148925 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nwgfs\"" Jul 29 17:45:00.150895 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:00.150827 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755785-bwvb5"] Jul 29 17:45:00.160323 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:00.160293 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755785-bwvb5" Jul 29 17:45:00.288102 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:00.288063 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755785-bwvb5"] Jul 29 17:45:00.291019 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:45:00.290991 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb86be55b_3ed8_42ba_ac1f_2f747ea3062d.slice/crio-c0c6921e327dca2186a18267662659112cec0fa0ba3bb415a1850b40007a8c7e WatchSource:0}: Error finding container c0c6921e327dca2186a18267662659112cec0fa0ba3bb415a1850b40007a8c7e: Status 404 returned error can't find the container with id c0c6921e327dca2186a18267662659112cec0fa0ba3bb415a1850b40007a8c7e Jul 29 17:45:00.293131 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:00.293113 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 17:45:00.438227 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:00.438193 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755785-bwvb5" event={"ID":"b86be55b-3ed8-42ba-ac1f-2f747ea3062d","Type":"ContainerStarted","Data":"c0c6921e327dca2186a18267662659112cec0fa0ba3bb415a1850b40007a8c7e"} Jul 29 17:45:04.341101 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.341022 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq"] Jul 29 17:45:04.344526 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.344507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.346930 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.346906 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 29 17:45:04.357046 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.357020 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq"] Jul 29 17:45:04.453954 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.453922 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzhgm\" (UniqueName: \"kubernetes.io/projected/6b34dedd-7a2a-4086-b384-ab06acefa644-kube-api-access-kzhgm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.454144 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.453982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b34dedd-7a2a-4086-b384-ab06acefa644-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.454144 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.454023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b34dedd-7a2a-4086-b384-ab06acefa644-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.454144 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.454082 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b34dedd-7a2a-4086-b384-ab06acefa644-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.454144 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.454141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b34dedd-7a2a-4086-b384-ab06acefa644-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.454307 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.454245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b34dedd-7a2a-4086-b384-ab06acefa644-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.458378 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.458348 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755785-bwvb5" event={"ID":"b86be55b-3ed8-42ba-ac1f-2f747ea3062d","Type":"ContainerStarted","Data":"be63fed5525bfef59598c3f32de92fad1c507ea3fb596b13398a7d6c34a82bc0"} Jul 29 17:45:04.472794 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.472741 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755785-bwvb5" podStartSLOduration=0.999674188 podStartE2EDuration="4.472704397s" totalImagesPullingTime="3.473030209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:45:04.471679326 +0000 UTC m=+620.076550487" watchObservedRunningTime="2026-07-29 17:45:04.472704397 +0000 UTC m=+620.077575557" Jul 29 17:45:04.555496 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.555457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b34dedd-7a2a-4086-b384-ab06acefa644-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.555496 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.555509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzhgm\" (UniqueName: \"kubernetes.io/projected/6b34dedd-7a2a-4086-b384-ab06acefa644-kube-api-access-kzhgm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.555794 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.555560 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b34dedd-7a2a-4086-b384-ab06acefa644-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.555794 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.555608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b34dedd-7a2a-4086-b384-ab06acefa644-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.555794 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.555634 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b34dedd-7a2a-4086-b384-ab06acefa644-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.555794 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.555678 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b34dedd-7a2a-4086-b384-ab06acefa644-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.556066 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.555957 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b34dedd-7a2a-4086-b384-ab06acefa644-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.556066 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.555969 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b34dedd-7a2a-4086-b384-ab06acefa644-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.556159 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.556082 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b34dedd-7a2a-4086-b384-ab06acefa644-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.558090 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.558067 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b34dedd-7a2a-4086-b384-ab06acefa644-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.558808 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.558789 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b34dedd-7a2a-4086-b384-ab06acefa644-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.563756 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.563729 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzhgm\" (UniqueName: \"kubernetes.io/projected/6b34dedd-7a2a-4086-b384-ab06acefa644-kube-api-access-kzhgm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jqggq\" (UID: \"6b34dedd-7a2a-4086-b384-ab06acefa644\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.655678 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.655646 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:04.786411 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:04.786323 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq"] Jul 29 17:45:04.788896 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:45:04.788862 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b34dedd_7a2a_4086_b384_ab06acefa644.slice/crio-c7a43a3468611141264add7a082cbc8bbf7984681c427c3cb132c288b5b96087 WatchSource:0}: Error finding container c7a43a3468611141264add7a082cbc8bbf7984681c427c3cb132c288b5b96087: Status 404 returned error can't find the container with id c7a43a3468611141264add7a082cbc8bbf7984681c427c3cb132c288b5b96087 Jul 29 17:45:05.463871 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:05.463829 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" event={"ID":"6b34dedd-7a2a-4086-b384-ab06acefa644","Type":"ContainerStarted","Data":"05adbf0e6d8daeb00f75f830bd8612fb87ff9af9fa9778a9f2acb1712b2d8bff"} Jul 29 17:45:05.464372 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:05.463890 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" event={"ID":"6b34dedd-7a2a-4086-b384-ab06acefa644","Type":"ContainerStarted","Data":"c7a43a3468611141264add7a082cbc8bbf7984681c427c3cb132c288b5b96087"} Jul 29 17:45:05.465337 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:05.465311 2578 generic.go:356] "Generic (PLEG): container finished" podID="b86be55b-3ed8-42ba-ac1f-2f747ea3062d" containerID="be63fed5525bfef59598c3f32de92fad1c507ea3fb596b13398a7d6c34a82bc0" exitCode=0 Jul 29 17:45:05.465444 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:05.465380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755785-bwvb5" event={"ID":"b86be55b-3ed8-42ba-ac1f-2f747ea3062d","Type":"ContainerDied","Data":"be63fed5525bfef59598c3f32de92fad1c507ea3fb596b13398a7d6c34a82bc0"} Jul 29 17:45:05.483917 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:05.483860 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" podStartSLOduration=1.259879755 podStartE2EDuration="1.483846276s" totalImagesPullingTime="223.966521ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:45:05.482838869 +0000 UTC m=+621.087710031" watchObservedRunningTime="2026-07-29 17:45:05.483846276 +0000 UTC m=+621.088717437" Jul 29 17:45:06.606343 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:06.606316 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755785-bwvb5" Jul 29 17:45:07.475983 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:07.475954 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755785-bwvb5" Jul 29 17:45:07.475983 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:07.475973 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755785-bwvb5" event={"ID":"b86be55b-3ed8-42ba-ac1f-2f747ea3062d","Type":"ContainerDied","Data":"c0c6921e327dca2186a18267662659112cec0fa0ba3bb415a1850b40007a8c7e"} Jul 29 17:45:07.476202 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:07.476042 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0c6921e327dca2186a18267662659112cec0fa0ba3bb415a1850b40007a8c7e" Jul 29 17:45:10.937510 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:10.937475 2578 scope.go:117] "RemoveContainer" containerID="bd93b10b14991be351195138f77e79ba5c18c8f79b9c0e7976729fcb7fceb0b2" Jul 29 17:45:11.493609 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:11.493574 2578 generic.go:356] "Generic (PLEG): container finished" podID="9392d97f-8446-4cc4-b1ff-242989596b74" containerID="5db14ed495429fd3ea2a56bc21665f87f154c210299b6ef225d446b1ecc19d40" exitCode=1 Jul 29 17:45:11.493849 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:11.493640 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" event={"ID":"9392d97f-8446-4cc4-b1ff-242989596b74","Type":"ContainerDied","Data":"5db14ed495429fd3ea2a56bc21665f87f154c210299b6ef225d446b1ecc19d40"} Jul 29 17:45:11.493849 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:11.493700 2578 scope.go:117] "RemoveContainer" containerID="bd93b10b14991be351195138f77e79ba5c18c8f79b9c0e7976729fcb7fceb0b2" Jul 29 17:45:11.494108 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:11.494086 2578 scope.go:117] "RemoveContainer" containerID="5db14ed495429fd3ea2a56bc21665f87f154c210299b6ef225d446b1ecc19d40" Jul 29 17:45:11.494313 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:45:11.494288 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:45:14.656920 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:14.656879 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:14.657343 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:14.656943 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:14.669650 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:14.669618 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:15.525613 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:15.525583 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jqggq" Jul 29 17:45:18.046029 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:18.045981 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:45:18.046445 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:18.046055 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:45:18.046445 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:18.046378 2578 scope.go:117] "RemoveContainer" containerID="5db14ed495429fd3ea2a56bc21665f87f154c210299b6ef225d446b1ecc19d40" Jul 29 17:45:18.046561 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:45:18.046542 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:45:30.937998 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:30.937958 2578 scope.go:117] "RemoveContainer" containerID="5db14ed495429fd3ea2a56bc21665f87f154c210299b6ef225d446b1ecc19d40" Jul 29 17:45:30.938584 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:45:30.938216 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:45:33.146947 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.146915 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g"] Jul 29 17:45:33.147344 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.147261 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b86be55b-3ed8-42ba-ac1f-2f747ea3062d" containerName="cleanup" Jul 29 17:45:33.147344 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.147273 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b86be55b-3ed8-42ba-ac1f-2f747ea3062d" containerName="cleanup" Jul 29 17:45:33.147344 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.147342 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b86be55b-3ed8-42ba-ac1f-2f747ea3062d" containerName="cleanup" Jul 29 17:45:33.151948 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.151927 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.154227 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.154203 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 29 17:45:33.161767 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.161744 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g"] Jul 29 17:45:33.185779 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.185747 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b797127e-a44b-4307-9033-27f5b44f325d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.185949 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.185792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b797127e-a44b-4307-9033-27f5b44f325d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.185949 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.185834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b797127e-a44b-4307-9033-27f5b44f325d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.185949 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.185876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b797127e-a44b-4307-9033-27f5b44f325d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.185949 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.185917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b797127e-a44b-4307-9033-27f5b44f325d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.186084 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.185955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khvnz\" (UniqueName: \"kubernetes.io/projected/b797127e-a44b-4307-9033-27f5b44f325d-kube-api-access-khvnz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.286949 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.286913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khvnz\" (UniqueName: \"kubernetes.io/projected/b797127e-a44b-4307-9033-27f5b44f325d-kube-api-access-khvnz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.287130 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.286983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b797127e-a44b-4307-9033-27f5b44f325d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.287130 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.287019 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b797127e-a44b-4307-9033-27f5b44f325d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.287130 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.287055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b797127e-a44b-4307-9033-27f5b44f325d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.287130 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.287106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b797127e-a44b-4307-9033-27f5b44f325d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.287331 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.287278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b797127e-a44b-4307-9033-27f5b44f325d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.287512 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.287478 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b797127e-a44b-4307-9033-27f5b44f325d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.287622 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.287526 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b797127e-a44b-4307-9033-27f5b44f325d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.287622 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.287584 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b797127e-a44b-4307-9033-27f5b44f325d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.289285 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.289265 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b797127e-a44b-4307-9033-27f5b44f325d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.289688 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.289669 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b797127e-a44b-4307-9033-27f5b44f325d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.303044 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.303010 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khvnz\" (UniqueName: \"kubernetes.io/projected/b797127e-a44b-4307-9033-27f5b44f325d-kube-api-access-khvnz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g\" (UID: \"b797127e-a44b-4307-9033-27f5b44f325d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.465339 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.465301 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:33.596795 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:33.596758 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g"] Jul 29 17:45:33.600545 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:45:33.600521 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb797127e_a44b_4307_9033_27f5b44f325d.slice/crio-8cead314d666e6b7ad255b7f4b22d4dcad795cb71a1187ef7a9f913271a59bf2 WatchSource:0}: Error finding container 8cead314d666e6b7ad255b7f4b22d4dcad795cb71a1187ef7a9f913271a59bf2: Status 404 returned error can't find the container with id 8cead314d666e6b7ad255b7f4b22d4dcad795cb71a1187ef7a9f913271a59bf2 Jul 29 17:45:34.595848 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:34.595806 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" event={"ID":"b797127e-a44b-4307-9033-27f5b44f325d","Type":"ContainerStarted","Data":"6c4d87f01e4632a7526f6cc5c8f41a754867e63f914f41fe7d5a9cb3be8b8748"} Jul 29 17:45:34.596253 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:34.595876 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" event={"ID":"b797127e-a44b-4307-9033-27f5b44f325d","Type":"ContainerStarted","Data":"8cead314d666e6b7ad255b7f4b22d4dcad795cb71a1187ef7a9f913271a59bf2"} Jul 29 17:45:34.614540 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:34.614489 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" podStartSLOduration=1.342811518 podStartE2EDuration="1.614472372s" totalImagesPullingTime="271.660854ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:45:34.613220136 +0000 UTC m=+650.218091377" watchObservedRunningTime="2026-07-29 17:45:34.614472372 +0000 UTC m=+650.219343553" Jul 29 17:45:43.465542 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:43.465492 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:43.466125 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:43.465560 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:43.478252 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:43.478222 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:43.647220 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:43.647172 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g" Jul 29 17:45:45.938098 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:45.938067 2578 scope.go:117] "RemoveContainer" containerID="5db14ed495429fd3ea2a56bc21665f87f154c210299b6ef225d446b1ecc19d40" Jul 29 17:45:45.938489 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:45:45.938265 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:45:52.023586 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.023541 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr"] Jul 29 17:45:52.026381 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.026356 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.028576 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.028553 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 29 17:45:52.037609 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.037578 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr"] Jul 29 17:45:52.156792 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.156759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.156965 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.156810 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.156965 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.156886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzr9n\" (UniqueName: \"kubernetes.io/projected/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-kube-api-access-fzr9n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.156965 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.156933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.156965 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.156954 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.157099 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.156997 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.257476 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.257440 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.257476 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.257480 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.257746 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.257506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.257746 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.257581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.257746 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.257625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.257746 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.257675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzr9n\" (UniqueName: \"kubernetes.io/projected/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-kube-api-access-fzr9n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.258059 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.257947 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.258059 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.258000 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.258059 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.258035 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.259928 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.259911 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.260318 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.260287 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.266256 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.266231 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzr9n\" (UniqueName: \"kubernetes.io/projected/b13871d9-cbf1-4ee6-83ac-ec40652c7f06-kube-api-access-fzr9n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmddr\" (UID: \"b13871d9-cbf1-4ee6-83ac-ec40652c7f06\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.337160 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.337073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:45:52.489254 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.489228 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr"] Jul 29 17:45:52.491185 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:45:52.491159 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb13871d9_cbf1_4ee6_83ac_ec40652c7f06.slice/crio-9835d4f5d8b93796baae43839f4974901f36bb6193f252577489d5587af7c73a WatchSource:0}: Error finding container 9835d4f5d8b93796baae43839f4974901f36bb6193f252577489d5587af7c73a: Status 404 returned error can't find the container with id 9835d4f5d8b93796baae43839f4974901f36bb6193f252577489d5587af7c73a Jul 29 17:45:52.675174 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:52.675136 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" event={"ID":"b13871d9-cbf1-4ee6-83ac-ec40652c7f06","Type":"ContainerStarted","Data":"9835d4f5d8b93796baae43839f4974901f36bb6193f252577489d5587af7c73a"} Jul 29 17:45:53.681435 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:53.681392 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" event={"ID":"b13871d9-cbf1-4ee6-83ac-ec40652c7f06","Type":"ContainerStarted","Data":"62c35608af8cdedad01fbddf57daeafc7120f995dac2230c66b80098ee5732a3"} Jul 29 17:45:53.700021 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:53.699966 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" podStartSLOduration=1.483407561 podStartE2EDuration="1.699948032s" totalImagesPullingTime="216.540471ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:45:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:45:53.698978401 +0000 UTC m=+669.303849586" watchObservedRunningTime="2026-07-29 17:45:53.699948032 +0000 UTC m=+669.304819192" Jul 29 17:45:56.938358 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:56.938321 2578 scope.go:117] "RemoveContainer" containerID="5db14ed495429fd3ea2a56bc21665f87f154c210299b6ef225d446b1ecc19d40" Jul 29 17:45:57.700330 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:57.700287 2578 generic.go:356] "Generic (PLEG): container finished" podID="9392d97f-8446-4cc4-b1ff-242989596b74" containerID="70b77ca782ac9f961be68d55cef46a2e21de4488284ef898b7299d30a047d1e8" exitCode=1 Jul 29 17:45:57.700610 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:57.700360 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" event={"ID":"9392d97f-8446-4cc4-b1ff-242989596b74","Type":"ContainerDied","Data":"70b77ca782ac9f961be68d55cef46a2e21de4488284ef898b7299d30a047d1e8"} Jul 29 17:45:57.700610 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:57.700422 2578 scope.go:117] "RemoveContainer" containerID="5db14ed495429fd3ea2a56bc21665f87f154c210299b6ef225d446b1ecc19d40" Jul 29 17:45:57.700802 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:57.700787 2578 scope.go:117] "RemoveContainer" containerID="70b77ca782ac9f961be68d55cef46a2e21de4488284ef898b7299d30a047d1e8" Jul 29 17:45:57.701034 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:45:57.701012 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:45:58.046888 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:58.046797 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:45:58.046888 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:58.046864 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:45:58.706346 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:45:58.706319 2578 scope.go:117] "RemoveContainer" containerID="70b77ca782ac9f961be68d55cef46a2e21de4488284ef898b7299d30a047d1e8" Jul 29 17:45:58.706521 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:45:58.706496 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:46:02.338153 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:46:02.338115 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:46:02.338558 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:46:02.338220 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:46:02.350557 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:46:02.350521 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:46:02.734919 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:46:02.734884 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmddr" Jul 29 17:46:08.937583 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:46:08.937547 2578 scope.go:117] "RemoveContainer" containerID="70b77ca782ac9f961be68d55cef46a2e21de4488284ef898b7299d30a047d1e8" Jul 29 17:46:08.938120 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:46:08.937778 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:46:22.937617 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:46:22.937579 2578 scope.go:117] "RemoveContainer" containerID="70b77ca782ac9f961be68d55cef46a2e21de4488284ef898b7299d30a047d1e8" Jul 29 17:46:22.938211 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:46:22.937803 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:46:37.938282 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:46:37.938198 2578 scope.go:117] "RemoveContainer" containerID="70b77ca782ac9f961be68d55cef46a2e21de4488284ef898b7299d30a047d1e8" Jul 29 17:46:37.938801 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:46:37.938406 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:46:49.937412 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:46:49.937383 2578 scope.go:117] "RemoveContainer" containerID="70b77ca782ac9f961be68d55cef46a2e21de4488284ef898b7299d30a047d1e8" Jul 29 17:46:49.937930 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:46:49.937570 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:47:00.937698 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:00.937664 2578 scope.go:117] "RemoveContainer" containerID="70b77ca782ac9f961be68d55cef46a2e21de4488284ef898b7299d30a047d1e8" Jul 29 17:47:00.938198 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:47:00.937951 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:47:11.937355 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:11.937318 2578 scope.go:117] "RemoveContainer" containerID="70b77ca782ac9f961be68d55cef46a2e21de4488284ef898b7299d30a047d1e8" Jul 29 17:47:11.937933 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:47:11.937575 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:47:22.938363 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:22.938325 2578 scope.go:117] "RemoveContainer" containerID="70b77ca782ac9f961be68d55cef46a2e21de4488284ef898b7299d30a047d1e8" Jul 29 17:47:23.087281 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:23.087242 2578 generic.go:356] "Generic (PLEG): container finished" podID="9392d97f-8446-4cc4-b1ff-242989596b74" containerID="194874468f17573db91a35b664c35845cc209eb7064e463d85f26fc63a87456f" exitCode=1 Jul 29 17:47:23.087517 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:23.087312 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" event={"ID":"9392d97f-8446-4cc4-b1ff-242989596b74","Type":"ContainerDied","Data":"194874468f17573db91a35b664c35845cc209eb7064e463d85f26fc63a87456f"} Jul 29 17:47:23.087517 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:23.087393 2578 scope.go:117] "RemoveContainer" containerID="70b77ca782ac9f961be68d55cef46a2e21de4488284ef898b7299d30a047d1e8" Jul 29 17:47:23.088013 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:23.087741 2578 scope.go:117] "RemoveContainer" containerID="194874468f17573db91a35b664c35845cc209eb7064e463d85f26fc63a87456f" Jul 29 17:47:23.088189 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:47:23.088008 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:47:23.095224 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:47:23.095194 2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9392d97f_8446_4cc4_b1ff_242989596b74.slice/crio-conmon-194874468f17573db91a35b664c35845cc209eb7064e463d85f26fc63a87456f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9392d97f_8446_4cc4_b1ff_242989596b74.slice/crio-194874468f17573db91a35b664c35845cc209eb7064e463d85f26fc63a87456f.scope\": RecentStats: unable to find data in memory cache]" Jul 29 17:47:28.046509 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:28.046458 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:47:28.046964 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:28.046847 2578 scope.go:117] "RemoveContainer" containerID="194874468f17573db91a35b664c35845cc209eb7064e463d85f26fc63a87456f" Jul 29 17:47:28.047042 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:47:28.047022 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:47:38.046037 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:38.045998 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" Jul 29 17:47:38.046523 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:38.046363 2578 scope.go:117] "RemoveContainer" containerID="194874468f17573db91a35b664c35845cc209eb7064e463d85f26fc63a87456f" Jul 29 17:47:38.046564 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:47:38.046537 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:47:43.885549 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:43.885512 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68f6858cb9-52s5l_d1cffe66-94e1-4fa6-847f-c353c4a6fa97/manager/0.log" Jul 29 17:47:44.240419 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:44.240389 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78ccbc8659-5qfg5_59036ae9-21be-4f8c-b333-a62d167e1f3c/copy-manifests/0.log" Jul 29 17:47:44.257954 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:44.257921 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78ccbc8659-5qfg5_59036ae9-21be-4f8c-b333-a62d167e1f3c/manager/0.log" Jul 29 17:47:44.851489 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:44.851458 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-84d5cb6765-bfvhq_80750741-ae4e-4283-b7b8-b74e30c2a3fc/maas-api/0.log" Jul 29 17:47:44.972823 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:44.972797 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755785-bwvb5_b86be55b-3ed8-42ba-ac1f-2f747ea3062d/cleanup/0.log" Jul 29 17:47:45.095852 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:45.095822 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-5vtj4_916d54b9-4baa-4188-b7c9-0182b54348ba/postgres/0.log" Jul 29 17:47:46.525165 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:46.525125 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4bqxx_b668e312-b0fb-4676-bc39-86f7d08e5e97/manager/0.log" Jul 29 17:47:46.865607 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:46.865529 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-brlr5_a6df4794-a766-491f-a674-ce34405cc954/registry-server/0.log" Jul 29 17:47:47.706809 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:47.706775 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-p6nfr_8dfbb46f-4dac-4fe7-a906-35fca3a339a7/discovery/0.log" Jul 29 17:47:47.817704 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:47.817676 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c7886b686-n2bsb_428d05b5-7467-4d7c-b5ce-2d495fa4c6b0/kube-auth-proxy/0.log" Jul 29 17:47:48.045310 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:48.045220 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-52cm4_c3328ef8-221c-4a8a-bfe8-a7711ea25a7d/istio-proxy/1.log" Jul 29 17:47:48.163030 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:48.162999 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-lgmd7_e9f538a5-ace4-4be2-a2b1-4a6ee0429929/payload-pre-processing/0.log" Jul 29 17:47:48.276540 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:48.276508 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-mzc4q_9392d97f-8446-4cc4-b1ff-242989596b74/payload-processing/5.log" Jul 29 17:47:48.738751 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:48.738722 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lwjxx_d9275d3b-1388-4332-a1f2-c18de2e20974/main/0.log" Jul 29 17:47:48.938283 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:48.938249 2578 scope.go:117] "RemoveContainer" containerID="194874468f17573db91a35b664c35845cc209eb7064e463d85f26fc63a87456f" Jul 29 17:47:48.938516 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:47:48.938490 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:47:48.974633 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:48.974591 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-jqggq_6b34dedd-7a2a-4086-b384-ab06acefa644/main/0.log" Jul 29 17:47:49.088364 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:49.088280 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffmn8g_b797127e-a44b-4307-9033-27f5b44f325d/main/0.log" Jul 29 17:47:49.211453 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:49.211427 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-wmddr_b13871d9-cbf1-4ee6-83ac-ec40652c7f06/main/0.log" Jul 29 17:47:57.843414 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:57.843379 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lkrjd_f31b1811-35ad-4bd3-9c49-480e21c0131f/global-pull-secret-syncer/0.log" Jul 29 17:47:58.024516 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:58.024483 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sd7tw_9e5a3362-b8c5-41f1-a88f-4a4a604e070b/konnectivity-agent/0.log" Jul 29 17:47:58.068372 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:47:58.068342 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-247.ec2.internal_782acfccb3f2820d4b0360316ae2b9b0/haproxy/0.log" Jul 29 17:48:02.938099 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:02.938068 2578 scope.go:117] "RemoveContainer" containerID="194874468f17573db91a35b664c35845cc209eb7064e463d85f26fc63a87456f" Jul 29 17:48:02.938607 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:48:02.938241 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:48:03.692054 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:03.692018 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4bqxx_b668e312-b0fb-4676-bc39-86f7d08e5e97/manager/0.log" Jul 29 17:48:03.789665 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:03.789633 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-brlr5_a6df4794-a766-491f-a674-ce34405cc954/registry-server/0.log" Jul 29 17:48:06.044395 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:06.044365 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s5lcz_13342fad-67d3-4cfe-ac0d-03a230f609fa/node-exporter/0.log" Jul 29 17:48:06.066542 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:06.066517 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s5lcz_13342fad-67d3-4cfe-ac0d-03a230f609fa/kube-rbac-proxy/0.log" Jul 29 17:48:06.094876 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:06.094850 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s5lcz_13342fad-67d3-4cfe-ac0d-03a230f609fa/init-textfile/0.log" Jul 29 17:48:08.294373 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.294337 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6"] Jul 29 17:48:08.297048 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.297024 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.299329 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.299305 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k7j72\"/\"openshift-service-ca.crt\"" Jul 29 17:48:08.299465 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.299368 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k7j72\"/\"default-dockercfg-2x995\"" Jul 29 17:48:08.300048 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.300031 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k7j72\"/\"kube-root-ca.crt\"" Jul 29 17:48:08.306415 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.306392 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6"] Jul 29 17:48:08.384770 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.384736 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6f2210e-e62d-4ce3-8291-a739a50f738a-podres\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.384770 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.384776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6f2210e-e62d-4ce3-8291-a739a50f738a-lib-modules\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.384986 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.384850 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swd9n\" (UniqueName: \"kubernetes.io/projected/b6f2210e-e62d-4ce3-8291-a739a50f738a-kube-api-access-swd9n\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.384986 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.384896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6f2210e-e62d-4ce3-8291-a739a50f738a-proc\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.384986 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.384925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6f2210e-e62d-4ce3-8291-a739a50f738a-sys\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.485997 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.485950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6f2210e-e62d-4ce3-8291-a739a50f738a-proc\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.485997 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.486004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6f2210e-e62d-4ce3-8291-a739a50f738a-sys\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.486251 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.486071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6f2210e-e62d-4ce3-8291-a739a50f738a-podres\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.486251 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.486078 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6f2210e-e62d-4ce3-8291-a739a50f738a-proc\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.486251 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.486100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6f2210e-e62d-4ce3-8291-a739a50f738a-lib-modules\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.486251 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.486140 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6f2210e-e62d-4ce3-8291-a739a50f738a-sys\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.486251 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.486179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swd9n\" (UniqueName: \"kubernetes.io/projected/b6f2210e-e62d-4ce3-8291-a739a50f738a-kube-api-access-swd9n\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.486251 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.486212 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6f2210e-e62d-4ce3-8291-a739a50f738a-podres\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.486251 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.486214 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6f2210e-e62d-4ce3-8291-a739a50f738a-lib-modules\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.494573 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.494549 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swd9n\" (UniqueName: \"kubernetes.io/projected/b6f2210e-e62d-4ce3-8291-a739a50f738a-kube-api-access-swd9n\") pod \"perf-node-gather-daemonset-nvxb6\" (UID: \"b6f2210e-e62d-4ce3-8291-a739a50f738a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.607327 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.607228 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:08.736813 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:08.736677 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6"] Jul 29 17:48:08.739123 ip-10-0-131-247 kubenswrapper[2578]: W0729 17:48:08.739093 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb6f2210e_e62d_4ce3_8291_a739a50f738a.slice/crio-5c7f38815d68feccc487b8fa22ab3c49e7a75714c27e057c88e63ce6f67d9e72 WatchSource:0}: Error finding container 5c7f38815d68feccc487b8fa22ab3c49e7a75714c27e057c88e63ce6f67d9e72: Status 404 returned error can't find the container with id 5c7f38815d68feccc487b8fa22ab3c49e7a75714c27e057c88e63ce6f67d9e72 Jul 29 17:48:09.298701 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:09.298665 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" event={"ID":"b6f2210e-e62d-4ce3-8291-a739a50f738a","Type":"ContainerStarted","Data":"f02c08c1e71f1a26fc9615f7e6b7394fc15002066d444e0fc7d43a7f9b2b8e0e"} Jul 29 17:48:09.299136 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:09.298754 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" event={"ID":"b6f2210e-e62d-4ce3-8291-a739a50f738a","Type":"ContainerStarted","Data":"5c7f38815d68feccc487b8fa22ab3c49e7a75714c27e057c88e63ce6f67d9e72"} Jul 29 17:48:09.299136 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:09.298819 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:09.313595 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:09.313544 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" podStartSLOduration=1.313531049 podStartE2EDuration="1.313531049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:48:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:48:09.312833511 +0000 UTC m=+804.917704673" watchObservedRunningTime="2026-07-29 17:48:09.313531049 +0000 UTC m=+804.918402209" Jul 29 17:48:10.972073 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:10.972044 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n2mkr_9a80edd5-e73b-4e4f-8150-63d1eb55488a/dns/0.log" Jul 29 17:48:10.993245 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:10.993222 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n2mkr_9a80edd5-e73b-4e4f-8150-63d1eb55488a/kube-rbac-proxy/0.log" Jul 29 17:48:11.016407 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:11.016377 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mfj6t_a6cf7e7d-5acd-42dd-8014-1eee405b5ab2/dns-node-resolver/0.log" Jul 29 17:48:11.591380 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:11.591340 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5fb6dfcbd7-pjrsb_2ecc6ed2-0dc9-48bd-b293-2937f59c1732/registry/0.log" Jul 29 17:48:11.632860 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:11.632832 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p7ncg_43c3182d-712b-43a5-a854-fa1be60e4a36/node-ca/0.log" Jul 29 17:48:12.691638 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:12.691596 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-p6nfr_8dfbb46f-4dac-4fe7-a906-35fca3a339a7/discovery/0.log" Jul 29 17:48:12.711476 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:12.711435 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c7886b686-n2bsb_428d05b5-7467-4d7c-b5ce-2d495fa4c6b0/kube-auth-proxy/0.log" Jul 29 17:48:12.768627 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:12.768599 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-52cm4_c3328ef8-221c-4a8a-bfe8-a7711ea25a7d/istio-proxy/0.log" Jul 29 17:48:12.770163 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:12.770138 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-52cm4_c3328ef8-221c-4a8a-bfe8-a7711ea25a7d/istio-proxy/1.log" Jul 29 17:48:12.798000 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:12.797968 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-lgmd7_e9f538a5-ace4-4be2-a2b1-4a6ee0429929/payload-pre-processing/0.log" Jul 29 17:48:12.819803 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:12.819776 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-mzc4q_9392d97f-8446-4cc4-b1ff-242989596b74/payload-processing/5.log" Jul 29 17:48:12.819803 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:12.819786 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-mzc4q_9392d97f-8446-4cc4-b1ff-242989596b74/payload-processing/5.log" Jul 29 17:48:13.521174 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:13.521139 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f8ccv_d1651f98-f8ff-4c37-bc66-009f039c298d/serve-healthcheck-canary/0.log" Jul 29 17:48:14.107731 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:14.107684 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-smwjz_156dbf97-91ef-4c18-95c6-a141ad86b210/kube-rbac-proxy/0.log" Jul 29 17:48:14.129134 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:14.129104 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-smwjz_156dbf97-91ef-4c18-95c6-a141ad86b210/exporter/0.log" Jul 29 17:48:14.152445 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:14.152418 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-smwjz_156dbf97-91ef-4c18-95c6-a141ad86b210/extractor/0.log" Jul 29 17:48:14.943615 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:14.943577 2578 scope.go:117] "RemoveContainer" containerID="194874468f17573db91a35b664c35845cc209eb7064e463d85f26fc63a87456f" Jul 29 17:48:14.943810 ip-10-0-131-247 kubenswrapper[2578]: E0729 17:48:14.943770 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=payload-processing pod=payload-processing-5cc6cd444b-mzc4q_openshift-ingress(9392d97f-8446-4cc4-b1ff-242989596b74)\"" pod="openshift-ingress/payload-processing-5cc6cd444b-mzc4q" podUID="9392d97f-8446-4cc4-b1ff-242989596b74" Jul 29 17:48:15.313011 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:15.312927 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-nvxb6" Jul 29 17:48:16.460015 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:16.459979 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68f6858cb9-52s5l_d1cffe66-94e1-4fa6-847f-c353c4a6fa97/manager/0.log" Jul 29 17:48:16.608679 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:16.608648 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78ccbc8659-5qfg5_59036ae9-21be-4f8c-b333-a62d167e1f3c/manager/0.log" Jul 29 17:48:16.626694 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:16.626661 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78ccbc8659-5qfg5_59036ae9-21be-4f8c-b333-a62d167e1f3c/copy-manifests/0.log" Jul 29 17:48:19.150381 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:19.150344 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-p6nfr_8dfbb46f-4dac-4fe7-a906-35fca3a339a7/discovery/0.log" Jul 29 17:48:19.162508 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:19.162480 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c7886b686-n2bsb_428d05b5-7467-4d7c-b5ce-2d495fa4c6b0/kube-auth-proxy/0.log" Jul 29 17:48:19.204089 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:19.204057 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-52cm4_c3328ef8-221c-4a8a-bfe8-a7711ea25a7d/istio-proxy/0.log" Jul 29 17:48:19.205623 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:19.205599 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-52cm4_c3328ef8-221c-4a8a-bfe8-a7711ea25a7d/istio-proxy/1.log" Jul 29 17:48:19.221793 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:19.221761 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-lgmd7_e9f538a5-ace4-4be2-a2b1-4a6ee0429929/payload-pre-processing/0.log" Jul 29 17:48:19.232573 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:19.232538 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-mzc4q_9392d97f-8446-4cc4-b1ff-242989596b74/payload-processing/5.log" Jul 29 17:48:19.232788 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:19.232551 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-mzc4q_9392d97f-8446-4cc4-b1ff-242989596b74/payload-processing/5.log" Jul 29 17:48:20.442614 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:20.442581 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-p6nfr_8dfbb46f-4dac-4fe7-a906-35fca3a339a7/discovery/0.log" Jul 29 17:48:20.453990 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:20.453959 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c7886b686-n2bsb_428d05b5-7467-4d7c-b5ce-2d495fa4c6b0/kube-auth-proxy/0.log" Jul 29 17:48:20.491925 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:20.491896 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-52cm4_c3328ef8-221c-4a8a-bfe8-a7711ea25a7d/istio-proxy/0.log" Jul 29 17:48:20.493315 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:20.493295 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-52cm4_c3328ef8-221c-4a8a-bfe8-a7711ea25a7d/istio-proxy/1.log" Jul 29 17:48:20.513781 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:20.513754 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-lgmd7_e9f538a5-ace4-4be2-a2b1-4a6ee0429929/payload-pre-processing/0.log" Jul 29 17:48:20.526210 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:20.526183 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-mzc4q_9392d97f-8446-4cc4-b1ff-242989596b74/payload-processing/5.log" Jul 29 17:48:20.527046 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:20.527027 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-mzc4q_9392d97f-8446-4cc4-b1ff-242989596b74/payload-processing/5.log" Jul 29 17:48:24.832580 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:24.832546 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2vlbk_0208514f-816a-4d0b-ac41-1ceea22d19b1/kube-multus/0.log" Jul 29 17:48:25.197300 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:25.197275 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zkcmj_d9f1bcbb-a128-4b58-a2b8-78060c048d1d/kube-multus-additional-cni-plugins/0.log" Jul 29 17:48:25.221738 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:25.221686 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zkcmj_d9f1bcbb-a128-4b58-a2b8-78060c048d1d/egress-router-binary-copy/0.log" Jul 29 17:48:25.246117 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:25.246092 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zkcmj_d9f1bcbb-a128-4b58-a2b8-78060c048d1d/cni-plugins/0.log" Jul 29 17:48:25.268044 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:25.268015 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zkcmj_d9f1bcbb-a128-4b58-a2b8-78060c048d1d/bond-cni-plugin/0.log" Jul 29 17:48:25.289122 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:25.289096 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zkcmj_d9f1bcbb-a128-4b58-a2b8-78060c048d1d/routeoverride-cni/0.log" Jul 29 17:48:25.311168 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:25.311135 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zkcmj_d9f1bcbb-a128-4b58-a2b8-78060c048d1d/whereabouts-cni-bincopy/0.log" Jul 29 17:48:25.333644 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:25.333616 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zkcmj_d9f1bcbb-a128-4b58-a2b8-78060c048d1d/whereabouts-cni/0.log" Jul 29 17:48:25.472668 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:25.472573 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-95tg5_09c4bcf7-1764-48d5-9610-eaacef66e261/network-metrics-daemon/0.log" Jul 29 17:48:25.491875 ip-10-0-131-247 kubenswrapper[2578]: I0729 17:48:25.491850 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-95tg5_09c4bcf7-1764-48d5-9610-eaacef66e261/kube-rbac-proxy/0.log"